On-line (Internet) Audio/Video

Index

General





IPTV Video over Internet
media video resolution
480i, 576i, 720p, 1080i, 1080p (any)
codec
  • MPEG-2
  • MPEG4-AVC/H264
  • VC-1
(any)
container
  • MPEG-2 TS
  • (direct)
  • MP4
  • QuickTime
  • WMedia
  • RealNetworks
  • Flash Video
  • ...
service discovery

SD&S
transmission progressive download
  • HTTP
  • FTP
- x
streaming live
video MPEG-2 RFC 2250
H264 RFC 3984
VC-1 RFC 4425
audio AAC RFC 3640
AMR-WB+ RFC 4352

x
on-demand x x
network delivery unicast
content on-demand x
multicast
x x
p2p
- x
receiver STB
x -
PC
  • Media Centre
  • browser (RTSP)
  • media player (RTP/RTCP)

Streaming


protocol
owner / standard
delivery format
codecs
manifest
DRM
servidor (HTTP Streaming software)
HTML
client
examples
MPEG-2 TS

MP4

FLV

ISMV (ISOBMFF)

WebM

video
audio
other

m3u8

mpd

preparation
distribution
MPEG-2 video
AVC / H.264
SVC
VP8
AAC
MP3
RTP / RTSP
RFC 3550 / RFC 2326





RFC 2250
RFC 3640 / 3016







RFC 3984
RFC draft







HTTP
(docs)
(software)
RTMP
  • Adobe


x








fmf




  • Flash Media Server
  • Red5

  • Flash player
  • ...
HTTP Dynamic Streaming

x
x

















HTTP Live Streaming (HLS)
x





x



  • AAC
  • MP3

x
-

  • regular HTTP server, with mime-types, at httpd.conf:
    • AddType application/x-mpegURL .m3u8
    • AddType video/MP2T .ts
<video src='prog_index.m3u8' controls='on'/>
MPEG-DASH MPEG-B part 6
MPEG 23009
x
x






-
mpd
  • mime-types, httpd.conf (Apache):
    • AddType video/vnd.3gpp.mpd .mpd
    • AddType application/dash+xml .mpd
    • AddType video/mp4 .m4s
  • DASH-JS (Javascript + HTML5 + WebM + Chrome)
AHS 3GPP
-
x

















3GP-DASH
3GPP
TS26.247



















HAS
OIPF vol 2a (based on AHS)
x
ISOBMFF










-
x






WebM project




x














Smooth Streaming
(Microsoft IIS Media Services): spec
Microsoft



x







  • ism/isml
  • csm






protocol


owner / standard

MPEG-2 TS

MP4

FLV

ISMV (ISOBMFF)

WebM
MPEG-2 video
AVC / H.264
SVC
VP8
AAC
MP3
other
m3u8 mpd DRM
preparation

distribution
HTML
client
examples
video
audio
delivery format
codecs
manifest servidor (HTTP Streaming software)

streaming
protocol documents
RTP/RTCP UDP
IETF RFC audio video RTP packet
number name header payload
PT ...
3550
1889
RTP



3555 MIME type registration MIME type


3551 AV profile  x x x

3640 MPEG-4 Elementary streams MPEG4 ES
(AAC,...)



AU header
section
auxiliary section access unit data
section
agg
AU headers length AU header 1 AU header 2

AU size AU index CTS flag CTS delta DTS flag DTS delta RAP flag stream state
...

AU 1 AU 2
frag
AU header

AU 1 / fragment 1
AU header

AU 1 / fragment 2
3016 MPEG4 AV MPEG4


3119 Loss-tolerant MP3 MP3 -


3267 Payload and file storage AMR, AMR-WB AMR, AMR-WB -


4352 Payload AMR-WB+ AMR-WB+



2250 MPEG-1/2 video - MPEG-1/2


2429 H.263 video - H.263


3984 Payload H.264 video - H.264

NAL unit
NAL header payload
F NRI nal_unit_type
...
draft-svc (diff)
Payload SVC video - SVC


4425 Payload VC-1 video - VC-1


RTSP (.org) (tricky mode)  TCP
RSVP

SDP
SAP

HTTP Adaptive Streaming

(general)
HLS
  • A Review of HTTP Live Streaming (Andrew Fecheyr-Lippens) (pdf)
DASH
MSSH



Implementations:

owner community license language features used by notes
GPL LGPL other C C++ Java RTP RTCP SRTP RTSP SDP SAP SIP
generic
(3550)
MPEG-4
(3640)
H.264
(3984)
ccRTP GNU
x (le)


x
x

x






jlibrtp






x










jrtplib Jori


x
x
x









libgstrtp GStreamer

x














librtp GPhone
x

x

x









libsrtp











x





live555


x

x
x x - x
x

x
oRTP Linphone

x
x

x









PJMEDIA Pernau

x



x






x

RTPlib Lucent


Non exclusive x

x









RTSP toolkit IBM











x




UCL RTP UCL



x

x




x


Vovida RTP Vovida


VOCAL
x
x



x




TML with KorFMD (H264 reference software) Suhering



x



x







SDP
freesdp GNU
x










x




HP


private








x




INRIA

x









x




Tampere University

x









x



NetSDP

x
Perl-art








x



SinisterSDP


x









x



streaming applications
Darwin Apple











x



hinted mp4 files
dvbstream



















Helix DNA Server


















LIVE555 Media Server













x





MPEG4IP



MPL (for own)


UCL x x

Darwin (own)


live
VideoLAN/VLC







x - -






MPEG-2 TS
mp4_streamer (GPAC applications/testapps)








x


-



mp4 files
multimedia frameworks

  • RTP header (IETF RFC 3550: section 5.1):
    0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1
    V=2 P X CC M PT sequence_number
    timestamp
    synchronization source (SSRC) identifier
    contributing source (CSRC) identifiers
    • V: Version
    • P: Padding
    • X: Extension
    • CC: CSRC count
    • M: marker
    • PT: payload type
  • NAL header / nal_unit_type
  • H264/RTP (IETF RFC 3984):

    RTP packet
    one several
    NAL unit one single fragmentation
    several aggregation -
    .

    single NAL aggregation fragmentation unit
    STAP MTAP FU-A FU-B
    A
    (w/o DON)
    B
    (w DON)
    16-bits
    offset
    timestamp
    24-bits
    offset
    timestamp


    NAL unit type -> 1-23 24 25 26 27 28 29
    packetization modes single NAL
    x





    non-interleaved

    x


    x
    interleaved


    x x x x x
  • .
    frame AU layer slice NAL RTP
    # #

    type PT SN timestamp marker
    - 0

    8: PPS (96) 0 0
    1 1 base i 5: slice IDR 1 0 0
    ii 5: slice IDR 2 1?
    enh sp1 i 21: slice IDR scal 3 0
    ii 21: slice IDR scal 4 1?
    2 2 base i 2: slice A 5 3600 0
    ii 2: slice A 6 1
    3 3 base i 28: FU-A 7 7200 0
    8 0
    ii 1: slice non-IDR 9 1?
    enh sp1 i 20: slice non-IDR scal 10 0
    enh sp2 i 20: slice non-IDR scal 11 1?
    4 4 base i MTAP 12 14400 1
    5 5 base i
    .

Audio/Video

Descàrrega progressiva / Progressive download

Programari / Software

Projectes europeus / European projects

Conferències / Conferences

Música / Music

Platform Components Technology Where / affiliates
Pressplay
(Duet)
  • Sony
  • Vivendi Universal
  • EMI
  • Madacy, Navarre, OWIE, Razor & Tie, Roadrunner, Rounder
  • TVT Records
  • Zomba

Musicnet

  • Virgin
  • HMV
Tornado

Xarxes CDN / Content Delivery Networks (CDN)

Gestió de drets / Rights Management (DRM)

Xifratge / Encryption

  • Estaǹdards / Standards
  • Eines / Tools

    command (Bento4)
    standard
    encrypt
    decrypt
    DCF
    mp4dcfpackager --method CTR
    --content-id cid:toto
    --key 000102030405060708090a0b0c0d0e0f:00000000000000000000000000000000
    toto.mp4 toto.dcf
    mp4decrypt
    --key 1:00112233445566778899aabbccddeeff
    toto.dcf toto.odf
    mp4extract toto.odf
    PDCF
    mp4encrypt --method OMA-PDCF-CTR
    --key 1:000102030405060708090a0b0c0d0e0f:0000000000000000
    --key 2:000102030405060708090a0b0c0d0e0f:0000000000000000
    toto.mp4 toto.pdcf
    mp4decrypt
    --key 1:000102030405060708090a0b0c0d0e0f:0000000000000000
    --key 2:000102030405060708090a0b0c0d0e0f:0000000000000000
    toto.pdcf toto.mp4

Gestió de pagaments / Payment management

Formats (*)

Continguts / Contents

Seqüències / Sequencies

P2P (Peer to peer)

Reproductors MP3 Players



dim LCD ràdio recording bluetooth video doc preu





dim res colors FM RDS FM line mic


1GB
(Z)
2GB (Q) 4GB
(A)










live prog







Samsung YP-F2R 28 52 15


x x -
-






YP-T7 37 62 14
96x96 65K - - -
-
-




YP-T7F 37 62 14 1,2" 96x96 262K x x x x x
- MPEG4
135, 138+9+iva

YP-T8 44 83 15 1,8" 128x160 262K x - x


-


169
YP-T9J
(unoff)
43 83 11 1,8" 172x220 262K x x x - - x x SVI: XVID 208x176 15 fps pdf 169+9+iva 155+9,9ii
189+9+iva
169+22ii
239+9+iva
199+22ii
YP-Z5F 42 90 12 1,8" 128x160
x x x
-

MPEG4
118 159, 149
F: FM
X: 512MB
Z: 1GB
Q: 2GB
A: 4GB

http://www.francescpinyol.cat/online_audio_video.html
Darrera modificació: 24 de febrer de 2014 / Last update: 24th February 2014

Cap a casa / Back home.