Modelling dependency in multimedia streams

Expressing and analysing data dependency in multimedia streams is promising, since content-aware policies at a transport level would benefit from such services. In this paper we present a format-independent dependency model aimed at specifying, validating and reasoning about structural dependency in multimedia streams. Based on this model, we developed a universal dependency description language and a dependency validation service to serve as an infrastructure for content-aware transport layers. Driven by application knowledge, this special form of a cross-layer design enables lower layers to reason about the impact of data loss and drops during transmission while being unaware of the real data format.We outline, how this infrastructure can be used to build content-aware error protection policies and explain how applications need to specify dependency and prepare media streams in order to gain benefits from those policies. While costs and benefits of a dependency model are only quantifiable in conjunction with special policies, we report on the general worst-case costs of our model here.

[1]  Ketan Mayer-Patel,et al.  An MPEG performance model and its application to adaptive forward error correction , 2002, MULTIMEDIA '02.

[2]  Gerhard Fohler,et al.  Quality aware MPEG-2 stream adaptation in resource constrained systems , 2004, Proceedings. 16th Euromicro Conference on Real-Time Systems, 2004. ECRTS 2004..

[3]  Alexandros Eleftheriadis,et al.  Flavor: a formal language for audio-visual object representation , 2004, MULTIMEDIA '04.

[4]  Ye Wang,et al.  A framework for robust and scalable audio streaming , 2004, MULTIMEDIA '04.

[5]  Christos Papadopoulos,et al.  Retransmission-Based Error Control for Continuous Media Applications , 1996 .

[6]  Minoru Etoh,et al.  Advances in Wireless Video Delivery , 2005, Proceedings of the IEEE.

[7]  Wu-chi Feng,et al.  Quality-adaptive media streaming by priority drop , 2003, NOSSDAV '03.

[8]  Shipeng Li,et al.  Error-resilient unequal protection of fine granularity scalable video bitstreams , 2004, 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577).

[9]  Xiao Su,et al.  A survey of error-concealment schemes for real-time audio and video transmissions over the Internet , 2000, Proceedings International Symposium on Multimedia Software Engineering.

[10]  Bernd Girod,et al.  Layered coding vs. multiple descriptions for video streaming over multiple paths , 2003, ACM Multimedia.

[11]  D. Clark,et al.  Study Case : Architectural Considerations for a New Generation of Protocols Page 1 Study case : Architectural consideration for a new generation of protocols ( , 2006 .

[12]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[13]  Thierry Turletti,et al.  Adaptive error control for packet video in the Internet , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[14]  Winfried E. Kühnhauser,et al.  Towards a structure-aware failure semantics for streaming media communication models , 2005, J. Parallel Distributed Comput..

[15]  Philip A. Chou,et al.  Application layer error-correction coding for rate-distortion optimized streaming to wireless clients , 2002, IEEE Transactions on Communications.

[16]  David Clark,et al.  Architectural considerations for a new generation of protocols , 1990, SIGCOMM 1990.

[17]  Jean Cardinal,et al.  Efficient rate-distortion optimized media streaming for tree-reducible packet dependencies , 2006, Electronic Imaging.

[18]  Jari Korhonen,et al.  Packetization Scheme for Streaming High-Quality Audio over Wireless Links , 2003, MIPS.

[19]  Steven McCanne,et al.  Soft ARQ for Layered Streaming Media , 2001, J. VLSI Signal Process..

[20]  Christian Timmerer,et al.  Bitstream syntax description-based adaptation in streaming and constrained environments , 2005, IEEE Transactions on Multimedia.

[21]  Özgür Gürbüz,et al.  Rate distortion optimized joint ARQ-FEC scheme for real-time wireless multimedia , 2005, IEEE International Conference on Communications, 2005. ICC 2005. 2005.

[22]  Gary J. Sullivan,et al.  Video Compression - From Concepts to the H.264/AVC Standard , 2005, Proceedings of the IEEE.

[23]  Martin Homann Towards a Structure-Aware Failure Semantics for Streaming Media Communication Models , 2005 .

[24]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..