A Survey of Application Layer Techniques for Adaptive Streaming of Multimedia

Though the integrated services model and resource reservation protocol (RSVP) provide support for quality of service, in the current Internet only best-effort traffic is widely supported. New high-speed technologies such as ATM (asynchronous transfer mode), gigabit Ethernet, fast Ethernet, and frame relay, have spurred higher user expectations. These technologies are expected to support real-time applications such as video-on-demand, Internet telephony, distance education and video-broadcasting. Towards this end, networking methods such as service classes and quality of service models are being developed. Today's Internet is a heterogeneous networking environment. In such an environment, resources available to multimedia applications vary. To adapt to the changes in network conditions, both networking techniques and application layer techniques have been proposed. In this paper, we focus on the application level techniques, including methods based on compression algorithm features, layered encoding, rate shaping, adaptive error control, and bandwidth smoothing. We also discuss operating system methods to support adaptive multimedia. Throughout the paper, we discuss how feedback from lower networking layers can be used by these application-level adaptation schemes to deliver the highest quality content.

[1]  Wu-chi Feng,et al.  Rate-constrained bandwidth smoothing for delivery of stored video , 1997, Electronic Imaging.

[2]  N. Duffield,et al.  SAVE: an algorithm for smoothed adaptive video over explicit rate networks , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[3]  Tatsuya Suda,et al.  Adaptive multicast of multi-layered video: rate-based and credit-based approaches , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[4]  Mohammed Atiquzzaman,et al.  Multimedia over ATM: progress, status and future , 1998, Proceedings 7th International Conference on Computer Communications and Networks (Cat. No.98EX226).

[5]  Donald F. Towsley,et al.  Adaptive FEC-based error control for Internet telephony , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[6]  Steven McCanne,et al.  Simulation of FEC-based error control for packet audio on the Internet , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[7]  Guru M. Parulkar,et al.  Efficient user-space protocol implementations with QoS guarantees using real-time upcalls , 1998, TNET.

[8]  Wu-chi Feng,et al.  Critical bandwidth allocation for the delivery of compressed video , 1995, Comput. Commun..

[9]  Zhi-Li Zhang,et al.  A network-conscious approach to end-to-end video delivery over wide area networks using proxy servers , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[10]  Alexandros Eleftheriadis,et al.  Optimal data partitioning of MPEG-2 coded video , 1994, Proceedings of 1st International Conference on Image Processing.

[11]  P. Pancha,et al.  Prioritized transmission of variable bit rate MPEG video , 1992, [Conference Record] GLOBECOM '92 - Communications for Global Users: IEEE.

[12]  David K. Y. Yau,et al.  An algorithm for lossless smoothing of MPEG video , 1994, SIGCOMM 1994.

[13]  Magda El Zarki,et al.  Bandwidth-allocation schemes for variable-bit-rate MPEG sources in ATM networks , 1993, IEEE Trans. Circuits Syst. Video Technol..

[14]  Myung J. Lee,et al.  Multipoint Multimedia Teleconference System with Adaptive Synchronization , 1996, IEEE J. Sel. Areas Commun..

[15]  Yongcheng Li,et al.  Real-Time Video and Audio in the World Wide Web , 1995, World Wide Web J..

[16]  Calton Pu,et al.  Player for adaptive MPEG video streaming over the Internet , 1998, Other Conferences.

[17]  Jean Bolot,et al.  Adaptive FEC-Based Error Control for Interactive Audio in the Internet , 1998 .

[18]  Kevin Jeffay,et al.  The performance of two-dimensional media scaling for Internet videoconferencing , 2001 .

[19]  Raj Yavatkar,et al.  Integrated CPU and network-I/O QoS management in an endsystem , 1998, Comput. Commun..

[20]  Lawrence A. Rowe,et al.  Design and performance of the Berkeley Continuous Media Toolkit , 1997, Electronic Imaging.

[21]  Xue Li,et al.  Layered video multicast with retransmission (LVMR): evaluation of error recovery schemes , 1997, Proceedings of 7th International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV '97).

[22]  Michael R. Frater,et al.  MPEG 2 video error resilience experiments: : The importance considering the impact of the systems layer , 1999, Signal Process. Image Commun..

[23]  Srihari Nelakuditi,et al.  Efficient selective frame discard algorithms for stored video delivery across resource constrained networks , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[24]  Wu-chi Feng,et al.  A comparison of bandwidth smoothing techniques for the transmission of prerecorded compressed video , 1997, Proceedings of INFOCOM '97.

[25]  Thierry Turletti,et al.  Experience with control mechanisms for packet video in the internet , 1998, CCRV.

[26]  David K. Y. Yau,et al.  Adaptive rate-controlled scheduling for multimedia applications , 1997, TNET.

[27]  Vaduvur Bharghavan,et al.  An adaptive transport protocol for multimedia communication , 1998, Proceedings. IEEE International Conference on Multimedia Computing and Systems (Cat. No.98TB100241).

[28]  T. V. Lakshman,et al.  VBR video: tradeoffs and potentials , 1998, Proc. IEEE.

[29]  Henning Schulzrinne,et al.  Real Time Streaming Protocol (RTSP) , 1998, RFC.

[30]  Donald F. Towsley,et al.  Supporting stored video: reducing rate variability and end-to-end resource requirements through optimal smoothing , 1998, TNET.

[31]  Yiwei Thomas Hou,et al.  Network bandwidth sharing for transporting rate-adaptive packet video using feedback , 1998, IEEE GLOBECOM 1998 (Cat. NO. 98CH36250).

[32]  Xue Li,et al.  Multisession rate control for layered video multicast , 1998, Electronic Imaging.

[33]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[34]  James E. Fowler,et al.  Adaptive vector quantization of image sequences using generalized threshold replenishment , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[35]  Thierry Turletti,et al.  A rate control mechanism for packet video in the Internet , 1994, Proceedings of INFOCOM '94 Conference on Computer Communications.

[36]  Yiwei Thomas Hou,et al.  On network bandwidth sharing for transporting rate-adaptive packet video using feedback , 2000, Int. J. Commun. Syst..

[37]  Mi-Jeong Lee,et al.  A Selective Layer Discard Algorithm for Stored Video Delivery over Resource Constrained Networks , 2001 .

[38]  P. Venkat Rangan,et al.  Enforcing application-level QoS by frame-induced packet discarding in video communications , 1995, Comput. Commun..

[39]  Jo Yew Tham,et al.  Highly scalable wavelet-based video codec for very low bit-rate environment , 1998, IEEE J. Sel. Areas Commun..

[40]  Wenjun Zeng,et al.  Rate shaping by block dropping for transmission of MPEG-precoded video over channels of dynamic bandwidth , 1997, MULTIMEDIA '96.

[41]  C.-C. Jay Kuo,et al.  Rate control for an embedded wavelet video coder , 1997, IEEE Trans. Circuits Syst. Video Technol..

[42]  Wu-chi Feng,et al.  Priority-based technique for the best-effort delivery of stored video , 1998, Electronic Imaging.

[43]  Hui Zhang,et al.  Design and Implementation of a Video On-Demand System , 1998, Comput. Networks.

[44]  Wu-chi Feng,et al.  An optimal bandwidth allocation strategy for the delivery of compressed prerecorded video , 1997, Multimedia Systems.

[45]  Avideh Zakhor,et al.  A common framework for rate and distortion based scaling of highly scalable compressed video , 1996, IEEE Trans. Circuits Syst. Video Technol..

[46]  Keith W. Ross,et al.  Video-on-Demand Over ATM: Constant-Rate Transmission and Transport , 1996, IEEE J. Sel. Areas Commun..

[47]  James E. Fowler,et al.  Real-time video compression using differential vector quantization , 1995, IEEE Trans. Circuits Syst. Video Technol..

[48]  Martin Vetterli,et al.  Receiver-driven layered multicast , 1996, SIGCOMM 1996.

[49]  Jean-Chrysostome Bolot,et al.  Control mechanisms for packet audio in the Internet , 1996, Proceedings of IEEE INFOCOM '96. Conference on Computer Communications.

[50]  Donald F. Towsley,et al.  Proxy prefix caching for multimedia streams , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[51]  Nariman Farvardin,et al.  Three-dimensional subband coding of video , 1995, IEEE Trans. Image Process..

[52]  Hui Zhang,et al.  Resilient multicast support for continuous-media applications , 1997, Proceedings of 7th International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV '97).

[53]  Wu-chi Feng,et al.  Online smoothing of live, variable-bit-rate video , 1997, Proceedings of 7th International Workshop on Network and Operating System Support for Digital Audio and Video (NOSSDAV '97).