Mechanisms for Adapting Compressed Multimedia to Varying Bandwidth Conditions

Publisher Summary This chapter discusses the mechanisms for adapting compressed multimedia for varying bandwidth conditions. These mechanisms allow applications to adjust gracefully to changes in available channel bandwidth. Without these adaptation tools, the changes in available bandwidth will lead to significant quality degradation, leading occasionally to total service interruption. This is an even more pressing need when one considers the increasing heterogeneity of both networks and network access devices. The chapter classifies bandwidth adaptation architectures based on three basic design decisions— namely, the selection of adaptation points, decision agents, and source coding techniques. Bandwidth adaptation is made based on available source and channel information. The source-related information is known more accurately at the sender end, while channel information is more accurate at the client end. A proxy, located in the middle of the network, can achieve a good compromise between server and client adaptation.

[1]  Mohammed Ghanbari,et al.  Post-processing of MPEG2 coded video for transmission at lower bit rates , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[2]  Bernd Girod,et al.  Adaptive playout scheduling and loss concealment for voice communication over IP networks , 2003, IEEE Trans. Multim..

[3]  Bernd Girod,et al.  Robust H.263 compatible video transmission for mobile access to video servers , 1997, Proceedings of International Conference on Image Processing.

[4]  Bernd Girod,et al.  Rate-distortion optimized packet scheduling and routing for media streaming with path diversity , 2003, Data Compression Conference, 2003. Proceedings. DCC 2003.

[5]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[6]  Antonio Ortega,et al.  Rate control for robust video transmission over burst-error wireless channels , 1999, IEEE J. Sel. Areas Commun..

[7]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[8]  Mihaela van der Schaar,et al.  Rate-distortion-complexity modeling for network and receiver aware adaptation , 2005, IEEE Transactions on Multimedia.

[9]  Albert Wang,et al.  Error control for receiver-driven layered multicast of audio and video , 2001, IEEE Trans. Multim..

[10]  Neri Merhav,et al.  Multiplication-free approximate algorithms for compressed-domain linear operations on images , 1999, IEEE Trans. Image Process..

[11]  Bernd Girod,et al.  Rate-distortion optimized streaming of video with multiple independent encodings , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[12]  Mihaela van der Schaar,et al.  Near-lossless complexity-scalable embedded compression algorithm for cost reduction in DTV receivers , 2000, IEEE Trans. Consumer Electron..

[13]  A. Ortega,et al.  Fast adaptive media scheduling based on expected run-time distortion , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[14]  Martin Vetterli,et al.  Receiver-driven layered multicast , 1996, SIGCOMM 1996.

[15]  Bernd Girod,et al.  Rate-distortion hint tracks for adaptive video streaming , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Shih-Fu Chang,et al.  Manipulation and Compositing of MC-DCT Compressed Video , 1995, IEEE J. Sel. Areas Commun..

[17]  J. Bennett,et al.  Advanced video coding , 2003 .

[18]  Michael R. Frater,et al.  Scalable video coding by stream morphing , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Ming-Ting Sun,et al.  Digital Video Transcoding , 2005 .

[20]  Reza Rejaie,et al.  Adaptive receiver-driven streaming from multiple senders , 2006, Multimedia Systems.

[21]  Antonio Ortega,et al.  Scalable proxy caching of video under storage constraints , 2002, IEEE J. Sel. Areas Commun..

[22]  Antonio Ortega,et al.  Complexity-scalable transform coding using variable complexity algorithms , 2000, Proceedings DCC 2000. Data Compression Conference.

[23]  John G. Apostolopoulos,et al.  On multiple description streaming with content delivery networks , 2002, Proceedings.Twenty-First Annual Joint Conference of the IEEE Computer and Communications Societies.

[24]  Mohammed Ghanbari,et al.  A frequency-domain video transcoder for dynamic bit-rate reduction of MPEG-2 bit streams , 1998, IEEE Trans. Circuits Syst. Video Technol..

[25]  Sanjit K. Mitra,et al.  Rate-distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standard , 1996, IEEE Trans. Circuits Syst. Video Technol..

[26]  Wei Ding,et al.  Rate control of MPEG video coding and recording by rate-quantization modeling , 1996, IEEE Trans. Circuits Syst. Video Technol..

[27]  Alan N. Willson,et al.  Rate-distortion optimal motion estimation algorithms for motion-compensated transform video coding , 1998, IEEE Trans. Circuits Syst. Video Technol..

[28]  Mihaela van der Schaar,et al.  Adaptive motion-compensation fine-granular-scalability (AMC-FGS) for wireless video , 2002, IEEE Trans. Circuits Syst. Video Technol..

[29]  Antonio Ortega,et al.  Robust video communication by combining scalability and multiple description coding techniques , 2003, IS&T/SPIE Electronic Imaging.

[30]  Oliver Werner,et al.  Requantization for transcoding of MPEG-2 intraframes , 1999, IEEE Trans. Image Process..

[31]  S.K. Mitra,et al.  From rate-distortion analysis to resource-distortion analysis , 2005, IEEE Circuits and Systems Magazine.

[32]  Ming-Ting Sun,et al.  Fast video transcoding architectures for networked multimedia applications , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[33]  Anthony Vetro,et al.  Video transcoding architectures and techniques: an overview , 2003, IEEE Signal Process. Mag..

[34]  Antonio Ortega,et al.  Probabilistic partial-distance fast matching algorithms for motion estimation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[35]  Antonio Ortega,et al.  Erasure recovery in predictive coding environments using multiple description coding , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[36]  Athanasios Leontaris,et al.  Comparison of blocking and blurring metrics for video compression , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[37]  Feng Wu,et al.  A framework for efficient progressive fine granularity scalable video coding , 2001, IEEE Trans. Circuits Syst. Video Technol..

[38]  Iraj Sodagar,et al.  Scalable wavelet coding for synthetic/natural hybrid images , 1999, IEEE Trans. Circuits Syst. Video Technol..

[39]  Antonio Ortega,et al.  Scalable variable complexity approximate forward DCT , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Antonio Ortega,et al.  PALS: peer-to-peer adaptive layered streaming , 2003, NOSSDAV '03.

[41]  Alan F. Lippman,et al.  Video coding for streaming media delivery on the Internet , 2001, IEEE Trans. Circuits Syst. Video Technol..

[42]  Bernd Girod,et al.  Prescient R-D optimized packet dependency management for low-latency video streaming , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[43]  Tihao Chiang,et al.  A robust fine granularity scalability using trellis-based predictive leak , 2002, IEEE Trans. Circuits Syst. Video Technol..

[44]  Oscar C. Au,et al.  Parameter estimation for image/video transcoding , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[45]  Marta Karczewicz,et al.  The SP- and SI-frames design for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[46]  Kenneth Rose,et al.  Toward optimality in scalable predictive coding , 2001, IEEE Trans. Image Process..

[47]  Boon-Lock Yeo,et al.  A fast algorithm for DCT-domain inverse motion compensation based on shared information in a macroblock , 2000, IEEE Trans. Circuits Syst. Video Technol..

[48]  Antonio Ortega,et al.  Bit-rate control using piecewise approximated rate-distortion characteristics , 1998, IEEE Trans. Circuits Syst. Video Technol..

[49]  Vivek K. Goyal,et al.  Multiple description coding: compression meets the network , 2001, IEEE Signal Process. Mag..

[50]  Helen J. Wang,et al.  Resilient peer-to-peer streaming , 2003, 11th IEEE International Conference on Network Protocols, 2003. Proceedings..

[51]  S.A. Karunasekera,et al.  A distortion measure for image artifacts based on human visual sensitivity , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[52]  Avideh Zakhor,et al.  Multiple sender distributed video streaming , 2004, IEEE Transactions on Multimedia.

[53]  Chia-Wen Lin,et al.  Fast algorithms for DCT-domain video transcoding , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[54]  Bernd Girod,et al.  Rate-constrained motion estimation , 1994, Other Conferences.

[55]  Hsueh-Ming Hang,et al.  Source model for transform video coder and its application. I. Fundamental theory , 1997, IEEE Trans. Circuits Syst. Video Technol..

[56]  Slawomir Mackowiak,et al.  Spatio-temporal scalability for MPEG video coding , 2000, IEEE Trans. Circuits Syst. Video Technol..

[57]  Sung-Ju Lee,et al.  Caching strategies in transcoding-enabled proxy systems for streaming media distribution networks , 2004, IEEE Transactions on Multimedia.

[58]  Huifang Sun,et al.  Architectures for MPEG compressed bitstream scaling , 1996, IEEE Trans. Circuits Syst. Video Technol..

[59]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[60]  Yao Wang,et al.  Multiple Description Coding for Video Delivery , 2005, Proceedings of the IEEE.

[61]  Philip A. Chou,et al.  Rate-distortion optimized sender-driven streaming over best-effort networks , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[62]  Alexandros Eleftheriadis,et al.  Constrained and general dynamic rate shaping of compressed digital video , 1995, Proceedings., International Conference on Image Processing.

[63]  Antonio Ortega,et al.  Efficient scalable encoding for distributed speech recognition , 2006, Speech Commun..

[64]  Wen Gao,et al.  Seamless switching of scalable video bitstreams for efficient streaming , 2004, IEEE Transactions on Multimedia.

[65]  Michael R. Frater,et al.  Efficient drift-free signal-to-noise ratio scalability , 2000, IEEE Trans. Circuits Syst. Video Technol..

[66]  Weiping Li,et al.  Overview of fine granularity scalability in MPEG-4 video standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[67]  Hironao Hori,et al.  Rate conversion of MPEG coded video by re-quantization process , 1995, Proceedings., International Conference on Image Processing.

[68]  Rui Zhang,et al.  Optimized video streaming over lossy networks with real-time estimation of end-to-end distortion , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[69]  Bernd Girod,et al.  Rate-distortion optimized streaming from the edge of the network , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[70]  André Vincent,et al.  Selective requantization for transcoding of MPEG compressed video , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[71]  Gene Cheung,et al.  Directed acyclic graph based source modeling for data unit selection of streaming media over QoS networks , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[72]  Antonio Ortega,et al.  Joint Selection of Source and Channel Rate for VBR Video Transmission Under ATM Policing Constraints , 1997, IEEE J. Sel. Areas Commun..

[73]  Mohammed Ghanbari,et al.  A multi-metric objective picture-quality measurement model for MPEG video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[74]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.