Error-Resilient Coding and Decoding Strategies for Video Communication

Publisher Summary This chapter discusses the error-resilient coding and decoding strategies for video communication. It is important to understand that video can benefit significantly if the transmitter can be sure that the video will be delivered reliably. Typically, the introduction of error-resilience tools in the video coding layer is very costly in terms of compression efficiency. The overhead is in general much better spent in lower layers of the protocol stack. Nevertheless, there exist applications in which errors are inevitable. If the video encoder is not aware of distortions on the transmission link, this in general leads to dramatic quality degradations due to instantaneous errors as well as spatial-temporal error propagation. Whereas the effect of instantaneous errors can be decreased by the use of specific packetization modes, the usually more severe effect of error propagation can be reduced by the application of more frequent intra-information, interactive error control, or a combination of both.

[1]  Hua Yang,et al.  Source-channel prediction in error resilient video coding , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[2]  Gary J. Sullivan,et al.  Video Compression - From Concepts to the H.264/AVC Standard , 2005, Proceedings of the IEEE.

[3]  Xiao Su,et al.  A survey of error-concealment schemes for real-time audio and video transmissions over the Internet , 2000, Proceedings International Symposium on Multimedia Software Engineering.

[4]  Ness B. Shroff,et al.  Error concealment techniques for encoded video streams , 1995, Proceedings., International Conference on Image Processing.

[5]  Teresa H. Y. Meng,et al.  Transform coded image reconstruction exploiting interblock correlation , 1995, IEEE Trans. Image Process..

[6]  Masahiro Wada,et al.  Selective recovery of video packet loss using error concealment , 1989, IEEE J. Sel. Areas Commun..

[7]  Mohammed Ghanbari.  Postprocessing of late cells for packet video , 1996, IEEE Trans. Circuits Syst. Video Technol..

[8]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[9]  John D. Villasenor,et al.  Adaptive intra update for video coding over noisy channels , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[10]  Thomas Stockhammer,et al.  H.264/AVC data partitioning for mobile video communication , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[11]  Thomas Wiegand,et al.  Long-term memory motion-compensated prediction , 1999, IEEE Trans. Circuits Syst. Video Technol..

[12]  Rabab Kreidieh Ward,et al.  A concealment method for video communications in an error-prone environment , 2000, IEEE Journal on Selected Areas in Communications.

[13]  Claude E. Shannon,et al.  A Mathematical Theory of Communications , 1948 .

[14]  R. Talluri,et al.  Error-resilient video coding in the ISO MPEG-4 standard , 1998, IEEE Commun. Mag..

[15]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  Ness B. Shroff,et al.  A fast suboptimal approach to error concealment in encoded video streams , 1997, Proceedings of International Conference on Image Processing.

[17]  Jörg Ott,et al.  Error resilience support in H.263+ , 1998, IEEE Trans. Circuits Syst. Video Technol..

[18]  Wenjun Zeng,et al.  Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[19]  Ajay Luthra,et al.  Introduction to the special issue on the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[20]  Philip A. Chou,et al.  Rate-distortion optimized streaming of packetized media , 2006, IEEE Transactions on Multimedia.

[21]  Thomas Wiegand,et al.  Error-resilient video transmission using long-term memory motion-compensated prediction , 2000, IEEE Journal on Selected Areas in Communications.

[22]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[23]  Tsuhan Chen,et al.  Second-generation error concealment for video transport over error prone channels , 2002, Proceedings. International Conference on Image Processing.

[24]  Marta Karczewicz,et al.  The SP- and SI-frames design for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[25]  Huifang Sun,et al.  Adaptive error concealment algorithm for MPEG compressed video , 1992, Other Conferences.

[26]  K. Rijkse,et al.  H.263: video coding for low-bit-rate communication , 1996, IEEE Commun. Mag..

[27]  JongWon Kim,et al.  DCT coefficients recovery-based error concealment technique and its application to the MPEG-2 bit stream error , 1997, IEEE Trans. Circuits Syst. Video Technol..

[28]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[29]  Bernd Girod,et al.  Standard compatible extension of H.263 for robust video transmission in mobile environments , 1997, IEEE Trans. Circuits Syst. Video Technol..

[30]  Miska M. Hannuksela,et al.  The error concealment feature in the H.26L test model , 2002, Proceedings. International Conference on Image Processing.

[31]  T. Nakai,et al.  Error resilient video coding by dynamic replacing of reference pictures , 1996, Proceedings of GLOBECOM'96. 1996 IEEE Global Telecommunications Conference.

[32]  Richard E. Ladner,et al.  Unequal loss protection for H.263 compressed video , 2005, IEEE Trans. Circuits Syst. Video Technol..

[33]  David G. Messerschmitt,et al.  Resynchronization of motion compensated video affected by ATM cell loss , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[34]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[35]  John G. Apostolopoulos,et al.  Reliable video communication over lossy packet networks using multiple state encoding and path diversity , 2000, IS&T/SPIE Electronic Imaging.

[36]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[37]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[38]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[39]  Qin-Fan Zhu,et al.  Joint source coding, transport processing, and error concealment for H.323-based packet video , 1998, Electronic Imaging.

[40]  Tsuhan Chen,et al.  Model-based error concealment for wireless video , 2002, IEEE Trans. Circuits Syst. Video Technol..

[41]  Bernd Girod,et al.  Feedback-based error control for mobile video transmission , 1999, Proc. IEEE.

[42]  Liang-Gee Chen,et al.  Error concealment of lost motion vectors with overlapped motion compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[43]  Eleftheriadis Alexandros,et al.  Multipoint videoconferencing with scalable video coding , 2006 .

[44]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[45]  Faouzi Kossentini,et al.  Optimal mode selection and synchronization for robust video communications over error-prone networks , 2000, IEEE Journal on Selected Areas in Communications.

[46]  Myung Don Kim,et al.  Selective temporal error concealment algorithm for H.264/AVC , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[47]  Arun N. Netravali,et al.  Digital Video: An introduction to MPEG-2 , 1996 .