A Review of Error Resilience Techniques in Video Streaming

Delivering video data of satisfactory quality over unreliable networks - such as the internet or wireless networks - is a demanding area which has received significant attention of the research community over the past few years. Given the fact that packet loss is inevitable and therefore the presence of errors granted, the effort is directed towards limiting the effect of these errors. A number of techniques have been developed to address this issue. This paper aims to summarize the most significant approaches for: error resilience, error concealment and joint encoder-decoder error control techniques, and to provide a thorough discussion of the benefits and drawbacks of these error control methods. Furthermore, two case studies of error resilience utilization are presented, namely Ad-hoc networks and Multimedia Broadcast Multiple Services (MBMS). I. INTRODUCTION

[1]  Jiangtao Wen,et al.  Reversible variable length codes for robust image and video transmission , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[2]  Iso/iec 14496-2 Information Technology — Coding of Audio-visual Objects — Part 2: Visual , 2022 .

[3]  Manuel P. Malumbres,et al.  Testing the H.264 error-resilience on wireless ad-hoc networks , 2003, Proceedings EC-VIP-MC 2003. 4th EURASIP Conference focused on Video/Image Processing and Multimedia Communications (IEEE Cat. No.03EX667).

[4]  K. Rijkse,et al.  H.263: video coding for low-bit-rate communication , 1996, IEEE Commun. Mag..

[5]  S. Hadjiefthymiades,et al.  Hypertext Transfer Protocol (HTTP) , 1996 .

[6]  John D. Villasenor,et al.  On design of error-correcting reversible variable length codes , 2002, IEEE Communications Letters.

[7]  Chang Yi-lin,et al.  On constructing symmetrical reversible variable-length codes independent of the Huffman code , 2006 .

[8]  Ya-Qin Zhang,et al.  Robust video coding algorithms and systems , 1999 .

[9]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[10]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[11]  Bogdan M. Wilamowski,et al.  The Transmission Control Protocol , 2005, The Industrial Information Technology Handbook.

[12]  Jon Postel,et al.  User Datagram Protocol , 1980, RFC.

[13]  Roy T. Fielding,et al.  Hypertext Transfer Protocol - HTTP/1.1 , 1997, RFC.

[14]  Thomas Wiegand,et al.  Draft ITU-T recommendation and final draft international standard of joint video specification , 2003 .

[15]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  Sethuraman Panchanathan,et al.  Error resiliency schemes in H.264/AVC standard , 2006, J. Vis. Commun. Image Represent..

[17]  Borko Furht,et al.  Error resilient video over multimedia broadcast multicast services (MBMS) , 2006, Multimedia Tools and Applications.

[18]  Ajay Luthra,et al.  The H.264/AVC Advanced Video Coding standard: overview and introduction to the fidelity range extensions , 2004, SPIE Optics + Photonics.

[19]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[20]  Pietro Manzoni,et al.  Performance of H.264 compressed video streams over 802.11b based MANETs , 2004, 24th International Conference on Distributed Computing Systems Workshops, 2004. Proceedings..

[21]  S. Kumar,et al.  Coding efficiency evaluation of RVLC codes , 2005, 48th Midwest Symposium on Circuits and Systems, 2005..

[22]  Henning Schulzrinne,et al.  An RTP Payload Format for Generic Forward Error Correction , 1999, RFC.

[23]  K. Lakovic,et al.  Design considerations for efficient reversible variable length codes , 2002, Conference Record of the Thirty-Sixth Asilomar Conference on Signals, Systems and Computers, 2002..

[24]  John D. Villasenor,et al.  Reversible variable length codes for efficient and robust image and video coding , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[25]  Marta Karczewicz,et al.  The SP- and SI-frames design for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[26]  Ja-Ling Wu,et al.  On error detection and error synchronization of reversible variable-length codes , 2005, IEEE Trans. Commun..

[27]  Borko Furht,et al.  Application of video error resilience techniques for mobile broadcast multicast services (MBMS) , 2004, IEEE Sixth International Symposium on Multimedia Software Engineering.

[28]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[29]  Turhan Tunali,et al.  A Survey on the H.264/AVC Standard , 2005 .

[30]  Shivendra S. Panwar,et al.  Video transport over ad-hoc networks using multiple paths , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[31]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[32]  Itu-T Video coding for low bitrate communication , 1996 .

[33]  Sunil Kumar,et al.  Error resiliency measure for RVLC codes , 2006, IEEE Signal Processing Letters.

[34]  Shivendra S. Panwar,et al.  A reference picture selection scheme for video transmission over ad-hoc networks using multiple paths , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[35]  Ja-Ling Wu,et al.  Modified symmetrical reversible variable-length code and its theoretical bounds , 2001, IEEE Trans. Inf. Theory.

[36]  M. Wada,et al.  Reversible variable length codes , 1995, IEEE Trans. Commun..

[37]  Sanjit K. Mitra,et al.  Rate-distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standard , 1996, IEEE Trans. Circuits Syst. Video Technol..

[38]  Ja-Ling Wu,et al.  On constructing the Huffman-code-based reversible variable-length codes , 2001, IEEE Trans. Commun..

[39]  D. Marpe,et al.  Video coding with H.264/AVC: tools, performance, and complexity , 2004, IEEE Circuits and Systems Magazine.

[40]  Bernd Girod,et al.  Feedback-based error control for mobile video transmission , 1999, Proc. IEEE.

[41]  Yao Wang,et al.  Multiple Description Coding for Video Delivery , 2005, Proceedings of the IEEE.

[42]  John D. Villasenor,et al.  A class of reversible variable length codes for robust image and video coding , 1997, Proceedings of International Conference on Image Processing.

[43]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.