Robust decoder-based error control strategy for recovery of H.264/AVC video content

Real-time wireless conversational and broadcasting multimedia applications offer particular transmission challenges as reliable content delivery cannot be guaranteed. The undelivered and erroneous content causes significant degradation in quality of experience. The H.264/AVC standard includes several error resilient tools to mitigate this effect on video quality. However, the methods implemented by the standard are based on a packet-loss scenario, where corrupted slices are dropped and the lost information concealed. Partially damaged slices still contain valuable information that can be used to enhance the quality of the recovered video. This study presents a novel error recovery solution that relies on a joint source-channel decoder to recover only feasible slices. A major advantage of this decoder-based strategy is that it grants additional robustness while keeping the same transmission data rate. Simulation results show that the proposed approach manages to completely recover 30.79% of the corrupted slices. This provides frame-by-frame peak signal-to-noise ratio (PSNR) gains of up to 18.1 dB, a result which, to the knowledge of the authors, is superior to all other joint source-channel decoding methods found in literature. Furthermore, this error resilient strategy can be combined with other error resilient tools adopted by the standard to enhance their performance.

[1]  H. Schwarz,et al.  Overview of the Scalable H.264/MPEG4-AVC Extension , 2006, 2006 International Conference on Image Processing.

[2]  Pascal Frossard,et al.  Media Streaming With Network Diversity , 2008, Proceedings of the IEEE.

[3]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Lars-Åke Larzon,et al.  UDP lite for real time multimedia applications , 1999 .

[5]  Pierre Duhamel,et al.  Robust Decoding of H.264 Encoded Video Transmitted over Wireless Channels , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[6]  Markus Rupp,et al.  Performance of a H.264/AVC Error Detection Algorithm Based on Syntax Analysis , 2007, J. Mobile Multimedia.

[7]  Sanjit K. Mitra,et al.  A robust error concealment technique using data hiding for image and video transmission over lossy channels , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  C.J. Debono,et al.  Enhancing the Error Detection Capabilities of DCT Based Codecs using Compressed Domain Dissimilarity Metrics , 2007, EUROCON 2007 - The International Conference on "Computer as a Tool".

[9]  Wei Tu,et al.  Distributed scheduling scheme for video streaming over multi-channel multi-radio multi-hop wireless networks , 2010, IEEE Journal on Selected Areas in Communications.

[10]  Reuben A. Farrugia,et al.  A Robust Error Detection Mechanism for H.264/AVC Coded Video Sequences Based on Support Vector Machines , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Jin-Jang Leou,et al.  Detection and concealment of transmission errors in H.261 images , 1998, IEEE Trans. Circuits Syst. Video Technol..

[12]  Joachim Hagenauer,et al.  Symbol-by-Symbol MAP Decoding of Variable Length Codes , 2000 .

[13]  Reuben A. Farrugia,et al.  Improved quality of experience of reconstructed H.264/AVC encoded video sequences through robust pixel domain error detection , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[14]  Itu-T and Iso Iec Jtc.  Advanced video coding for generic audiovisual services , 2010 .

[15]  Reuben A. Farrugia,et al.  ENHANCING ERROR RESILIENCE IN WIRELESS TRANSMITTED COMPRESSED VIDEO SEQUENCES THROUGH A PROBABILISTIC NEURAL NETWORK CORE , 2007 .

[16]  Markus Rupp,et al.  Robust Error Detection for H.264/AVC Using Relation Based Fragile Watermarking , 2006 .

[17]  Byeungwoo Jeon,et al.  Error detection and recovery by hiding information into video bitstream using fragile watermarking , 2002, IS&T/SPIE Electronic Imaging.

[18]  Luca Superiori,et al.  DETECTION OF VISUAL IMPAIRMENTS IN THE PIXEL DOMAIN OF CORRUPTED H.264/AVC PACKETS , 2007 .

[19]  C.J. Debono,et al.  Robust transmission of H.264/AVC sequences using list decoding and source constraints , 2008, MELECON 2008 - The 14th IEEE Mediterranean Electrotechnical Conference.

[20]  A. Haghighat,et al.  Performance of A 3 MCNP™ for Calculation of 3-D Neutron Flux Distribution in a BWR Core Shroud , 2001 .

[21]  C.J. Debono,et al.  Enhancing the Error Detection Capabilities of the Standard Video Decoder using Pixel Domain Dissimilarity Metrics , 2007, EUROCON 2007 - The International Conference on "Computer as a Tool".

[22]  Vivek K. Goyal,et al.  Multiple description coding: compression meets the network , 2001, IEEE Signal Process. Mag..

[23]  Luca Superiori,et al.  An H.264/AVC Error Detection Algorithm Based on Syntax Analysis , 2009 .

[24]  Timo Hämäläinen,et al.  Detecting corrupted intra macroblocks in H.263 video , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[25]  Ekram Khan,et al.  Iterative error detection and correction of H.263 coded video for wireless networks , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Minghua Chen,et al.  A fragile watermark error detection scheme for wireless video communications , 2005, IEEE Transactions on Multimedia.

[27]  Shu Lin,et al.  Error control coding : fundamentals and applications , 1983 .

[28]  Victor Buttigieg,et al.  Using variable-length error-correcting codes in MPEG-4 video , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[29]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[30]  Hsiang-Cheng Meng,et al.  A novel error resilience using reversible data embedding in H.264/AVC , 2007, 2007 6th International Conference on Information, Communications & Signal Processing.

[31]  Xinggang Lin,et al.  Content based error detection and concealment for image transmission over wireless channel , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[32]  M. Darnell,et al.  Error Control Coding: Fundamentals and Applications , 1985 .

[33]  Robert Facciol,et al.  Robust Video Transmission Using Reversible Watermarking Techniques , 2010, 2010 IEEE International Symposium on Multimedia.

[34]  Gary J. Sullivan,et al.  Video Compression - From Concepts to the H.264/AVC Standard , 2005, Proceedings of the IEEE.

[35]  Hang Nguyen,et al.  Estimation of redundancy in compressed image and video data for joint source- channel decoding , 2003, GLOBECOM '03. IEEE Global Telecommunications Conference (IEEE Cat. No.03CH37489).

[36]  Mihaela van der Schaar,et al.  Multimedia Over IP and Wireless Networks: Compression, Networking, and Systems , 2012 .

[37]  Mihaela van der Schaar,et al.  Distributed Resource Management in Multihop Cognitive Radio Networks for Delay-Sensitive Transmission , 2009, IEEE Transactions on Vehicular Technology.

[38]  Cyril Bergeron,et al.  Soft-input decoding of variable-length codes applied to the H.264 standard , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[39]  Hang Nguyen,et al.  Optimal VLC sequence decoding exploiting additional video stream properties , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[40]  Jin-Jang Leou,et al.  Detection and concealment of transmission errors in MPEG-2 images-a genetic algorithm approach , 1999, IEEE Trans. Circuits Syst. Video Technol..