A Maximum Likelihood Approach to Video Error Correction Applied to H.264 Decoding

In real-time video applications, where unreliable networks are commonplace, corrupted video packets can adversely affect visual quality. In this paper, we present a novel maximum likelihood approach to performing video error correction. Rather than discarding corrupted video packets, the method estimates the likeliest syntactically valid video slice content based on these packets. First, we present the mathematical foundations that enable solution of the problem at the slice level. Then, we present a simplified solution operating at the syntax element level. The method's performance is evaluated using the H.264 baseline profile. Unlike error concealment methods, we correct the errors in the bit stream, instead of reconstructing missing pixels. Simulation results show that the method yields improved visual quality. Furthermore, the proposed approach is computationally simpler than state-of-the-art error concealment methods.

[1]  Oscar C. Au,et al.  Video Error Concealment Using Spatio-Temporal Boundary Matching and Partial Differential Equation , 2008, IEEE Transactions on Multimedia.

[2]  Tho Le-Ngoc,et al.  Iterative Joint Source-Channel Decoding of H.264 Compressed Video , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[3]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[4]  Roni Even,et al.  RTP Payload Format for H.264 Video , 2011, RFC.

[5]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[6]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[7]  Xueming Qian,et al.  Recovering Connected Error Region Based on Adaptive Error Concealment Order Determination , 2009, IEEE Transactions on Multimedia.

[8]  Kaushik Roy,et al.  A novel bitstream level joint channel error concealment scheme for realtime video over wireless networks , 2004, IEEE INFOCOM 2004.

[9]  Jun Wu,et al.  A temporal error concealment method for H.264/AVC using motion vector recovery , 2008, IEEE Transactions on Consumer Electronics.

[10]  Reuben A. Farrugia,et al.  Robust decoder-based error control strategy for recovery of H.264/AVC video content , 2011, IET Commun..

[11]  Lars-Åke Larzon,et al.  UDP lite for real time multimedia applications , 1999 .

[12]  P. Nasiopoulos,et al.  Video Packetization Techniques for Enhancing H.264 Video Transmission over 3G Networks , 2008, 2008 5th IEEE Consumer Communications and Networking Conference.

[13]  Yue Wang,et al.  Joint source-channel decoding for H.264 coded video stream , 2005, IEEE Transactions on Consumer Electronics.

[14]  Thomas Eriksson,et al.  Mixture Model- and Least Squares-Based Packet Video Error Concealment , 2009, IEEE Transactions on Image Processing.

[15]  Steven Pigeon,et al.  Pixel domain referenceless visual degradation detection and error concealment for mobile video , 2011, 2011 18th IEEE International Conference on Image Processing.

[16]  Liang-Gee Chen,et al.  Error concealment of lost motion vectors with overlapped motion compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[17]  Hang Nguyen,et al.  Iterative joint source-channel decoding of variable length encoded video sequences exploiting source semantics , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[18]  Pierre Duhamel,et al.  Robust Decoding of H.264 Encoded Video Transmitted over Wireless Channels , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[19]  Olivia Nemethova,et al.  Combined sequential decoding and error concealment of H.264 video , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[20]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[21]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[22]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[23]  Mihaela van der Schaar,et al.  Multimedia Over IP and Wireless Networks: Compression, Networking, and Systems , 2012 .

[24]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[25]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..

[26]  Tho Le-Ngoc,et al.  Iterative Joint Source-Channel Decoding for H.264 video transmission using virtual checking method at source decoder , 2010, CCECE 2010.

[27]  Hari Kalva,et al.  The VC-1 and H.264 Video Compression Standards for Broadband Video Services , 2008 .

[28]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[29]  Reuben A. Farrugia,et al.  A Hybrid Error Control and Artifact Detection Mechanism for Robust Decoding of H.264/AVC Video Sequences , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Kenneth H. Rosen,et al.  Discrete Mathematics and its applications , 2000 .

[31]  Reuben A. Farrugia,et al.  A Robust Error Detection Mechanism for H.264/AVC Coded Video Sequences Based on Support Vector Machines , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  S. Aign Error concealment enhancement by using the reliability outputs of a SOVA in MPEG-2 video decoder , 1995, Proceedings of ISSE'95 - International Symposium on Signals, Systems and Electronics.

[33]  Itu-T and Iso Iec Jtc Advanced video coding for generic audiovisual services , 2010 .

[34]  Cyril Bergeron,et al.  Soft-input decoding of variable-length codes applied to the H.264 standard , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[35]  Shih-Chia Huang,et al.  Optimization of Hybridized Error Concealment for H.264 , 2008, IEEE Transactions on Broadcasting.

[36]  Jiann-Jong Chen,et al.  Joint Source-Channel Decoder for H.264 Coded Video Employing Fuzzy Adaptive Method , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[37]  Yanling Xu,et al.  H.264 video communication based refined error concealment schemes , 2004, IEEE Transactions on Consumer Electronics.

[38]  Robert V. Brill,et al.  Applied Statistics and Probability for Engineers , 2004, Technometrics.

[39]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[40]  W. Kwok,et al.  Multi-directional interpolation for spatial error concealment , 1993 .