Efficient temporal error concealment algorithm for H.264/AVC inter frame decoding

During the real-time video transmission over error-prone network, the compressed video signal is very sensitive to the channel disturbances, and the packet loss cannot be avoided which causes the video quality reduction in the destination. To satisfy the audiences' visual feeling, the decoder attempts to conceal the error effect by using the spatial or temporal domain information to estimate the missing video content. In this paper, an efficient temporal error concealment (ETEC) algorithm is proposed for H.264/AVC Inter frame decoding to eliminate the error effect for Human Visual System (HVS). The 4 × 4 block size is used as the basic motion vector (MV) recovery unit to increase the error concealment (EC) accuracy, and the MV of the lost macroblock (MB) is recovered by employing the MV information of the neighboring intact MBs based on the geometry and data interpolation. The simulation results show that the proposed algorithm can achieve better performance compared with the existing TEC methods not only for the objective quality measurement, but also for the HVS subjective view perception. Because of its simple composition, the proposed algorithm is pervasive to be used in the real-time multimedia communication systems with the video coding standard H.264/AVC. Copyright © 2011 John Wiley & Sons, Ltd.

[1]  Joachim Hagenauer,et al.  Forward Error Correction Coding for Fading Compensation in Mobile Satellite Channels , 1987, IEEE J. Sel. Areas Commun..

[2]  Wei Zhu,et al.  Fast Inter Mode Decision Algorithm Based on the MB Activity for MPEG-2 to H.264/AVC Transcoding , 2009, 2009 International Conference on Computational Science and Engineering.

[3]  Ming-Chieh Chi,et al.  Recursive block-matching principle for error concealment algorithm , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[4]  Jun Wu,et al.  A temporal error concealment method for H.264/AVC using motion vector recovery , 2008, IEEE Transactions on Consumer Electronics.

[5]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Lap-Pui Chau,et al.  A temporal error concealment algorithm for H.264 using Lagrange interpolation , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[7]  Xuemin Chen,et al.  Video coding using the H.264/MPEG-4 AVC compression standard , 2004, Signal Process. Image Commun..

[8]  Thomas Wiegand,et al.  Draft ITU-T recommendation and final draft international standard of joint video specification , 2003 .

[9]  David G. Messerschmitt,et al.  Resynchronization of motion compensated video affected by ATM cell loss , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Yo-Sung Ho,et al.  Error concealment based on directional interpolation , 1997 .

[11]  R. Talluri,et al.  Error-resilient video coding in the ISO MPEG-4 standard , 1998, IEEE Commun. Mag..

[12]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[13]  Supavadee Aramvith,et al.  Improved frame and basic unit layers bit allocation scheme for H.264 video transmission over ARQ-based wireless channels , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[14]  Jian Feng,et al.  Cell loss concealment method for MPEG video in ATM networks , 1995, Proceedings of GLOBECOM '95.

[15]  Donghyung Kim,et al.  Temporal Error Concealment for H.264 Video Based on Adaptive Block-Size Pixel Replacement , 2006, IEICE Trans. Commun..

[16]  Tho Le-Ngoc,et al.  Joint forward error correction and error concealment for compressed video , 2002, Proceedings. International Conference on Information Technology: Coding and Computing.

[17]  Paul Nevai,et al.  Mean convergence of Lagrange interpolation. III , 1984 .

[18]  Xingang Liu,et al.  Fast Interframe mode decision algorithm based on mode mapping and MB activity for MPEG-2 to H.264/AVC transcoding , 2010, J. Vis. Commun. Image Represent..

[19]  G. P. Névai,et al.  Mean convergence of Lagrange interpolation, II☆ , 1976 .