A highly effective error concealment method for whole frame loss

When videos are transmitted over the Internet, packet missing is inevitable and an entire frame may get lost. However, most of the literature on error concealment problems can only deal with block loss. For the case of frame loss, they usually fail to achieve satisfactory results. In this paper, we propose a highly effective frame concealment method, which gives amazingly good recovery quality. We base on the theory of multiple hypotheses and devise an adaptive integration scheme to make full use of each hypothesis' strength. Different from the existing methods which mostly rely on motion vectors of previous frames, we fully exploit the correlation between consecutive frames. A novel idea for generating multiple estimates of the lost frame is adopted. Experimental results demonstrate that the proposed algorithm significantly outperforms the state-of-the-art error concealment methods for whole frame loss in both subjective and objective quality.

[1]  Wen Gao,et al.  Auto Regressive Model and Weighted Least Squares Based Packet Video Error Concealment , 2010, 2010 Data Compression Conference.

[2]  Bernd Girod,et al.  Efficiency analysis of multihypothesis motion-compensated prediction for video coding , 2000, IEEE Trans. Image Process..

[3]  Trac D. Tran,et al.  Video error concealment using sparse recovery and local dictionaries , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[4]  Bo Yan,et al.  A Hybrid Frame Concealment Algorithm for H.264/AVC , 2010, IEEE Transactions on Image Processing.

[5]  C.-C. Jay Kuo,et al.  A dynamic error concealment for video transmission over noisy channels , 2002, Global Telecommunications Conference, 2002. GLOBECOM '02. IEEE.

[6]  Zhang Rongfu,et al.  Content-adaptive spatial error concealment for video communication , 2004 .

[7]  Cedric Nishan Canagarajah,et al.  Multiple-reference temporal error concealment , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[8]  Gwo-Long Li,et al.  Effective error concealment algorithm of whole frame loss for H.264 video coding standard by recursive motion vector refinement , 2010, IEEE Transactions on Consumer Electronics.

[9]  Thomas Wiegand,et al.  Long-term memory motion-compensated prediction , 1999, IEEE Trans. Circuits Syst. Video Technol..

[10]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[11]  S. Aign,et al.  Temporal and spatial error concealment techniques for hierarchical MPEG-2 video codec , 1995, Proceedings IEEE International Conference on Communications ICC '95.

[12]  Jianfei Cai,et al.  Image error-concealment via Block-based Bilateral Filtering , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[13]  C.-C. Jay Kuo,et al.  Spatial error concealment with sequence-aligned texture modeling and adaptive directional recovery , 2011, J. Vis. Commun. Image Represent..

[14]  Qiang Peng,et al.  Block-based temporal error concealment for video packet using motion vector extrapolation , 2002, IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions.

[15]  Bo Yan,et al.  Efficient Motion Vector Interpolation for Error Concealment of H.264/AVC , 2011, IEEE Transactions on Broadcasting.

[16]  Zhenyu Wu,et al.  An error concealment scheme for entire frame losses based on H.264/AVC , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[17]  Wen Gao,et al.  Bayesian frame interpolation by fusing multiple motion-compensated prediction frames , 2011, 2011 18th IEEE International Conference on Image Processing.

[18]  Jiang Li,et al.  An Error Concealment Algorithm for Entire Frame Loss in Video Transmission , 2004 .