A temporal error concealment algorithm for H.264/AVC based on edge directions

This paper proposes a temporal error concealment algorithm based on the edge directions of the pixels surrounding the lost macroblock (MB). On one hand, for each pixel on the external boundary of the restored MB, the spatial boundary distortion is calculated along the edge direction, which preserves edge alignment as well as ensures spatial continuity. On the other hand, the edge directions are utilized to identify whether the lost MB contains multiple objects, and then determine the restore mode of the four 8x8 blocks in the lost MB: simultaneously or independently. The experimental results for several test video sequences demonstrate that higher performance is achieved in both objective and subjective quality of the reconstructed frames compared with conventional error concealment algorithms.

[1]  Weisi Lin,et al.  Visual distortion assessment with emphasis on spatially transitional regions , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Jo Yew Tham,et al.  Edge Weighted Spatio-Temporal Search for Error Concealment , 2007, 2007 IEEE International Conference on Image Processing.

[3]  Oscar C. Au,et al.  Priority-driven extended boundary matching algorithm for temporal error concealment , 2006 .

[4]  Yo-Sung Ho,et al.  Error concealment based on directional interpolation , 1997 .

[5]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[6]  Sang-Heon Lee,et al.  An Edge-Adaptive Block Matching Algorithm for Error Concealment , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[7]  S. Aign,et al.  Temporal and spatial error concealment techniques for hierarchical MPEG-2 video codec , 1995, Proceedings IEEE International Conference on Communications ICC '95.

[8]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[9]  Oscar C. Au,et al.  Spatio-temporal boundary matching algorithm for temporal error concealment , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[10]  Satoshi Goto,et al.  Variable Block Size Motion Vector Retrieval Schemes for H.264 Inter Frame Error Concealment , 2008, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[11]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.