MPEG-2 error concealment based on block-matching principles

The MPEG-2 compression algorithm is very sensitive to channel disturbances due to the use of variable-length coding. A single bit error during transmission leads to noticeable degradation of the decoded sequence quality, in that part or an entire slice information is lost until the next resynchronization point is reached. Error concealment (EC) methods, implemented at the decoder side, present one way of dealing with this problem. An error-concealment scheme that is based on block-matching principles and spatio-temporal video redundancy is presented in this paper. Spatial information (for the first frame of the sequence or the next scene) or temporal information (for the other frames) is used to reconstruct the corrupted regions. The concealment strategy is embedded in the MPEG-2 decoder model in such a way that error concealment is applied after entire frame decoding. Its performance proves to be satisfactory for packet error rates (PER) ranging from 1% to 10% and for video sequences with different content and motion and surpasses that of other EC methods under study.

[1]  Michael W. Marcellin,et al.  POCS-based error concealment for packet video using multiframe overlap information , 1998, IEEE Trans. Circuits Syst. Video Technol..

[2]  Chung-Lin Huang,et al.  Hybrid cell loss concealment methods for MPEG-II-based packet video , 1997, Signal Process. Image Commun..

[3]  Michael W. Marcellin,et al.  Recovery of video in the presence of packet loss using interleaving and spatial redundancy , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[4]  S. Tsekeridou,et al.  An error concealment scheme for MPEG-2 coded video sequences , 1997, Proceedings of 1997 IEEE International Symposium on Circuits and Systems. Circuits and Systems in the Information Age ISCAS '97.

[5]  Liang-Gee Chen,et al.  Error resilience for block loss with overlapped motion compensation , 1997, Proceedings of International Conference on Image Processing.

[6]  Susanna Aign.  Error concealment improvements for MPEG-2 using enhanced error detection and early re-synchronization , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Changsong Xie,et al.  On MPEG-2 decoding of noisy input data , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[8]  M. Reha Civanlar,et al.  Packet loss resilience of MPEG-2 scalable video coding algorithms , 1996, IEEE Trans. Circuits Syst. Video Technol..

[9]  Bhaskar Ramamurthi,et al.  Nonlinear space-variant postprocessing of block coded images , 1986, IEEE Trans. Acoust. Speech Signal Process..

[10]  Jin-Jang Leou,et al.  Detection and concealment of transmission errors in H.261 images , 1998, IEEE Trans. Circuits Syst. Video Technol..

[11]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[12]  Andrea Basso,et al.  Error concealment and early resynchronization techniques for MPEG-2 video streams damaged by transmission over ATM networks , 1996, Electronic Imaging.

[13]  Nick G. Kingsbury,et al.  Error resilient transmission of MPEG-II over noisy wireless ATM networks , 1997, Proceedings of International Conference on Image Processing.

[14]  Raj Talluri,et al.  A robust, scalable, object-based video compression technique for very low bit-rate coding , 1997, IEEE Trans. Circuits Syst. Video Technol..

[15]  Ness B. Shroff,et al.  A Bayesian approach to error concealment in encoded video streams , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[16]  Aggelos K. Katsaggelos,et al.  Error resilience and concealment in video coding , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[17]  S. Aign.  Error concealment enhancement by using the reliability outputs of a SOVA in MPEG-2 video decoder , 1995, Proceedings of ISSE'95 - International Symposium on Signals, Systems and Electronics.

[18]  Amy R. Reibman,et al.  An error concealment algorithm for images subject to channel errors , 1995, IEEE Trans. Image Process..

[19]  Robert M. Gray,et al.  Subband-coded image reconstruction for lossy packet networks , 1997, IEEE Trans. Image Process..

[20]  Corinne Le Buhan Jordan.  Software-embedded data retrieval and error concealment scheme for MPEG-2 video sequences , 1996 .

[21]  Mohammed Ghanbari,et al.  Cell-loss concealment in ATM video codecs , 1993, IEEE Trans. Circuits Syst. Video Technol..

[22]  Yao Wang,et al.  Image reconstruction from partial subband images and its application in packet video transmission , 1991, Signal Process. Image Commun..

[23]  A Leon-Garcia,et al.  Information loss recovery for block-based image coding techniques-a fuzzy logic approach , 1995, IEEE Trans. Image Process..

[24]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[25]  Peter Kauff,et al.  Concealment techniques for data-reduced HDTV recording , 1995, Signal Process. Image Commun..

[26]  Ness B. Shroff,et al.  Error Concealment in Encoded Video , 1999 .

[27]  Joseph Wilder,et al.  MPEG video error concealment for ATM networks , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[28]  Zhou Wang,et al.  Best neighborhood matching: an information loss restoration technique for block-based image coding systems , 1998, IEEE Trans. Image Process..

[29]  Liang-Gee Chen,et al.  Error concealment of lost motion vectors with overlapped motion compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[30]  Liangchi Hsu,et al.  Wavelet and lapped orthogonal transforms with overlapped motion-compensation for multiresolution coding of HDTV , 1998 .

[31]  Yen-Lin Chen,et al.  Error control for H.263 video transmission over wireless channels , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[32]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Huifang Sun,et al.  Adaptive error concealment algorithm for MPEG compressed video , 1992, Other Conferences.

[34]  S. Aign,et al.  Temporal and spatial error concealment techniques for hierarchical MPEG-2 video codec , 1995, Proceedings IEEE International Conference on Communications ICC '95.

[35]  Konstantinos Konstantinides,et al.  Image and Video Compression Standards: Algorithms and Architectures , 1997 .

[36]  Peter Sommer,et al.  ATM & MPEG-2: integrating digital video into broadband networks , 1997 .

[37]  Konstantinos Konstantinides,et al.  Image and video compression standards , 1995 .

[38]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[39]  Wenjun Zeng,et al.  Geometric-structure-based directional filtering for error concealment in image/video transmission , 1995, Other Conferences.

[40]  Nick G. Kingsbury,et al.  Transcoding of MPEG-II for enhanced resilience to transmission errors , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[41]  Dipankar Raychaudhuri,et al.  Error concealment algorithms for robust decoding of MPEG compressed video , 1997, Signal Process. Image Commun..

[42]  Christophe Alexandre,et al.  The influence of residual errors on a digital satellite TV decoder , 1997, Signal Process. Image Commun..

[43]  Hayder Radha,et al.  Error concealment of still image and video streams with multi-directional recursive nonlinear filters , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[44]  JongWon Kim,et al.  DCT coefficients recovery-based error concealment technique and its application to the MPEG-2 bit stream error , 1997, IEEE Trans. Circuits Syst. Video Technol..

[45]  Farokh Marvasti,et al.  Subimage error concealment techniques , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[46]  Iain E. Garden Richardson,et al.  Improving the error tolerance of MPEG video by varying slice size , 1995, Signal Process..

[47]  A. Reibman,et al.  Forward error control for MPEG-2 video transport in a wireless ATM LAN , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[48]  Yao Wang,et al.  Image reconstruction for hybrid video coding systems , 1992, Data Compression Conference, 1992..

[49]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[50]  King Ngi Ngan,et al.  Cell-loss concealment techniques for layered video codecs in an ATM network , 1994, IEEE Trans. Image Process..