Novel error concealment method with adaptive prediction to the abrupt and gradual scene changes

In this paper, the impact of scene change on the conventional error concealment method is addressed and a novel error concealment method is proposed to improve the insufficiency of the conventional temporal error concealment algorithm due to the occurrence of scene change. Combining with the low complexity scene change detection algorithm using macroblock type information, the corrupt blocks resulting from bit errors are concealed either temporally or spatially depending on whether or not an abrupt scene change is found. In the case of gradual scene change, a novel error concealment method of interpolation and extrapolation is proposed to utilize the linear property of gradual scene change sequence, and effectively reduce the concealment error in comparison with the conventional algorithm. A great improvement of about 3 to 5 dB PSNR on average and 6 to 8 dB in some cases is obtained with very little memory and computation overhead.

[1]  Wenjun Zeng,et al.  Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[2]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[3]  Maja Bystrom,et al.  Hybrid error concealment schemes for broadcast video transmission over ATM networks , 1999, IEEE Trans. Circuits Syst. Video Technol..

[4]  Susanna Kaiser,et al.  Comparison of error concealment techniques for an MPEG-2 video decoder in terrestrial TV-broadcasting , 1999, Signal Process. Image Commun..

[5]  Yao Wang,et al.  Second-order derivative-based smoothness measure for error concealment in DCT-based codecs , 1998, IEEE Trans. Circuits Syst. Video Technol..

[6]  Ralph M. Ford,et al.  Metrics for shot boundary detection in digital video sequences , 2000, Multimedia Systems.

[7]  Mei-Juan Chen,et al.  Robust error concealment algorithm for video decoder , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[8]  Boon-Lock Yeo,et al.  Visual content highlighting via automatic extraction of embedded captions on MPEG compressed video , 1996, Electronic Imaging.

[9]  Shih-Fu Chang,et al.  Manipulation and Compositing of MC-DCT Compressed Video , 1995, IEEE J. Sel. Areas Commun..

[10]  A Leon-Garcia,et al.  Information loss recovery for block-based image coding techniques-a fuzzy logic approach , 1995, IEEE Trans. Image Process..

[11]  Nick Kingsbury,et al.  Error resilient image and video coding for wireless communication systems , 1999 .

[12]  Jian Feng,et al.  Error concealment for MPEG video transmissions , 1997 .

[13]  Jill M. Boyce Packet loss resilient transmission of MPEG video over the Internet , 1999, Signal Process. Image Commun..

[14]  Pao-Chi Chang,et al.  Error-propagation prevention technique for real-time video transmission over ATM networks , 1999, IEEE Trans. Circuits Syst. Video Technol..

[15]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[16]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[17]  Yoshinobu Tonomura,et al.  Projection-detecting filter for video cut detection , 1994, MULTIMEDIA '93.

[18]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[19]  Sang Uk Lee,et al.  Recovery of corrupted image data based on the NURBS interpolation , 1999, IEEE Trans. Circuits Syst. Video Technol..

[20]  Amy R. Reibman,et al.  An error concealment algorithm for images subject to channel errors , 1995, IEEE Trans. Image Process..

[21]  James W. Modestino,et al.  Design of a transport coding scheme for high-quality video over ATM networks , 1997, IEEE Trans. Circuits Syst. Video Technol..

[22]  Michael W. Marcellin,et al.  POCS-based error concealment for packet video using multiframe overlap information , 1998, IEEE Trans. Circuits Syst. Video Technol..

[23]  Min-Cheol Hong,et al.  Error concealment algorithms for compressed video , 1999, Signal Process. Image Commun..

[24]  Stephen W. Smoliar,et al.  Video parsing and browsing using compressed data , 1995, Multimedia Tools and Applications.

[25]  W. Kwok,et al.  Multi-directional interpolation for spatial error concealment , 1993 .

[26]  W. Keck A METHOD FOR ROBUST DECODING OF ERRONEOUS MPEG-2 VIDEO BITSTREAMS , 1996, 1996. Digest of Technical Papers., International Conference on Consumer Electronics.

[27]  Yasuyuki Nakajima A Video Browsing Using Fast Scene Cut Detection for an Efficient Networked Video Database Access (Special Issue on Networked Reality) , 1994 .

[28]  Michael R. Frater,et al.  Error resilience in the MPEG-2 video coding standard for cell based networks - A review , 1999, Signal Process. Image Commun..

[29]  Soo-Chang Pei,et al.  Efficient and effective wipe detection in MPEG compressed video based on the macroblock information , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[30]  James W. Modestino,et al.  Reliable transmission of high-quality video over ATM networks , 1999, IEEE Trans. Image Process..

[31]  Nilesh V. Patel,et al.  Video shot detection and characterization for video databases , 1997, Pattern Recognit..

[32]  T. Little,et al.  Compressed Video Processing For Cut Detection , 1996 .

[33]  Zhou Wang,et al.  Best neighborhood matching: an information loss restoration technique for block-based image coding systems , 1998, IEEE Trans. Image Process..

[34]  Liang-Gee Chen,et al.  Error concealment of lost motion vectors with overlapped motion compensation , 1997, IEEE Trans. Circuits Syst. Video Technol..

[35]  C.-C. Jay Kuo,et al.  Real-time streaming video with adaptive bandwidth control and DCT-based error concealment , 1999, IEEE Transactions on Circuits and Systems II: Analog and Digital Signal Processing.

[36]  Shih-Fu Chang,et al.  Scene change detection in an MPEG-compressed video sequence , 1995, Electronic Imaging.

[37]  Jin-Jang Leou,et al.  Detection and concealment of transmission errors in MPEG-2 images-a genetic algorithm approach , 1999, IEEE Trans. Circuits Syst. Video Technol..

[38]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[39]  Arding Hsu,et al.  Feature management for large video databases , 1993, Electronic Imaging.

[40]  Yuzhuo Zhong,et al.  Robust approach to video segmentation using compressed data , 1997, Electronic Imaging.

[41]  Arding Hsu,et al.  Image processing on compressed data for large video databases , 1993, MULTIMEDIA '93.

[42]  N. Canagarajah,et al.  Temporal error concealment using motion field interpolation , 1999 .

[43]  Soo-Chang Pei,et al.  Efficient MPEG Compressed Video Analysis Using Macroblock Type Information , 1999, IEEE Trans. Multim..

[44]  Yo-Sung Ho,et al.  Error concealment based on directional interpolation , 1997 .