Bayesian error concealment with DCT pyramid

In this paper, the problem of concealing missing image/video blocks is casted into a framework of Bayesian estimation. The conditional expectation of the missing block vector is taken over a pilot vector of correctly decoded pixels near the missing block. Multiple observations of the missing vector and pilot vectors obtained in a nonlocal manner are used to approximate the expectation. We design a multiscale estimation approach with DCT pyramid to improve estimation efficiency. The DC image of the missing block is recovered first, and then more details related to high frequency AC coefficients are recovered successively. The algorithm is found to be quite competitive among state-of-the-art, and more substantial improvement over existing algorithms on image with heavy loss rate/large block size is observed in our experiments.

[1]  Rabab Kreidieh Ward,et al.  Reconstruction of baseline JPEG coded images in error prone environments , 2000, IEEE Trans. Image Process..

[2]  Yao Wang,et al.  Signal loss recovery in DCT-based image and video codecs , 1991, Other Conferences.

[3]  André Kaup,et al.  Spatial error concealment of corrupted image data using frequency selective extrapolation , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Shih-Chang Hsia.  An edge-oriented spatial interpolation for consecutive block error concealment , 2004, IEEE Signal Process. Lett..

[5]  Cedric Nishan Canagarajah,et al.  Enhanced error concealment with mode selection , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Choong-Woong Lee,et al.  Error concealment technique using projection data for block-based image coding , 1994, Other Conferences.

[7]  Ziad Al Kachouh,et al.  Fast DCT-based spatial domain interpolation of blocks in images , 2000, IEEE Trans. Image Process..

[8]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[9]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..

[10]  Zhou Wang,et al.  Best neighborhood matching: an information loss restoration technique for block-based image coding systems , 1998, IEEE Trans. Image Process..

[11]  Jianfei Cai,et al.  Image error-concealment via Block-based Bilateral Filtering , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[12]  Zhang Rongfu,et al.  Content-adaptive spatial error concealment for video communication , 2004 .

[13]  Robert J. Marks,et al.  Recovery of image blocks using the method of alternating projections , 2005, IEEE Transactions on Image Processing.

[14]  Pierrick Coupé,et al.  Bayesian Non-local Means Filter, Image Redundancy and Adaptive Dictionaries for Noise Removal , 2007, SSVM.

[15]  Michael T. Orchard,et al.  Novel sequential error-concealment techniques using orientation adaptive interpolation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[16]  JongWon Kim,et al.  DCT coefficients recovery-based error concealment technique and its application to the MPEG-2 bit stream error , 1997, IEEE Trans. Circuits Syst. Video Technol..

[17]  Ness B. Shroff,et al.  Error concealment techniques for encoded video streams , 1995, Proceedings., International Conference on Image Processing.

[18]  Wenjun Zeng,et al.  Geometric-structure-based directional filtering for error concealment in image/video transmission , 1995, Other Conferences.