Bayesian Error Concealment With DCT Pyramid for Images

In this paper, the problem of concealing missing image blocks is casted into a framework of Bayesian estimation. The conditional expectation of the missing block vector is taken over a pilot vector of correctly decoded pixels near the missing block. Multiple observations of the missing vector and pilot vectors obtained in a neighborhood are used to approximate the expectation. We design a multiscale estimation approach with discrete cosine transform pyramid to improve estimation efficiency. The DC image of the missing block is recovered first, and then more details related to high-frequency AC coefficients are recovered successively. Moreover, the algorithm operates in an iterative mode through using estimated block to refine the searching process for the next estimation. The algorithm is found to perform very well for a wide range of block loss rates. Substantial improvement over 14 existing error concealment (inclusive of inpainting) algorithms on various images is demonstrated in our extensive experiments, under different test conditions inclusive of high-loss rates and large block sizes.

[1]  W. Kwok,et al.  Multi-directional interpolation for spatial error concealment , 1993 .

[2]  Ness B. Shroff,et al.  Error concealment techniques for encoded video streams , 1995, Proceedings., International Conference on Image Processing.

[3]  A. Baudes,et al.  A Nonlocal Algorithm for Image Denoising , 2005, CVPR 2005.

[4]  Ziad Al Kachouh,et al.  Fast DCT-based spatial domain interpolation of blocks in images , 2000, IEEE Trans. Image Process..

[5]  Peyman Milanfar,et al.  Kernel Regression for Image Processing and Reconstruction , 2007, IEEE Transactions on Image Processing.

[6]  Yao Wang,et al.  Signal loss recovery in DCT-based image and video codecs , 1991, Other Conferences.

[7]  Zhang Rongfu,et al.  Content-adaptive spatial error concealment for video communication , 2004 .

[8]  Mohammed Ghanbari,et al.  Layered image coding using the DCT pyramid , 1995, IEEE Trans. Image Process..

[9]  Michael T. Orchard,et al.  Novel sequential error-concealment techniques using orientation adaptive interpolation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[10]  Choong-Woong Lee,et al.  Error concealment technique using projection data for block-based image coding , 1994, Other Conferences.

[11]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Wenjun Zeng,et al.  Geometric-structure-based directional filtering for error concealment in image/video transmission , 1995, Other Conferences.

[13]  Yao Wang,et al.  Coding and cell-loss recovery in DCT-based packet video , 1993, IEEE Trans. Circuits Syst. Video Technol..

[14]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[15]  André Kaup,et al.  Spatial error concealment of corrupted image data using frequency selective extrapolation , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[17]  Shih-Chang Hsia An edge-oriented spatial interpolation for consecutive block error concealment , 2004, IEEE Signal Process. Lett..

[18]  Jean-Michel Morel,et al.  A non-local algorithm for image denoising , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  JongWon Kim,et al.  DCT coefficients recovery-based error concealment technique and its application to the MPEG-2 bit stream error , 1997, IEEE Trans. Circuits Syst. Video Technol..

[20]  Zhou Wang,et al.  Best neighborhood matching: an information loss restoration technique for block-based image coding systems , 1998, IEEE Trans. Image Process..

[21]  Wenjun Zeng,et al.  Geometric-structure-based error concealment with novel applications in block-based low-bit-rate coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[22]  Yao Wang,et al.  Second-order derivative-based smoothness measure for error concealment in DCT-based codecs , 1998, IEEE Trans. Circuits Syst. Video Technol..

[23]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[24]  Rabab Kreidieh Ward,et al.  Reconstruction of baseline JPEG coded images in error prone environments , 2000, IEEE Trans. Image Process..

[25]  Jianfei Cai,et al.  Image error-concealment via Block-based Bilateral Filtering , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[26]  Robert J. Marks,et al.  Recovery of image blocks using the method of alternating projections , 2005, IEEE Transactions on Image Processing.

[27]  Mohammed Ghanbari,et al.  Compact image coding using two-dimensional DCT pyramid , 1992 .

[28]  Cedric Nishan Canagarajah,et al.  Enhanced error concealment with mode selection , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..