A multi-resolution, geometry-driven error concealment method for corrupted JPEG color images

Resume In this article, we propose a new multi-resolution, geometry-driven error concealment method for missing data recovery on gray-level and color JPEG images. Beside JPEG applications, our algorithm can also be used for any block-based compression scheme, including MPEG. It requires no extra redundancy bits nor source–destination interactions, as opposed to classical FEC/ARQ schemes. The reconstruction process consists in interpolating error-free decoded spatial information into corrupted areas, using the actual geometry of local structures. In addition, a multi-resolution scheme is used to organize the recovery process, from coarse to fine structures, and achieve better performances in terms of approximation and computation time. We will demonstrate that our model can also be used to conceal quantization errors (compression artifacts).

[1]  Ruey-Feng Chang,et al.  Error Concealment Using Adaptive Multilayer Perceptrons (MLPs) for Block-Based Image Coding , 2000, Neural Computing & Applications.

[2]  Jirí Adámek.  Foundations of coding - theory and applications of error-correcting codes with an introduction to cryptography and information theory , 1991 .

[3]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[4]  Benoit Tremblais,et al.  A fast multi-scale edge detection algorithm , 2004, Pattern Recognit. Lett..

[5]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Guillermo Sapiro,et al.  Wavelet-domain reconstruction of lost blocks in wireless image transmission and packet-switched networks , 2002, Proceedings. International Conference on Image Processing.

[7]  Guillermo Sapiro,et al.  Structure and texture filling-in of missing image blocks in wireless transmission and compression applications , 2003, IEEE Trans. Image Process..

[8]  John D. Villasenor,et al.  A class of reversible variable length codes for robust image and video coding , 1997, Proceedings of International Conference on Image Processing.

[9]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[10]  G. Sapiro,et al.  Geometric partial differential equations and image analysis [Book Reviews] , 2001, IEEE Transactions on Medical Imaging.

[11]  Sheila S. Hemami.  Robust image transmission using resynchronizing variable-length codes and error concealment , 2000, IEEE Journal on Selected Areas in Communications.

[12]  Thomas J. Ferguson,et al.  Self-synchronizing Huffman codes , 1984, IEEE Trans. Inf. Theory.

[13]  Christian Chatellier,et al.  A PDE-based method for ringing artifact removal on grayscale and color JPEG2000 images , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[14]  Sheila S. Hemami.  Digital Image Coding For Robust Multimedia Transmission , 1996 .

[15]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[16]  Sheila S. Hemami.  Reconstruction-optimized lapped orthogonal transforms , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[17]  M. Wada,et al.  Reversible variable length codes , 1995, IEEE Trans. Commun..

[18]  André Kaup,et al.  Spatial error concealment of corrupted image data using frequency selective extrapolation , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[19]  Teresa H. Y. Meng,et al.  Transform coded image reconstruction exploiting interblock correlation , 1995, IEEE Trans. Image Process..

[20]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[21]  Guillermo Sapiro,et al.  Inpainting surface holes , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[22]  J. Koenderink.  The structure of images , 2004, Biological Cybernetics.

[23]  P. Lions,et al.  Axioms and fundamental equations of image processing , 1993 .

[24]  Alfredo De Santis,et al.  On the construction of statistically synchronizable codes , 1992, IEEE Trans. Inf. Theory.

[25]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[26]  A. R. Reibman,et al.  Self-synchronizing variable-length codes for image transmission , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[27]  Zhou Wang,et al.  Best neighborhood matching: an information loss restoration technique for block-based image coding systems , 1998, IEEE Trans. Image Process..

[28]  Harald Grossauer,et al.  A Combined PDE and Texture Synthesis Approach to Inpainting , 2004, ECCV.

[29]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[30]  Rabab Kreidieh Ward,et al.  Reconstruction of baseline JPEG coded images in error prone environments , 2000, IEEE Trans. Image Process..

[31]  A Leon-Garcia,et al.  Information loss recovery for block-based image coding techniques-a fuzzy logic approach , 1995, IEEE Trans. Image Process..

[32]  Jean-Michel Morel,et al.  Level lines based disocclusion , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[33]  Jianhong Shen,et al.  Digital inpainting based on the Mumford–Shah–Euler image model , 2002, European Journal of Applied Mathematics.

[34]  Guillermo Sapiro,et al.  Vector Median Filters, Inf-Sup Operations, and Coupled PDE's: Theoretical Connections , 2000, Journal of Mathematical Imaging and Vision.

[35]  Hans-Peter Seidel,et al.  Image restoration using multiresolution texture synthesis and image inpainting , 2003, Proceedings Computer Graphics International 2003.

[36]  J. Morel,et al.  An axiomatic approach to image interpolation. , 1998, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[37]  Amy R. Reibman,et al.  An error concealment algorithm for images subject to channel errors , 1995, IEEE Trans. Image Process..

[38]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[39]  M. Charrier,et al.  JPEG2000, the next millennium compression standard for still images , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[40]  Joachim Weickert,et al.  Coherence-enhancing diffusion of colour images , 1999, Image Vis. Comput..

[41]  Shu Lin,et al.  Error control coding : fundamentals and applications , 1983 .

[42]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[43]  W. Kwok,et al.  Multi-directional interpolation for spatial error concealment , 1993 .

[44]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, IEEE Trans. Image Process..

[45]  Sridhar Radhakrishnan,et al.  Error control and concealment for image transmission , 2000, IEEE Communications Surveys & Tutorials.

[46]  Chi-Keung Tang,et al.  Image repairing: robust image synthesis by adaptive ND tensor voting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[47]  Silvano Di Zenzo,et al.  A note on the gradient of a multi-image , 1986, Comput. Vis. Graph. Image Process..

[48]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[49]  F. MacWilliams,et al.  The Theory of Error-Correcting Codes , 1977 .

[50]  Bart M. ter Haar Romeny,et al.  Geometry-Driven Diffusion in Computer Vision , 1994, Computational Imaging and Vision.

[51]  P. Lions,et al.  Image selective smoothing and edge detection by nonlinear diffusion. II , 1992 .

[52]  Sang Uk Lee,et al.  Recovery of corrupted image data based on the NURBS interpolation , 1999, IEEE Trans. Circuits Syst. Video Technol..

[53]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[54]  Yao Wang,et al.  Maximally smooth image recovery in transform coding , 1993, IEEE Trans. Commun..

[55]  Guillermo Sapiro,et al.  Filling-in by joint interpolation of vector fields and gray levels , 2001, IEEE Trans. Image Process..