Deringing cartoons by image analogies

In this article, we propose a novel method to reduce ringing artifacts in BDCT-encoded cartoon images using image analogies. The quantization procedure of BDCT compression (such as JPEG and MPEG) introduces annoying visual artifacts. Our main focus is on the removal of ringing artifacts that is seldom addressed by existing methods. In the proposed method, the contaminated image is modeled as a Markov random field (MRF). We “learn” the behavior of contamination by extracting massive numbers of artifact patterns from a training set, and organizing them using tree-structured vector quantization (TSVQ). Instead of postfiltering the input contaminated image, we synthesize an artifact-reduced image. Our method is noniterative and hence, can remove artifacts within a very short period of time. We show that substantial improvement is achieved using the proposed method in terms of visual quality and statistics.

[1]  Michael G. Strintzis,et al.  Blocking artifact detection and reduction in compressed data , 2002, IEEE Trans. Circuits Syst. Video Technol..

[2]  Nuria Oliver,et al.  Curve Analogies , 2002, Rendering Techniques.

[3]  Avideh Zakhor,et al.  An optimization approach for removing blocking effects in transform coding , 1995, IEEE Trans. Circuits Syst. Video Technol..

[4]  Truong Q. Nguyen,et al.  Maximum likelihood parameter estimation for image ringing artifact removal , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[5]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[6]  Sang Uk Lee,et al.  On the POCS-based postprocessing technique to reduce the blocking artifacts in transform coded images , 1998, IEEE Trans. Circuits Syst. Video Technol..

[7]  Baining Guo,et al.  Synthesis and rendering of bidirectional texture functions on arbitrary surfaces , 2004, IEEE Transactions on Visualization and Computer Graphics.

[8]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[9]  H. W. Park,et al.  Blocking effect reduction of JPEG images by signal adaptive filtering , 1998, IEEE Trans. Image Process..

[10]  Hyunchul Kang,et al.  A practical projection-based postprocessing of block-coded images with fast convergence rate , 2000, IEEE Trans. Circuits Syst. Video Technol..

[11]  P. L. Combettes.  The foundations of set theoretic estimation , 1993 .

[12]  P. L. Combettes,et al.  Foundation of set theoretic estimation , 1993 .

[13]  Guoping Qiu,et al.  MLP for adaptive postprocessing block-coded images , 2000, IEEE Trans. Circuits Syst. Video Technol..

[14]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[15]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[16]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[17]  P. P. Vaidyanathan,et al.  Look-up table (LUT) method for inverse halftoning , 2001, IEEE Trans. Image Process..

[18]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[19]  Yücel Altunbasak,et al.  Multiframe blocking-artifact reduction for transform-coded video , 2002, IEEE Trans. Circuits Syst. Video Technol..

[20]  Nikolas P. Galatsanos,et al.  Removal of compression artifacts using projections onto convex sets and line process modeling , 1997, IEEE Trans. Image Process..

[21]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[22]  Dani Lischinski,et al.  Texture Mixing and Texture Movie Synthesis Using Statistical Learning , 2001, IEEE Trans. Vis. Comput. Graph..

[23]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[24]  Yung-Chang Chen,et al.  A new adaptive separable median filter for removing blocking effects , 1993 .

[25]  Nikolas P. Galatsanos,et al.  Projection-based spatially adaptive reconstruction of block-transform compressed images , 1995, IEEE Trans. Image Process..

[26]  Tao Chen,et al.  Adaptive postfiltering of transform coefficients for the reduction of blocking artifacts , 2001, IEEE Trans. Circuits Syst. Video Technol..

[27]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[28]  Hao Wang,et al.  Games, Logic and Computers , 1965 .

[29]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Jae S. Lim,et al.  Reduction of blocking effect in image coding , 1983, ICASSP.

[31]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[32]  Avideh Zakhor.  Iterative procedures for reduction of blocking effects in transform image coding , 1992, IEEE Trans. Circuits Syst. Video Technol..

[33]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[34]  Jae Lim,et al.  Reduction Of Blocking Effects In Image Coding , 1984 .

[35]  Jiebo Luo,et al.  Artifact reduction in low bit rate DCT-based image compression , 1996, IEEE Trans. Image Process..

[36]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[37]  Sang Uk Lee,et al.  A DCT-based spatially adaptive post-processing technique to reduce the blocking artifacts in transform coded images , 2000, IEEE Trans. Circuits Syst. Video Technol..

[38]  Hong Yan,et al.  Artifact reduction in compressed images based on region homogeneity constraints using the projection onto convex sets algorithm , 2002, IEEE Trans. Circuits Syst. Video Technol..

[39]  Wan-Chi Siu,et al.  A practical postprocessing technique for real-time block-based coding system , 1998, IEEE Trans. Circuits Syst. Video Technol..

[40]  Anton Alstes.  Wang Tiles for Image and Texture Generation , 2004 .

[41]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[42]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[43]  P. Haavisto,et al.  Post-Filtering Methods for Reducing Blocking Effects from Coded Images , 1994, IEEE International Conference on Consumer Electronics.

[44]  Truong Q. Nguyen,et al.  Maximum-likelihood parameter estimation for image ringing-artifact removal , 2001, IEEE Trans. Circuits Syst. Video Technol..

[45]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[46]  Chung-Neng Wang,et al.  A New Postprocessing Method For The Block-based DCT Coding Based On The Convex-projection Theory , 1998, International 1998 Conference on Consumer Electronics.

[47]  William T. Freeman,et al.  Learning Low-Level Vision , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[48]  Anthony Vetro,et al.  Edge map guided adaptive post-filter for blocking and ringing artifacts removal , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[49]  Adam Finkelstein,et al.  Lapped textures , 2000, SIGGRAPH.

[50]  Bhaskar Ramamurthi,et al.  Nonlinear space-variant postprocessing of block coded images , 1986, IEEE Trans. Acoust. Speech Signal Process..

[51]  Chung J. Kuo,et al.  Adaptive postprocessor for block encoded images , 1995, IEEE Trans. Circuits Syst. Video Technol..

[52]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.