Compressing Images with Diffusion- and Exemplar-Based Inpainting

Diffusion-based image compression methods can surpass state-of-the-art transform coders like JPEG 2000 for cartoon-like images. However, they are not well-suited for highly textured image content. Recently, advances in exemplar-based inpainting have made it possible to reconstruct images with non-local methods from sparse known data. In our work we compare the performance of such exemplar-based and diffusion-based inpainting algorithms, dependent on the type of image content. We use our insights to construct a hybrid compression codec that combines the strengths of both approaches. Experiments demonstrate that our novel method offers significant advantages over state-of-the-art diffusion-based methods on textured image data and can compete with transform coders.

[1]  Yun Li,et al.  A scalable coding approach for high quality depth image compression , 2012, 2012 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[2]  Joan L. Mitchell,et al.  JPEG: Still Image Data Compression Standard , 1992 .

[3]  Harry Shum,et al.  Image completion with structure propagation , 2005, ACM Trans. Graph..

[4]  Alexei A. Efros,et al.  Scene completion using millions of photographs , 2008, Commun. ACM.

[5]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[6]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2002, The Kluwer International Series in Engineering and Computer Science.

[7]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Joachim Weickert,et al.  Beating the Quality of JPEG 2000 with Anisotropic Diffusion , 2009, DAGM-Symposium.

[9]  Matthew V. Mahoney,et al.  Adaptive weighing of context models for lossless data compression , 2005 .

[10]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[11]  Christine Guillemot,et al.  Efficient depth map compression based on lossless edge coding and diffusion , 2012, 2012 Picture Coding Symposium.

[12]  Joachim Weickert,et al.  Understanding, Optimising, and Extending Data Compression with Anisotropic Diffusion , 2014, International Journal of Computer Vision.

[13]  Joachim Weickert,et al.  Compression of Depth Maps with Segment-Based Homogeneous Diffusion , 2013, SSVM.

[14]  Guillermo Sapiro,et al.  Structure and texture filling-in of missing image blocks in wireless transmission and compression applications , 2003, IEEE Trans. Image Process..

[15]  Joachim Weickert,et al.  Colour image compression with anisotropic diffusion , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[16]  Michael W. Marcellin,et al.  JPEG2000 - image compression fundamentals, standards and practice , 2013, The Kluwer international series in engineering and computer science.

[17]  Joachim Weickert,et al.  Theoretical Foundations of Anisotropic Diffusion in Image Processing , 1994, Theoretical Foundations of Computer Vision.

[18]  Patrick Pérez,et al.  Geometrically Guided Exemplar-Based Inpainting , 2011, SIAM J. Imaging Sci..

[19]  Pascal Peter,et al.  Three-Dimensional Data Compression with Anisotropic Diffusion , 2013, GCPR.

[20]  Guillermo Sapiro,et al.  Exemplar-Based Interpolation of Sparsely Sampled Images , 2009, EMMCVPR.

[21]  Dong Liu,et al.  Image Compression With Edge-Based Inpainting , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[23]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, IEEE Trans. Image Process..

[24]  Michel Barlaud,et al.  Deterministic edge-preserving regularization in computed imaging , 1997, IEEE Trans. Image Process..

[25]  Guillermo Sapiro,et al.  A Variational Framework for Exemplar-Based Image Inpainting , 2011, International Journal of Computer Vision.

[26]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[27]  Hans-Peter Seidel,et al.  Towards PDE-Based Image Compression , 2005, VLSM.

[28]  Joachim Weickert,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Edge-based Compression of Cartoon-like Images with Homogeneous Diffusion Edge-based Compression of Cartoon-like Images with Homogeneous Diffusion Edge-based Compression of Cartoon-like Images with Homogeneous Diffusion , 2022 .