A bi-level view of inpainting - based image compression

Inpainting based image compression approaches, especially linear and non-linear diffusion models, are an active research topic for lossy image compression. The major challenge in these compression models is to find a small set of descriptive supporting points, which allow for an accurate reconstruction of the original image. It turns out in practice that this is a challenging problem even for the simplest Laplacian interpolation model. In this paper, we revisit the Laplacian interpolation compression model and introduce two fast algorithms, namely successive preconditioning primal dual algorithm and the recently proposed iPiano algorithm, to solve this problem efficiently. Furthermore, we extend the Laplacian interpolation based compression model to a more general form, which is based on principles from bi-level optimization. We investigate two different variants of the Laplacian model, namely biharmonic interpolation and smoothed Total Variation regularization. Our numerical results show that significant improvements can be obtained from the biharmonic interpolation model, and it can recover an image with very high quality from only 5% pixels.

[1]  Antonin Chambolle,et al.  Diagonal preconditioning for first order primal-dual algorithms in convex optimization , 2011, 2011 International Conference on Computer Vision.

[2]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[3]  Andrea L. Bertozzi,et al.  A Wavelet-Laplace Variational Technique for Image Deconvolution and Inpainting , 2008, IEEE Transactions on Image Processing.

[4]  Jianhong Shen,et al.  Inpainting and the Fundamental Problem of Image Processing , 2002 .

[5]  Frank Neumann,et al.  Optimising Spatial and Tonal Data for Homogeneous Diffusion Inpainting , 2011, SSVM.

[6]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[7]  Horst Bischof,et al.  Revisiting Loss-Specific Training of Filter-Based MRFs for Image Restoration , 2013, GCPR.

[8]  Yunjin Chen,et al.  Insights Into Analysis Operator Learning: From Patch-Based Sparse Models to Higher Order MRFs , 2014, IEEE Transactions on Image Processing.

[9]  Sayali Baheti,et al.  Region Filling and Object Removal by Exemplar based Image Inpainting , 2015 .

[10]  Joachim Weickert,et al.  How to Choose Interpolation Data in Images , 2009, SIAM J. Appl. Math..

[11]  Joachim Weickert,et al.  Universität Des Saarlandes Fachrichtung 6.1 – Mathematik Edge-based Compression of Cartoon-like Images with Homogeneous Diffusion Edge-based Compression of Cartoon-like Images with Homogeneous Diffusion Edge-based Compression of Cartoon-like Images with Homogeneous Diffusion , 2022 .

[12]  David Stutz IPIANO : INERTIAL PROXIMAL ALGORITHM FOR NON-CONVEX OPTIMIZATION , 2016 .

[13]  Joan L. Mitchell,et al.  JPEG: Still Image Data Compression Standard , 1992 .

[14]  Hans-Peter Seidel,et al.  Image Compression with Anisotropic Diffusion , 2008, Journal of Mathematical Imaging and Vision.

[15]  Joachim Weickert,et al.  An Optimal Control Approach to Find Sparse Data for Laplace Interpolation , 2013, EMMCVPR.

[16]  Joachim Weickert,et al.  Beating the Quality of JPEG 2000 with Anisotropic Diffusion , 2009, DAGM-Symposium.