Sparse recovery of missing image samples using a convex similarity index

Abstract This paper investigates the problem of recovering missing samples using methods based on sparse representation adapted for visually enhanced quality of reconstruction of image signals. Although, the popular Mean Square Error (MSE) criterion is convex and simple, it may not be entirely consistent with Human Visual System (HVS). Thus, instead of l2-norm or MSE, a new perceptual quality measure is used as the similarity criterion between the original and the reconstructed images. The proposed criterion called Convex SIMilarity (CSIM) index is a modified version of the Structural SIMilarity (SSIM) index, which despite its predecessor, is convex and uni-modal. We derive mathematical properties for the proposed index and show how to optimally choose the parameters of the proposed criterion, investigating the Restricted Isometry (RIP) and error-sensitivity properties. We also propose an iterative sparse recovery method based on a constrained l1-norm minimization problem, incorporating CSIM as the fidelity criterion. The resulting convex optimization problem is solved via an algorithm based on Alternating Direction Method of Multipliers (ADMM). Taking advantage of the convexity of the CSIM index, we also prove the convergence of the algorithm to the globally optimal solution of the proposed optimization problem, starting from any arbitrary point. Simulation results confirm the performance of the new similarity index as well as the proposed algorithm for missing sample recovery of image patch signals.

[1]  Michael Elad,et al.  Audio Inpainting , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[2]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[3]  J. Tropp,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, Commun. ACM.

[4]  Farokh Marvasti,et al.  Sparse Signal Processing , 2020, Encyclopedia of Wireless Networks.

[5]  David Zhang,et al.  A Survey of Sparse Representation: Algorithms and Applications , 2015, IEEE Access.

[6]  Farrokh Marvasti,et al.  Sparse and low-rank recovery using adaptive thresholding , 2018, Digit. Signal Process..

[7]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[8]  Onur G. Guleryuz,et al.  Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising-part II: adaptive algorithms , 2006, IEEE Transactions on Image Processing.

[9]  Christine Guillemot,et al.  Image Inpainting : Overview and Recent Advances , 2014, IEEE Signal Processing Magazine.

[10]  Panagiotis Kosmas,et al.  Microwave Medical Imaging Based on Sparsity and an Iterative Method With Adaptive Thresholding , 2015, IEEE Transactions on Medical Imaging.

[11]  Craig K. Enders,et al.  Applied Missing Data Analysis , 2010 .

[12]  Farrokh Marvasti,et al.  Iterative Null-space Projection Method with Adaptive Thresholding in Sparse Signal Recovery and Matrix Completion , 2016, IET Signal Process..

[13]  Farrokh Marvasti,et al.  Impulsive Noise Cancellation Based on Soft Decision and Recursion , 2009, IEEE Transactions on Instrumentation and Measurement.

[14]  Babak Hossein Khalaj,et al.  A unified approach to sparse signal processing , 2009, EURASIP Journal on Advances in Signal Processing.

[15]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[16]  Junfeng Yang,et al.  Alternating Direction Algorithms for 1-Problems in Compressive Sensing , 2009, SIAM J. Sci. Comput..

[17]  Christian Jutten,et al.  An Iterative Bayesian Algorithm for Sparse Component Analysis in Presence of Noise , 2009, IEEE Transactions on Signal Processing.

[18]  H. Weyl Das asymptotische Verteilungsgesetz der Eigenwerte linearer partieller Differentialgleichungen (mit einer Anwendung auf die Theorie der Hohlraumstrahlung) , 1912 .

[19]  Fan Chen,et al.  A color-gradient patch sparsity based image inpainting algorithm with structure coherence and neighborhood consistency , 2014, Signal Process..

[20]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[21]  K. V. S. Hari,et al.  An iterative framework for sparse signal reconstruction algorithms , 2015, Signal Process..

[22]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[23]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[24]  M. Elad,et al.  $rm K$-SVD: An Algorithm for Designing Overcomplete Dictionaries for Sparse Representation , 2006, IEEE Transactions on Signal Processing.

[25]  Farrokh Marvasti,et al.  Recovery of missing samples using sparse approximation via a Convex SIMilarity measure , 2017, 2017 International Conference on Sampling Theory and Applications (SampTA).

[26]  Stephen P. Boyd,et al.  An Interior-Point Method for Large-Scale $\ell_1$-Regularized Least Squares , 2007, IEEE Journal of Selected Topics in Signal Processing.

[27]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[28]  Mohamed-Jalal Fadili,et al.  Inpainting and Zooming Using Sparse Representations , 2009, Comput. J..

[29]  Zhou Wang,et al.  On the Mathematical Properties of the Structural Similarity Index , 2012, IEEE Transactions on Image Processing.

[30]  Yuan Lei,et al.  A new accelerated alternating minimization method for analysis sparse recovery , 2018, Signal Process..

[31]  Paris V. Giampouras,et al.  Online sparse and low-rank subspace learning from incomplete data: A Bayesian view , 2017, Signal Process..

[32]  Yin Zhang,et al.  An efficient augmented Lagrangian method with applications to total variation minimization , 2013, Computational Optimization and Applications.

[33]  Haifeng Liu,et al.  Sparse signal recovery via alternating projection method , 2018, Signal Process..

[34]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[35]  D. Donoho,et al.  Atomic Decomposition by Basis Pursuit , 2001 .

[36]  Shahram Shirani,et al.  Subjective and Objective Quality Assessment of Image: A Survey , 2014, ArXiv.

[37]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[38]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[39]  D. Donoho,et al.  Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA) , 2005 .

[40]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[41]  Kjersti Engan,et al.  Assessment of sparse-based inpainting for retinal vessel removal , 2017, Signal Process. Image Commun..

[42]  Miki Haseyama,et al.  Image inpainting based on sparse representations with a perceptual metric , 2013, EURASIP J. Adv. Signal Process..

[43]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[44]  Volkan Cevher,et al.  Compressible Distributions for High-Dimensional Statistics , 2011, IEEE Transactions on Information Theory.

[45]  Laurent Demanet,et al.  Fast Discrete Curvelet Transforms , 2006, Multiscale Model. Simul..

[46]  Cristian R. Rojas,et al.  Alternating strategies with internal ADMM for low-rank matrix reconstruction , 2016, Signal Process..

[47]  Rick Chartrand,et al.  Exact Reconstruction of Sparse Signals via Nonconvex Minimization , 2007, IEEE Signal Processing Letters.

[48]  William W. Hager,et al.  Updating the Inverse of a Matrix , 1989, SIAM Rev..

[49]  Jun Zhang,et al.  On Recovery of Sparse Signals Via $\ell _{1}$ Minimization , 2008, IEEE Transactions on Information Theory.

[50]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[51]  Christian Jutten,et al.  A Fast Approach for Overcomplete Sparse Decomposition Based on Smoothed $\ell ^{0}$ Norm , 2008, IEEE Transactions on Signal Processing.

[52]  T. Blumensath,et al.  Iterative Thresholding for Sparse Approximations , 2008 .