Inpainting for Remotely Sensed Images With a Multichannel Nonlocal Total Variation Model

Filling dead pixels or removing uninteresting objects is often desired in the applications of remotely sensed images. In this paper, an effective image inpainting technology is presented to solve this task, based on multichannel nonlocal total variation. The proposed approach takes advantage of a nonlocal method, which has a superior performance in dealing with textured images and reconstructing large-scale areas. Furthermore, it makes use of the multichannel data of remotely sensed images to achieve spectral coherence for the reconstruction result. To optimize the proposed variation model, a Bregmanized-operator-splitting algorithm is employed. The proposed inpainting algorithm was tested on simulated and real images. The experimental results verify the efficacy of this algorithm.

[1]  Laurent D. Cohen,et al.  Non-local Regularization of Inverse Problems , 2008, ECCV.

[2]  Xuelong Li,et al.  Image Quality Assessment Based on Multiscale Geometric Analysis , 2009, IEEE Transactions on Image Processing.

[3]  D. Donoho,et al.  Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA) , 2005 .

[4]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[5]  Fugen Zhou,et al.  Inpainting Thick Image Regions using Isophote Propagation , 2006, 2006 International Conference on Image Processing.

[6]  Guillermo Sapiro,et al.  A Comprehensive Framework for Image Inpainting , 2010, IEEE Transactions on Image Processing.

[7]  Tony F. Chan,et al.  Mathematical Models for Local Nontexture Inpaintings , 2002, SIAM J. Appl. Math..

[8]  J. Storey,et al.  LANDSAT 7 SCAN LINE CORRECTOR-OFF GAP-FILLED PRODUCT DEVELOPMENT , 2005 .

[9]  Christine Fernandez-Maloigne,et al.  A Bandelet-Based Inpainting Technique for Clouds Removal From Remotely Sensed Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Xian-Sheng Hua,et al.  Ensemble Manifold Regularization , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Tony F. Chan,et al.  Color TV: total variation methods for restoration of vector-valued images , 1998, IEEE Trans. Image Process..

[12]  Wataru Takeuchi,et al.  Restoration of Aqua MODIS Band 6 Using Histogram Matching and Local Least Squares Fitting , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Liangpei Zhang,et al.  Recovering Reflectance of AQUA MODIS Band 6 Based on Within-Class Local Fitting , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Andrew Beng Jin Teoh,et al.  Secure Hashing of Dynamic Hand Signatures Using Wavelet-Fourier Compression with BioPhasor Mixing and Discretization , 2006, EURASIP J. Adv. Signal Process..

[15]  John Shawe-Taylor,et al.  MahNMF: Manhattan Non-negative Matrix Factorization , 2012, ArXiv.

[16]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[17]  Wotao Yin,et al.  An Iterative Regularization Method for Total Variation-Based Image Restoration , 2005, Multiscale Model. Simul..

[18]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[19]  Liangpei Zhang,et al.  A MAP-Based Algorithm for Destriping and Inpainting of Remotely Sensed Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[20]  Michael Schmidt,et al.  Geostatistical interpolation of SLC-off Landsat ETM+ images , 2009 .

[21]  David A. Landgrebe,et al.  An adaptive reconstruction system for spatially correlated multispectral multitemporal images , 1991, IEEE Trans. Geosci. Remote. Sens..

[22]  Xavier Bresson,et al.  Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction , 2010, SIAM J. Imaging Sci..

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  J Scott Tyo,et al.  Dead pixel replacement in LWIR microgrid polarimeters. , 2007, Optics express.

[25]  Liangpei Zhang,et al.  Adaptive Multiple-Frame Image Super-Resolution Based on U-Curve , 2010, IEEE Transactions on Image Processing.

[26]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[28]  J. Cihlar,et al.  An image transform to characterize and compensate for spatial variations in thin cloud contamination of Landsat images , 2002 .

[29]  A. Ben Hamza,et al.  A Variational Approach to Maximum a Posteriori Estimation for Image Denoising , 2001, EMMCVPR.

[30]  Michael D. Grossberg,et al.  Quantitative Restoration for MODIS Band 6 on Aqua , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[32]  Edmund Y. Lam,et al.  A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video , 2007, EURASIP J. Adv. Signal Process..

[33]  Farid Melgani,et al.  Contextual reconstruction of cloud-contaminated multitemporal multispectral images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[34]  Arnt-Børre Salberg,et al.  Land Cover Classification of Cloud-Contaminated Multitemporal High-Resolution Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[35]  L. Bregman The relaxation method of finding the common point of convex sets and its application to the solution of problems in convex programming , 1967 .

[36]  Farid Melgani,et al.  Inpainting Strategies for Reconstruction of Missing Data in VHR Images , 2011, IEEE Geoscience and Remote Sensing Letters.

[37]  Xuelong Li,et al.  Multi-scale dictionary for single image super-resolution , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Subhasis Chaudhuri,et al.  Zoom-based super-resolution reconstruction approach using prior total variation , 2007 .