Missing Data Reconstruction for Remote Sensing Images With Weighted Low-Rank Tensor Model

Missing data reconstruction for remote sensing images, such as dead-pixel recovery and cloud removal, is important for remote sensing data applications. Missing information reconstruction is well known as being an ill-posed inverse problem. In this paper, a weighted low-rank tensor regularization model is proposed to handle the problem. The proposed model fully utilizes the correlations in the spatial, spectral, and temporal components of the remote sensing images to adaptively deal with the varied missing data problems, including the Aqua Moderate Resolution Imaging Spectroradiometer (MODIS) band 6 dead line problem, the Landsat scan-line corrector failure (SLC-off) problem, and cloud contamination. A double-weighted treatment is developed to balance the contributions from the different dimensions and preserve the different structures and textures in remote sensing images. The experiments undertaken confirmed the good performance of the proposed method, and the reconstruction results of the proposed method, in both visual effect and quantitative evaluation, were superior to those of the other methods.

[1]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[2]  Feng Gao,et al.  A Modified Neighborhood Similar Pixel Interpolator Approach for Removing Thick Clouds in Landsat Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[3]  Gang Yang,et al.  Missing Information Reconstruction of Remote Sensing Data: A Technical Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[4]  Guy Gilboa,et al.  Nonlocal Operators with Applications to Image Processing , 2008, Multiscale Model. Simul..

[5]  Liangpei Zhang,et al.  Recovering Reflectance of AQUA MODIS Band 6 Based on Within-Class Local Fitting , 2011, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[6]  Wataru Takeuchi,et al.  Restoration of Aqua MODIS Band 6 Using Histogram Matching and Local Least Squares Fitting , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Jieping Ye,et al.  Tensor Completion for Estimating Missing Values in Visual Data , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Christine Guillemot,et al.  Image Inpainting : Overview and Recent Advances , 2014, IEEE Signal Processing Magazine.

[9]  Xuelong Li,et al.  Multiresolution Imaging , 2014, IEEE Transactions on Cybernetics.

[10]  Chao-Hung Lin,et al.  Patch-Based Information Reconstruction of Cloud-Contaminated Multitemporal Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[11]  Jun Huang,et al.  Hyperspectral image denoising using the robust low-rank tensor recovery. , 2015, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Liangpei Zhang,et al.  Compressed Sensing-Based Inpainting of Aqua Moderate Resolution Imaging Spectroradiometer Band 6 Using Adaptive Spectrum-Weighted Sparse Bayesian Dictionary Learning , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Christine Fernandez-Maloigne,et al.  A Bandelet-Based Inpainting Technique for Clouds Removal From Remotely Sensed Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[14]  Liangpei Zhang,et al.  Patch Matching-Based Multitemporal Group Sparse Representation for the Missing Information Reconstruction of Remote-Sensing Images , 2016, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[15]  Nikos Komodakis,et al.  Image Completion Using Efficient Belief Propagation Via Priority Scheduling and Dynamic Pruning , 2007, IEEE Transactions on Image Processing.

[16]  Liangpei Zhang,et al.  Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal MRF model , 2014 .

[17]  Li Yan,et al.  An Adaptive Weighted Tensor Completion Method for the Recovery of Remote Sensing Images With Missing Data , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Wan-Chi Siu,et al.  Review of image interpolation and super-resolution , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[19]  Nianzeng Che,et al.  A new method for retrieving band 6 of aqua MODIS , 2006, IEEE Geoscience and Remote Sensing Letters.

[20]  Tony F. Chan,et al.  Nontexture Inpainting by Curvature-Driven Diffusions , 2001, J. Vis. Commun. Image Represent..

[21]  Salvador Gabarda,et al.  Cloud covering denoising through image fusion , 2007, Image Vis. Comput..

[22]  Michael D. Grossberg,et al.  Quantitative Restoration for MODIS Band 6 on Aqua , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[24]  Ce Zhu,et al.  Low Rank Tensor Completion for Multiway Visual Data , 2018, 1805.03967.

[25]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[26]  Chao Zeng,et al.  Recovering missing pixels for Landsat ETM + SLC-off imagery using multi-temporal regression analysis and a regularization method , 2013 .

[27]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[28]  Liangpei Zhang,et al.  Total-Variation-Regularized Low-Rank Matrix Factorization for Hyperspectral Image Restoration , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[29]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[30]  B. Recht,et al.  Tensor completion and low-n-rank tensor recovery via convex optimization , 2011 .

[31]  Naoto Yokoya,et al.  Hyperspectral Super-Resolution of Locally Low Rank Images From Complementary Multisource Data , 2014, IEEE Transactions on Image Processing.

[32]  Feng Gao,et al.  A simple and effective method for filling gaps in Landsat ETM+ SLC-off images , 2011 .

[33]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[34]  Liangpei Zhang,et al.  Hyperspectral Image Denoising Employing a Spectral–Spatial Adaptive Total Variation Model , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[36]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[37]  Xian-Sheng Hua,et al.  Ensemble Manifold Regularization , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[39]  Yongqiang Zhao,et al.  Hyperspectral Image Denoising via Sparse Representation and Low-Rank Constraint , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[40]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[41]  Naoto Yokoya,et al.  Nonlocal Tensor Completion for Multitemporal Remotely Sensed Images’ Inpainting , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[42]  J. Storey,et al.  LANDSAT 7 SCAN LINE CORRECTOR-OFF GAP-FILLED PRODUCT DEVELOPMENT , 2005 .

[43]  XieQi,et al.  Weighted Nuclear Norm Minimization and Its Applications to Low Level Vision , 2017 .