Cloud Removal in Image Time Series Through Sparse Reconstruction From Random Measurements

In this paper, we propose a cloud removal algorithm for scenes within a satellite image time series based on synthetization of the affected areas via sparse reconstruction. The high spectrotemporal dimensionality of time series allows applying pixel-based sparse reconstruction techniques efficiently, estimating the values below a cloudy area by observing the spectral evolution in time of pixels in cloud-free areas. The process implicitly compensates the overall atmospheric interactions affecting a given image, and it is possible even if only one acquisition is available for a given period of time. The dictionary, on the basis of which the data are reconstructed, is selected randomly from the available image elements in the time series. This increases the degree of automation of the process, if the area containing clouds and their shadows is given. Favorable comparisons with similar methods and applications to supervised classification and change detection show that the proposed algorithm restores images locally contaminated by clouds and their shadows in a satisfactory and efficient way.

[1]  Chao-Hung Lin,et al.  Patch-Based Information Reconstruction of Cloud-Contaminated Multitemporal Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[3]  Gérard Dedieu,et al.  A multi-temporal method for cloud detection, applied to FORMOSAT-2, VENµS, LANDSAT and SENTINEL-2 images , 2010 .

[4]  Bastian Siegmann,et al.  Identific ation of Agricultural Crop Types in Northern Israel using Multitemporal RapidEye Data , 2015 .

[5]  Matthias Drusch,et al.  Sentinel-2: ESA's Optical High-Resolution Mission for GMES Operational Services , 2012 .

[6]  John F. Mustard,et al.  Spectral unmixing , 2002, IEEE Signal Process. Mag..

[7]  Peter Reinartz,et al.  Unmixing-based denoising for destriping and inpainting of hyperspectral images , 2014, 2014 IEEE Geoscience and Remote Sensing Symposium.

[8]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[10]  I. L. Thomas,et al.  Review Article A review of multi-channel indices of class separability , 1987 .

[11]  Julien Mairal,et al.  Convex optimization with sparsity-inducing norms , 2011 .

[12]  Gang Yang,et al.  Missing Information Reconstruction of Remote Sensing Data: A Technical Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[13]  P. Reinartz,et al.  Building damage assessment after the earthquake in Haiti using two post-event satellite stereo imagery and DSMs , 2013, Joint Urban Remote Sensing Event 2013.

[14]  Antonio J. Plaza,et al.  A fast iterative algorithm for implementation of pixel purity index , 2006, IEEE Geoscience and Remote Sensing Letters.

[15]  Peter Reinartz,et al.  Joint Sparsity Model for Multilook Hyperspectral Image Unmixing , 2015, IEEE Geoscience and Remote Sensing Letters.

[16]  Farid Melgani,et al.  Inpainting Strategies for Reconstruction of Missing Data in VHR Images , 2011, IEEE Geoscience and Remote Sensing Letters.

[17]  Mathias Schneider,et al.  The Fully Automatic Optical Processing System CATENA at DLR , 2013 .

[18]  Peter Reinartz,et al.  Restoration of Simulated EnMAP Data through Sparse Spectral Unmixing , 2015, Remote. Sens..

[19]  Huifang Li,et al.  Temporal Domain Group Sparse Representation Based Cloud Removal for Remote Sensing Images , 2015, ICIG.

[20]  Liangpei Zhang,et al.  Sparse-based reconstruction of missing information in remote sensing images from spectral/temporal complementary information , 2015 .

[21]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[22]  Ying Wu,et al.  Regularized Simultaneous Forward–Backward Greedy Algorithm for Sparse Unmixing of Hyperspectral Data , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Allan Aasbjerg Nielsen,et al.  The Regularized Iteratively Reweighted MAD Method for Change Detection in Multi- and Hyperspectral Data , 2007, IEEE Transactions on Image Processing.

[24]  José M. Bioucas-Dias,et al.  Hyperspectral Subspace Identification , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[25]  Massimo Fornasier,et al.  Restoration of Color Images by Vector Valued BV Functions and Variational Calculus , 2007, SIAM J. Appl. Math..

[26]  Peter Reinartz,et al.  Noise Reduction in Hyperspectral Images Through Spectral Unmixing , 2014, IEEE Geoscience and Remote Sensing Letters.

[27]  Gunter Menz,et al.  Spectral requirements on airborne hyperspectral remote sensing data for wheat disease detection , 2011, Precision Agriculture.

[28]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[29]  Farid Melgani,et al.  Missing-Area Reconstruction in Multispectral Images Under a Compressive Sensing Perspective , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Farid Melgani,et al.  Contextual reconstruction of cloud-contaminated multitemporal multispectral images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[31]  Bastian Siegmann,et al.  Improved crop classification using multitemporal RapidEye data , 2015, 2015 8th International Workshop on the Analysis of Multitemporal Remote Sensing Images (Multi-Temp).

[32]  Antonio J. Plaza,et al.  Thin Cloud Removal Based on Signal Transmission Principles and Spectral Mixture Analysis , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[33]  D. Roy,et al.  The availability of cloud-free Landsat ETM+ data over the conterminous United States and globally , 2008 .

[34]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[35]  Peter Reinartz,et al.  Adaptive Shadow Detection Using a Blackbody Radiator Model , 2011, IEEE Transactions on Geoscience and Remote Sensing.