Cloud removal for hyperspectral remotely sensed images based on hyperspectral information fusion

ABSTRACT Hyperspectral remote sensing plays an important role in a wide variety of fields. However, its specific application for land surface analysis has been constrained due to the different shapes of thick, opaque cloud cover. The reconstruction of missing information obscured by clouds in remote-sensing images is an area of active research. However, most of the available cloud-removal methods are not suitable for hyperspectral images, because they lose the spectral information which is very important for hyperspectral analysis. In this article, we developed a new spectral resolution enhancement method for cloud removal (SREM-CR) from hyperspectral images, with the help of an auxiliary cloud-free multispectral image acquired at different times. In the fixed hyperspectral image, spectra of the cloud cover pixels are reconstructed depending on the relationship between the original hyperspectral and multispectral images. The final resulting image has the same spectral resolution as the original hyperspectral image but without clouds. This approach was tested on two experiments, in which the results were compared by visual interpretation and statistical indices. Our method demonstrated good performance.

[1]  David A. Landgrebe,et al.  An adaptive reconstruction system for spatially correlated multispectral multitemporal images , 1991, IEEE Trans. Geosci. Remote. Sens..

[2]  E. Helmer,et al.  Cloud-Free Satellite Image Mosaics with Regression Trees and Histogram Matching. , 2005 .

[3]  Liangpei Zhang,et al.  Single image haze removal considering sensor blur and noise , 2013, EURASIP J. Adv. Signal Process..

[4]  Chao-Hung Lin,et al.  Patch-Based Information Reconstruction of Cloud-Contaminated Multitemporal Images , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[5]  D. Donoho,et al.  Simultaneous cartoon and texture image inpainting using morphological component analysis (MCA) , 2005 .

[6]  Christine Fernandez-Maloigne,et al.  A Bandelet-Based Inpainting Technique for Clouds Removal From Remotely Sensed Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Huifang Li,et al.  A Variational Gradient-based Fusion Method for Visible and SWIR Imagery , 2012 .

[8]  Jian Sun,et al.  Statistics of Patch Offsets for Image Completion , 2012, ECCV.

[9]  Chao-Hung Lin,et al.  Cloud Removal From Multitemporal Satellite Images Using Information Cloning , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Soo Chin Liew,et al.  Producing cloud free and cloud-shadow free mosaic from cloudy IKONOS images , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[11]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[12]  Christopher M. Stevens,et al.  EO-1: NASA's first new millennium earth orbiting mission , 1996, Optics & Photonics.

[13]  L. Wald,et al.  Fusion of high spatial and spectral resolution images : The ARSIS concept and its implementation , 2000 .

[14]  D. Roy,et al.  The availability of cloud-free Landsat ETM+ data over the conterminous United States and globally , 2008 .

[15]  Liangpei Zhang,et al.  A MAP-Based Algorithm for Destriping and Inpainting of Remotely Sensed Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[16]  Arnt-Børre Salberg,et al.  Land Cover Classification of Cloud-Contaminated Multitemporal High-Resolution Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Feng Gao,et al.  A simple and effective method for filling gaps in Landsat ETM+ SLC-off images , 2011 .

[18]  J. Cihlar,et al.  An image transform to characterize and compensate for spatial variations in thin cloud contamination of Landsat images , 2002 .

[19]  Feng Gao,et al.  A Modified Neighborhood Similar Pixel Interpolator Approach for Removing Thick Clouds in Landsat Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[20]  Yi Guo,et al.  Enhancement of Spectral Resolution for Remotely Sensed Multispectral Image , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[21]  Farid Melgani,et al.  Contextual reconstruction of cloud-contaminated multitemporal multispectral images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[22]  Jennifer L. Dungan,et al.  Kriging in the shadows: Geostatistical interpolation for remote sensing , 1994 .

[23]  Wataru Takeuchi,et al.  Restoration of Aqua MODIS Band 6 Using Histogram Matching and Local Least Squares Fitting , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[25]  Naoto Yokoya,et al.  Coupled Nonnegative Matrix Factorization Unmixing for Hyperspectral and Multispectral Data Fusion , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Farid Melgani,et al.  Inpainting Strategies for Reconstruction of Missing Data in VHR Images , 2011, IEEE Geoscience and Remote Sensing Letters.