A Bandelet-Based Inpainting Technique for Clouds Removal From Remotely Sensed Images

It is well known that removing cloud-contaminated portions of a remotely sensed image and then filling in the missing data represent an important photo editing cumbersome task. In this paper, an efficient inpainting technique for the reconstruction of areas obscured by clouds or cloud shadows in remotely sensed images is presented. This technique is based on the Bandelet transform and the multiscale geometrical grouping. It consists of two steps. In the first step, the curves of geometric flow of different zones of the image are determined by using the Bandelet transform with multiscale grouping. This step allows an efficient representation of the multiscale geometry of the image's structures. Having well represented this geometry, the information inside the cloud-contaminated zone is synthesized by propagating the geometrical flow curves inside that zone. This step is accomplished by minimizing a functional whose role is to reconstruct the missing or cloud contaminated zone independently of the size and topology of the inpainting domain. The proposed technique is illustrated with some examples on processing aerial images. The obtained results are compared with those obtained by other clouds removal techniques.

[1]  S. Mallat,et al.  Surface compression with geometric bandelets , 2005, ACM Trans. Graph..

[2]  G. Peyré Géométrie multi-échelles pour les images et les textures , 2005 .

[3]  Farid Melgani,et al.  Contextual reconstruction of cloud-contaminated multitemporal multispectral images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[4]  Manuel Menezes de Oliveira Neto,et al.  Fast Digital Image Inpainting , 2001, VIIP.

[5]  Stéphane Mallat,et al.  Sparse geometric image representations with bandelets , 2005, IEEE Transactions on Image Processing.

[6]  Rachid Deriche,et al.  Vector-valued image regularization with PDEs: a common framework for different applications , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Stéphane Mallat,et al.  Discrete bandelets with geometric orthogonal filters , 2005, IEEE International Conference on Image Processing 2005.

[8]  Jhing-Fa Wang,et al.  A Hybrid Algorithm With Artifact Detection Mechanism for Region Filling After Object Removal From a Digital Photograph , 2007, IEEE Transactions on Image Processing.

[9]  Fen Chen,et al.  Clouds and cloud shadows removal from high-resolution remote sensing images , 2005, Proceedings. 2005 IEEE International Geoscience and Remote Sensing Symposium, 2005. IGARSS '05..

[10]  Stéphane Mallat,et al.  Surface compression with geometric bandelets , 2005, ACM Trans. Graph..

[11]  Fugen Zhou,et al.  Inpainting Thick Image Regions using Isophote Propagation , 2006, 2006 International Conference on Image Processing.

[12]  David A. Landgrebe,et al.  An adaptive reconstruction system for spatially correlated multispectral multitemporal images , 1991, IEEE Trans. Geosci. Remote. Sens..

[13]  B. Alpert Wavelets and other bases for fast numerical linear algebra , 1993 .

[14]  David G. Long,et al.  A cloud-removal algorithm for SSM/I data , 1999, IEEE Trans. Geosci. Remote. Sens..

[15]  Rachid Deriche,et al.  Vector-valued image regularization with PDE's: a common framework for different applications , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[16]  Min Li,et al.  AUTOMATED PRODUCTION OF CLOUD-FREE AND CLOUD SHADOW-FREE IMAGE MOSAICS FROM CLOUDY SATELLITE IMAGERY , 2004 .

[17]  Farid Melgani,et al.  Contextual Spatiospectral Postreconstruction of Cloud-Contaminated Images , 2008, IEEE Geoscience and Remote Sensing Letters.

[18]  Stéphane Mallat,et al.  Bandelet Image Approximation and Compression , 2005, Multiscale Model. Simul..

[19]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[20]  Farid Melgani,et al.  Cloud-contaminated image reconstruction with contextual spatio-spectral information , 2007, 2007 IEEE International Geoscience and Remote Sensing Symposium.

[21]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, IEEE Trans. Image Process..