Simultaneous Detection and Removal of High Altitude Clouds from an Image

Interestingly, shape of the high-altitude clouds serves as a beacon for weather forecasting, so its detection is of vital importance. Besides these clouds often cause hindrance in an endeavor of satellites to inspect our world. Even thin clouds produce the undesired superposition of visual information, whose decomposition into the clear background and cloudy layer using a single satellite image is a highly ill-posed problem. In this work, we derive sophisticated image priors by thoroughly analyzing the properties of high-altitude clouds and geological images; and formulate a non-convex optimization scheme, which simultaneously detects and removes the clouds within a few seconds. Experimental results on real world RGB images demonstrate that the proposed method outperforms the other competitive methods by retaining the comprehensive background details and producing the precise shape of the cloudy layer.

[1]  E. Candes,et al.  11-magic : Recovery of sparse signals via convex programming , 2005 .

[2]  Mila Nikolova,et al.  Analysis of Half-Quadratic Minimization Methods for Signal and Image Recovery , 2005, SIAM J. Sci. Comput..

[3]  Emmanuel J. Candès,et al.  NESTA: A Fast and Accurate First-Order Method for Sparse Recovery , 2009, SIAM J. Imaging Sci..

[4]  Xiaochun Cao,et al.  Single Image Dehazing via Multi-scale Convolutional Neural Networks , 2016, ECCV.

[5]  Edward H. Adelson,et al.  Recovering intrinsic images from a single image , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Huifang Li,et al.  An effective thin cloud removal procedure for visible remote sensing images , 2014 .

[7]  Wataru Takeuchi,et al.  Restoration of Aqua MODIS Band 6 Using Histogram Matching and Local Least Squares Fitting , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[8]  Hongliang Fang,et al.  Atmospheric correction of Landsat ETM+ land surface imagery: Part I: Methods , 2001 .

[9]  Yinqi Xiong Algorithm of Removing Thin Cloud-fog Cover from Single Remote Sensing Image , 2014 .

[10]  Thomas F. Coleman,et al.  An Interior Trust Region Approach for Nonlinear Minimization Subject to Bounds , 1993, SIAM J. Optim..

[11]  Chun-Liang Chien,et al.  Automatic cloud removal from multi-temporal SPOT images , 2008, Appl. Math. Comput..

[12]  Sylvie Le Hégarat-Mascle,et al.  Use of Markov Random Fields for automatic cloud/shadow detection on high resolution optical images , 2009 .

[13]  Gary A. Shaw,et al.  Spectral Imaging for Remote Sensing , 2003 .

[14]  James Zijun Wang,et al.  Thin Cloud Detection of All-Sky Images Using Markov Random Fields , 2012, IEEE Geoscience and Remote Sensing Letters.

[15]  E. Pereira,et al.  The Use of Euclidean Geometric Distance on RGB Color Space for the Classification of Sky and Cloud Patterns , 2010 .

[16]  J. Kristjánsson,et al.  Condensation and Cloud Parameterization Studies with a Mesoscale Numerical Weather Prediction Model , 1989 .

[17]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[18]  W. Verhoef,et al.  Reconstructing cloudfree NDVI composites using Fourier analysis of time series , 2000 .

[19]  D. Geman,et al.  Nonlinear Image Recovery with , 1995 .

[20]  Wen Gao,et al.  Group-Based Sparse Representation for Image Restoration , 2014, IEEE Transactions on Image Processing.

[21]  Fen Chen,et al.  Haze Detection and Removal in Remote Sensing Images Based on Undecimated Wavelet Transform , 2007 .

[22]  Jian Sun,et al.  Statistics of Patch Offsets for Image Completion , 2012, ECCV.

[23]  Ke Yan,et al.  A new cloud removal algorithm for multi-spectral images , 2005, International Symposium on Multispectral Image Processing and Pattern Recognition.

[24]  E. Helmer,et al.  Cloud-Free Satellite Image Mosaics with Regression Trees and Histogram Matching. , 2005 .

[25]  Farid Melgani,et al.  Inpainting Strategies for Reconstruction of Missing Data in VHR Images , 2011, IEEE Geoscience and Remote Sensing Letters.

[26]  Qing Zhang,et al.  Cloud Detection of RGB Color Aerial Photographs by Progressive Refinement Scheme , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Chao-Hung Lin,et al.  Cloud Removal From Multitemporal Satellite Images Using Information Cloning , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[28]  K. Liou Influence of Cirrus Clouds on Weather and Climate Processes: A Global Perspective , 1986 .

[29]  Sudhish N. George,et al.  Reconstruction of cloud-contaminated satellite remote sensing images using kernel PCA-based image modelling , 2016, Arabian Journal of Geosciences.

[30]  Freek D. van der Meer,et al.  Remote-sensing image analysis and geostatistics , 2012 .

[31]  David McWilliams Ludlum National Audubon Society Field Guide to North American Weather , 1991 .

[32]  Patrick L. Combettes,et al.  Image restoration subject to a total variation constraint , 2004, IEEE Transactions on Image Processing.

[33]  Jean-Philippe Tarel,et al.  Fast visibility restoration from a single color or gray level image , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[34]  J. Cihlar,et al.  An image transform to characterize and compensate for spatial variations in thin cloud contamination of Landsat images , 2002 .

[35]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[36]  Jiali Shao,et al.  A thin cloud removal method from remote sensing image for water body identification , 2013, Chinese Geographical Science.

[37]  Yair Weiss,et al.  Deriving intrinsic images from image sequences , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[38]  Chao Zeng,et al.  Recovering missing pixels for Landsat ETM + SLC-off imagery using multi-temporal regression analysis and a regularization method , 2013 .

[39]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[40]  Salvador Gabarda,et al.  Cloud covering denoising through image fusion , 2007, Image Vis. Comput..

[41]  Mohinder Malhotra Single Image Haze Removal Using Dark Channel Prior , 2016 .

[42]  Christine Fernandez-Maloigne,et al.  A Bandelet-Based Inpainting Technique for Clouds Removal From Remotely Sensed Images , 2009, IEEE Transactions on Geoscience and Remote Sensing.

[43]  O. R. Mitchell,et al.  Filtering to remove cloud cover in satellite imagery , 1977, IEEE Transactions on Geoscience Electronics.

[44]  Wei Tang,et al.  Single Remote Sensing Image Dehazing , 2014, IEEE Geoscience and Remote Sensing Letters.

[45]  Richard A. Frey,et al.  Cloud Detection with MODIS. Part I: Improvements in the MODIS Cloud Mask for Collection 5 , 2008 .

[46]  Min Chen,et al.  Thin cloud removal from single satellite images. , 2014, Optics express.

[47]  Farid Melgani,et al.  Contextual reconstruction of cloud-contaminated multitemporal multispectral images , 2006, IEEE Transactions on Geoscience and Remote Sensing.

[48]  Marin Ferecatu,et al.  Interactive Remote-Sensing Image Retrieval Using Active Relevance Feedback , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[49]  Feng Gao,et al.  A Modified Neighborhood Similar Pixel Interpolator Approach for Removing Thick Clouds in Landsat Images , 2012, IEEE Geoscience and Remote Sensing Letters.

[50]  Shai Avidan,et al.  Non-local Image Dehazing , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  Mingzhu Wan,et al.  Removing thin cloud on single remote sensing image based on SWF , 2016, 2016 IEEE International Conference of Online Analysis and Computing Science (ICOACS).

[52]  David I. Eggenberger,et al.  McGraw-Hill Yearbook of Science and Technology , 1963 .

[53]  Bin Wang,et al.  Automated Detection and Removal of Clouds and Their Shadows from Landsat TM Images , 1999 .

[54]  Gustavo Camps-Valls,et al.  Semi-Supervised Graph-Based Hyperspectral Image Classification , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[55]  D. Roy,et al.  The availability of cloud-free Landsat ETM+ data over the conterminous United States and globally , 2008 .

[56]  P. Lee,et al.  Homomorphic Filtering of colour images using a Spatial Filter Kernel in the HSI colour space , 2008, 2008 IEEE Instrumentation and Measurement Technology Conference.

[57]  Josef Cihlar,et al.  Detection and removal of cloud contamination from AVHRR images , 1994, IEEE Trans. Geosci. Remote. Sens..

[58]  G. Tselioudis,et al.  Evaluation of midlatitude cloud properties in a weather and a climate model: Dependence on dynamic regime and spatial resolution , 2002 .

[59]  Rob Fergus,et al.  Fast Image Deconvolution using Hyper-Laplacian Priors , 2009, NIPS.

[60]  Cirrus Cloud Properties and the Large-Scale Meteorological Environment: Relationships Derived from A-Train and NCEP–NCAR Reanalysis Data , 2013 .

[61]  Soo Chin Liew,et al.  Generating "Cloud free" and "Cloud-Shadow free" mosaic for SPOT panchromatic images , 2002, IEEE International Geoscience and Remote Sensing Symposium.

[62]  Iain Brown,et al.  Spatio-temporal MODIS EVI gap filling under cloud cover: An example in Scotland , 2012 .

[63]  Andy M. Yip,et al.  Recent Developments in Total Variation Image Restoration , 2004 .

[64]  R. Saunders,et al.  An improved method for detecting clear sky and cloudy radiances from AVHRR data , 1988 .

[65]  Hongliang Fang,et al.  Atmospheric correction of Landsat ETM+ land surface imagery. I. Methods , 2001, IEEE Trans. Geosci. Remote. Sens..

[66]  Arnt-Børre Salberg,et al.  Land Cover Classification of Cloud-Contaminated Multitemporal High-Resolution Images , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[67]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[68]  Feng Gao,et al.  A simple and effective method for filling gaps in Landsat ETM+ SLC-off images , 2011 .

[69]  Jean-Philippe Tarel,et al.  Vision Enhancement in Homogeneous and Heterogeneous Fog , 2012, IEEE Intelligent Transportation Systems Magazine.

[70]  L. Radke,et al.  A Summary of the Physical Properties of Cirrus Clouds , 1990 .

[71]  Jennifer L. Dungan,et al.  Kriging in the shadows: Geostatistical interpolation for remote sensing , 1994 .

[72]  Anat Levin,et al.  User Assisted Separation of Reflections from a Single Image Using a Sparsity Prior , 2004, ECCV.

[73]  Enio Bueno Pereira,et al.  A Simple Method for the Assessment of the Cloud Cover State in High-Latitude Regions by a Ground-Based Digital Camera , 2006 .