Color-Based Segmentation of Sky/Cloud Images From Ground-Based Cameras

Sky/cloud images captured by ground-based cameras (a.k.a. whole sky imagers) are increasingly used nowadays because of their applications in a number of fields, including climate modeling, weather prediction, renewable energy generation, and satellite communications. Due to the wide variety of cloud types and lighting conditions in such images, accurate and robust segmentation of clouds is challenging. In this paper, we present a supervised segmentation framework for ground-based sky/cloud images based on a systematic analysis of different color spaces and components, using partial least-squares regression. Unlike other state-of-the-art methods, our proposed approach is entirely learning based and does not require any manually defined parameters. In addition, we release the Singapore whole Sky imaging segmentation database, a large database of annotated sky/cloud images, to the research community.

[1]  Jun Yang,et al.  A Hybrid Thresholding Algorithm for Cloud Detection on Ground-Based Color Images , 2011 .

[2]  Yee Hui Lee,et al.  Comparison of radio-sounding profiles for cloud attenuation analysis in the tropical region , 2014, 2014 IEEE Antennas and Propagation Society International Symposium (APSURSI).

[3]  Enio Bueno Pereira,et al.  A Simple Method for the Assessment of the Cloud Cover State in High-Latitude Regions by a Ground-Based Digital Camera , 2006 .

[4]  Sundar A. Christopher,et al.  Automatic contrail detection and segmentation , 1998, IEEE Trans. Geosci. Remote. Sens..

[5]  E. Pereira,et al.  The Use of Euclidean Geometric Distance on RGB Color Space for the Classification of Sky and Cloud Patterns , 2010 .

[6]  S. D. Jong.  SIMPLS: an alternative approach to partial least squares regression , 1993 .

[7]  Silas C. Michaelides,et al.  Multifeature texture analysis for the classification of clouds in satellite imagery , 2003, IEEE Trans. Geosci. Remote. Sens..

[8]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Qing Zhang,et al.  Cloud Detection of RGB Color Aerial Photographs by Progressive Refinement Scheme , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[11]  Josep Calbó,et al.  Retrieving Cloud Characteristics from Ground-Based Daytime Color All-Sky Images , 2006 .

[12]  Stefan Winkler,et al.  WAHRSIS: A low-cost high-resolution whole sky imager with near-infrared capabilities , 2014, Defense + Security Symposium.

[13]  Yanming Chen,et al.  Multiscale Grid Method for Detection and Reconstruction of Building Roofs from Airborne LiDAR Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[14]  Josep Calbó,et al.  Feature Extraction from Whole-Sky Ground-Based Images for Cloud-Type Recognition , 2008 .

[15]  Nicolas H. Younan,et al.  On the Use of a Cluster Ensemble Cloud Classification Technique in Satellite Precipitation Estimation , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[16]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Guy Rochard,et al.  Unsupervised segmentation of low clouds from infrared METEOSAT images based on a contextual spatio-temporal labeling approach , 2002, IEEE Trans. Geosci. Remote. Sens..

[18]  Anil K. Jain,et al.  A wrapper-based approach to image segmentation and classification , 2004, IEEE Transactions on Image Processing.

[19]  Hiroshi Mamitsuka,et al.  Selecting features in microarray classification using ROC curves , 2006, Pattern Recognit..

[20]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[21]  A. Heinle,et al.  Automatic cloud classification of whole sky images , 2010 .

[22]  Baihua Xiao,et al.  Ground-Based Cloud Detection Using Automatic Graph Cut , 2015, IEEE Geoscience and Remote Sensing Letters.

[23]  Xiangyun Hu,et al.  Bag-of-Words and Object-Based Classification for Cloud Extraction From Satellite Imagery , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[24]  Stefan Winkler,et al.  Systematic study of color spaces and components for the segmentation of sky/cloud images , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[25]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[26]  Muhammad Tariq Mahmood,et al.  Robust Registration of Cloudy Satellite Images Using Two-Step Segmentation , 2015, IEEE Geoscience and Remote Sensing Letters.

[27]  Steven A. Shafer,et al.  Anatomy of a color histogram , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  Stefan Winkler,et al.  Multi-level semantic labeling of Sky/cloud images , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[29]  Chunheng Wang,et al.  Automatic Cloud Detection for All-Sky Images Using Superpixel Segmentation , 2015, IEEE Geoscience and Remote Sensing Letters.

[30]  Manabu Watanabe,et al.  Comparative Assessment of Supervised Classifiers for Land Use–Land Cover Classification in a Tropical Region Using Time-Series PALSAR Mosaic Data , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[31]  R. Manne.  Analysis of two partial-least-squares algorithms for multivariate calibration , 1987 .

[32]  Stefan Winkler,et al.  Cloud base height estimation using high-resolution whole sky imagers , 2015, 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[33]  Cordelia Schmid,et al.  Constructing models for content-based image retrieval , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[34]  Yee Hui Lee,et al.  Comparison of cloud models for propagation studies in Ka-band satellite applications , 2014, 2014 International Symposium on Antennas and Propagation Conference Proceedings.