Multi-level semantic labeling of Sky/cloud images

Sky/cloud images captured by ground-based Whole Sky Imagers (WSIs) are extensively used now-a-days for various applications. In this paper, we learn the semantics of sky/cloud images, which allows an automatic annotation of pixels with different class labels. We model the various labels/classes with a continuous-valued multi-variate distribution. Using a set of training images, the distributions for different labels are learnt, and subsequently used for labeling test images. We also present a method to determine the number of clusters. Our proposed approach is the first for multi-class sky-cloud image annotation and achieves very good results.

[1]  Jun Yang,et al.  A Hybrid Thresholding Algorithm for Cloud Detection on Ground-Based Color Images , 2011 .

[2]  Yee Hui Lee,et al.  Performance of Site Diversity Investigated Through RADAR Derived Results , 2011, IEEE Transactions on Antennas and Propagation.

[3]  Zhu Yao-qin,et al.  Estimating the Image Segmentation Number via the Entropy Gap Statistic , 2009, 2009 Second International Conference on Information and Computing Science.

[4]  Enio Bueno Pereira,et al.  A Simple Method for the Assessment of the Cloud Cover State in High-Latitude Regions by a Ground-Based Digital Camera , 2006 .

[5]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  Josep Calbó,et al.  Retrieving Cloud Characteristics from Ground-Based Daytime Color All-Sky Images , 2006 .

[7]  Y. Mori,et al.  Image-to-word transformation based on dividing and vector quantizing images with words , 1999 .

[8]  Stefan Winkler,et al.  Systematic study of color spaces and components for the segmentation of sky/cloud images , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[9]  E. Pereira,et al.  The Use of Euclidean Geometric Distance on RGB Color Space for the Classification of Sky and Cloud Patterns , 2010 .

[10]  Stefan Winkler,et al.  WAHRSIS: A low-cost high-resolution whole sky imager with near-infrared capabilities , 2014, Defense + Security Symposium.

[11]  Nando de Freitas,et al.  A Statistical Model for General Contextual Object Recognition , 2004, ECCV.

[12]  Stefan Winkler,et al.  Categorization of cloud image patches using an improved texton-based approach , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[13]  Tang Liangrui,et al.  Image Edge Detecting Based on Gap Statistic Model and Relative Entropy , 2009, 2009 Sixth International Conference on Fuzzy Systems and Knowledge Discovery.

[14]  David A. Forsyth,et al.  Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary , 2002, ECCV.

[15]  Yee Hui Lee,et al.  Comparison of radio-sounding profiles for cloud attenuation analysis in the tropical region , 2014, 2014 IEEE Antennas and Propagation Society International Symposium (APSURSI).