Ground-Based Cloud Detection Using Graph Model Built Upon Superpixels

Cloud detection plays an important role in climate models, climate predictions, and meteorological services. Although researchers have given increasing efforts on cloud detection, the performance is still unsatisfactory due to the diverse nature of clouds. Considering the fact that one source of information (color or texture) is not enough to segment cloud from clear sky, in this letter, we propose a novel ground-based cloud detection method using graph model (GM) built upon superpixels to integrate multiple sources of information. First, we use the superpixel segmentation to divide the image into a series of subregions according to the color similarity and spatial continuity. Next, adjacent superpixels are merged according to their similarity of extracted features. Finally, we build a GM on the merged superpixels by considering each superpixel as a node and adding edges between neighboring ones. The unary cost is set according to the classification score of Random Forests, while pairwise cost reflects the penalties for color and texture discontinuity between neighboring components. The final segmentation could be acquired by minimizing the cost function. Moreover, the algorithm is computationally efficient as we use the superpixels rather than raw pixels as computation units. Experimental results demonstrate the effectiveness and efficiency of the proposed method for cloud detection.

[1]  C. Long,et al.  Total Sky Imager Model 880 Status and Testing Results , 2001 .

[2]  J. Shaw,et al.  Short-Term Arctic Cloud Statistics at NSA from the Infrared Cloud Imager , 2003 .

[3]  Baihua Xiao,et al.  Ground-Based Cloud Detection Using Automatic Graph Cut , 2015, IEEE Geoscience and Remote Sensing Letters.

[4]  Chunheng Wang,et al.  Tensor Ensemble of Ground-Based Cloud Sequences: Its Modeling, Classification, and Synthesis , 2013, IEEE Geoscience and Remote Sensing Letters.

[5]  A Cazorla,et al.  Development of a sky imager for cloud cover assessment. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[6]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[7]  Enio Bueno Pereira,et al.  A Simple Method for the Assessment of the Cloud Cover State in High-Latitude Regions by a Ground-Based Digital Camera , 2006 .

[8]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[9]  Josep Calbó,et al.  Retrieving Cloud Characteristics from Ground-Based Daytime Color All-Sky Images , 2006 .

[10]  E. Pereira,et al.  The Use of Euclidean Geometric Distance on RGB Color Space for the Classification of Sky and Cloud Patterns , 2010 .

[11]  Andreas Macke,et al.  Estimation of the total cloud cover with high temporal resolution and parametrization of short-term fluctuations of sea surface insolation , 2008 .

[12]  Esa Rahtu,et al.  Generating Object Segmentation Proposals Using Global and Local Search , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Chunheng Wang,et al.  Automatic Cloud Detection for All-Sky Images Using Superpixel Segmentation , 2015, IEEE Geoscience and Remote Sensing Letters.

[14]  Janet Shields,et al.  Daylight visible/NIR whole-sky imagers for cloud and radiance monitoring in support of UV research programs , 2003, SPIE Optics + Photonics.

[15]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Mario Blumthaler,et al.  All-sky imaging: a simple, versatile system for atmospheric research. , 2009, Applied optics.

[17]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[18]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[19]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[20]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[22]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  A. Heinle,et al.  Automatic cloud classification of whole sky images , 2010 .