Deep Convolutional Activations-Based Features for Ground-Based Cloud Classification

Ground-based cloud classification is crucial for meteorological research and has received great concern in recent years. However, it is very challenging due to the extreme appearance variations under different atmospheric conditions. Although the convolutional neural networks have achieved remarkable performance in image classification, no one has evaluated their suitability for cloud classification. In this letter, we propose to use the deep convolutional activations-based features (DCAFs) for ground-based cloud classification. Considering the unique characteristic of cloud, we believe the local rich texture information might be more important than the global layout information and, thus, give a comprehensive evaluation of using both shallow convolutional layers-based features and DCAFs. Experimental results on two challenging public data sets demonstrate that although the realization of DCAF is quite straightforward without any use-dependent tricks, it outperforms conventional hand-crafted features considerably.

[1]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[2]  Kenneth A. Buch,et al.  Cloud classification using whole-sky imager data , 1995 .

[3]  C. Long,et al.  Total Sky Imager Model 880 Status and Testing Results , 2001 .

[4]  Janet Shields,et al.  Daylight visible/NIR whole-sky imagers for cloud and radiance monitoring in support of UV research programs , 2003, SPIE Optics + Photonics.

[5]  J. Shaw,et al.  Short-Term Arctic Cloud Statistics at NSA from the Infrared Cloud Imager , 2003 .

[6]  Luc Van Gool,et al.  Maximum Response Filters for Texture Analysis , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[7]  D. Sagi,et al.  Gabor filters as texture discriminator , 1989, Biological Cybernetics.

[8]  Maneesha Singh,et al.  Automated ground-based cloud recognition , 2005, Pattern Analysis and Applications.

[9]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[10]  Lian Jin-gen Whole sky infrared cloud measuring system based on the uncooled infrared focal plane array , 2008 .

[11]  A Cazorla,et al.  Development of a sky imager for cloud cover assessment. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[12]  Josep Calbó,et al.  Feature Extraction from Whole-Sky Ground-Based Images for Cloud-Type Recognition , 2008 .

[13]  Zhao Shi-jun Classification of Whole Sky Infrared Cloud Image Based on the LBP Operator , 2009 .

[14]  A. Heinle,et al.  Automatic cloud classification of whole sky images , 2010 .

[15]  Lei Liu,et al.  Cloud Classification Based on Structure Features of Infrared Images , 2011 .

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  Chunheng Wang,et al.  Tensor Ensemble of Ground-Based Cloud Sequences: Its Modeling, Classification, and Synthesis , 2013, IEEE Geoscience and Remote Sensing Letters.

[18]  Yunxue Shao,et al.  Salient local binary pattern for ground-based cloud classification , 2013, Acta Meteorologica Sinica.

[19]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[20]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Stefan Winkler,et al.  WAHRSIS: A low-cost high-resolution whole sky imager with near-infrared capabilities , 2014, Defense + Security Symposium.

[22]  Lei Guo,et al.  Object Detection in Optical Remote Sensing Images Based on Weakly Supervised Learning and High-Level Feature Learning , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[23]  Lei Guo,et al.  Effective and Efficient Midlevel Visual Elements-Oriented Land-Use Classification Using VHR Remote Sensing Images , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[25]  Stefan Winkler,et al.  Categorization of cloud image patches using an improved texton-based approach , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[26]  Xueming Qian,et al.  Semantic Annotation of High-Resolution Satellite Images via Weakly Supervised Learning , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[27]  Junwei Han,et al.  Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images , 2016, IEEE Transactions on Geoscience and Remote Sensing.

[28]  Paul F. Whelan,et al.  Using filter banks in Convolutional Neural Networks for texture classification , 2016, Pattern Recognit. Lett..