CloudNet: Ground‐Based Cloud Classification With Deep Convolutional Neural Network

Clouds have an enormous influence on the Earth's energy balance, climate, and weather. Cloud types have different cloud radiative effects, which is an essential indicator of the cloud effect on radiation. Therefore, identifying the cloud type is important in meteorology. In this letter, we propose a new convolutional neural network model, called CloudNet, for accurate ground‐based meteorological cloud classification. We build a ground‐based cloud data set, called Cirrus Cumulus Stratus Nimbus, which consists of 11 categories under meteorological standards. The total number of cloud images is three times that of the previous database. In particular, it is the first time that contrails, a type of cloud generated by human activity, have been taken into account in the ground‐based cloud classification, making the Cirrus Cumulus Stratus Nimbus data set more discriminative and comprehensive than existing ground‐based cloud databases. The evaluation of a large number of experiments demonstrates that the proposed CloudNet model could achieve good performance in meteorological cloud classification.

[1]  William B. Rossow,et al.  Radiative Effects of Cloud-Type Variations , 2000 .

[2]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[3]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Zhiguo Cao,et al.  DeepCloud: Ground-Based Cloud Image Categorization Using Deep Convolutional Features , 2017, IEEE Transactions on Geoscience and Remote Sensing.

[5]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[6]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Richard L. Bankert,et al.  Cloud Classification of AVHRR Imagery in Maritime Regions Using a Probabilistic Neural Network , 1994 .

[8]  Fabrizio Sebastiani,et al.  Machine learning in automated text categorization , 2001, CSUR.

[9]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[10]  G. Stephens.  Cloud Feedbacks in the Climate System: A Critical Review , 2005 .

[11]  P. Minnis,et al.  Estimation of 2006 Northern Hemisphere contrail coverage using MODIS data , 2013 .

[12]  Chunheng Wang,et al.  Deep Convolutional Activations-Based Features for Ground-Based Cloud Classification , 2017, IEEE Geoscience and Remote Sensing Letters.

[13]  Jinglin Zhang,et al.  Verification for Different Contrail Parameterizations Based on Integrated Satellite Observation and ECMWF Reanalysis Data , 2017 .

[14]  Shuang Liu,et al.  Learning group patterns for ground-based cloud classification in wireless sensor networks , 2016, EURASIP J. Wirel. Commun. Netw..

[15]  Mahmood R. Azimi-Sadjadi,et al.  A study of cloud classification with neural networks using spectral and textural features , 1999, IEEE Trans. Neural Networks.

[16]  Matti Pietikäinen,et al.  Gray Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2000, ECCV.

[17]  Kenneth A. Buch,et al.  Cloud classification using whole-sky imager data , 1995 .

[18]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Patrick Minnis,et al.  Contrails, Cirrus Trends, and Climate , 2004 .

[20]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Zhiguo Cao,et al.  Cloud Classification of Ground-Based Images Using Texture–Structure Features , 2014 .

[23]  C. Long,et al.  Total Sky Imager Model 880 Status and Testing Results , 2001 .

[24]  W. Rossow,et al.  ISCCP Cloud Data Products , 1991 .

[25]  Chun-tong Liu,et al.  Modeling and analyzing interference signal in a complex electromagnetic environment , 2016, EURASIP J. Wirel. Commun. Netw..

[26]  Ronald M. Welch,et al.  A neural network approach to cloud classification , 1990 .

[27]  Zhiguo Cao,et al.  mCLOUD: A Multiview Visual Feature Extraction Mechanism for Ground-Based Cloud Image Categorization , 2016 .

[28]  A. Heinle,et al.  Automatic cloud classification of whole sky images , 2010 .

[29]  Stefan Winkler,et al.  Categorization of cloud image patches using an improved texton-based approach , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[30]  Ewa Kwiatkowska,et al.  Neural network system for cloud classification from satellite images , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[31]  Sophia Ananiadou,et al.  Stochastic Gradient Descent Training for L1-regularized Log-linear Models with Cumulative Penalty , 2009, ACL.