A convolutional neural network for classifying cloud particles recorded by imaging probes

Abstract. During typical field campaigns, millions of cloud particle images are captured with imaging probes. Our interest lies in classifying these particles in order to compute the statistics needed for understanding clouds. Given the large volume of collected data, this raises the need for an automated classification approach. Traditional classification methods that require extracting features manually (e.g., decision trees and support vector machines) show reasonable performance when trained and tested on data coming from a unique dataset. However, they often have difficulties in generalizing to test sets coming from other datasets where the distribution of the features might be significantly different. In practice, we found that for holographic imagers each new dataset requires labeling a huge amount of data by hand using those methods. Convolutional neural networks have the potential to overcome this problem due to their ability to learn complex nonlinear models directly from the images instead of pre-engineered features, as well as by relying on powerful regularization techniques. We show empirically that a convolutional neural network trained on cloud particles from holographic imagers generalizes well to unseen datasets. Moreover, fine tuning the same network with a small number (256) of training images improves the classification accuracy. Thus, the automated classification with a convolutional neural network not only reduces the hand-labeling effort for new datasets but is also no longer the main error source for the classification of small particles.

[1]  M. Wendisch,et al.  Mixed-Phase Clouds: Progress and Challenges , 2017 .

[2]  G. McFarquhar,et al.  Cloud Ice Properties: In Situ Measurement Challenges , 2017 .

[3]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  A. Beck Observing the Microstructure of Orographic Clouds with HoloGondel , 2017 .

[5]  P. Brown,et al.  Airborne observations of the microphysical structure of two contrasting cirrus clouds , 2016 .

[6]  T. Choularton,et al.  Microphysical sensitivity of coupled springtime Arctic stratocumulus to modelled primary ice over the ice pack, marginal ice, and ocean , 2016 .

[7]  U. Lohmann,et al.  HoloGondel: in situ cloud observations on a cable car in the Swiss Alps using a holographic imager , 2016 .

[8]  Edwin Hirst,et al.  PHIPS-HALO: the airborne Particle Habit Imaging and Polar Scattering probe - Part 1: Design and operation , 2016 .

[9]  T. Storelvmo,et al.  On the relationships among cloud cover, mixed‐phase partitioning, and planetary albedo in GCMs , 2016 .

[10]  W. Rühm,et al.  Snow event classification with a 2D video disdrometer — A decision tree approach , 2016 .

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Johannes Quaas,et al.  Frequency of occurrence of rain from liquid‐, mixed‐, and ice‐phase clouds derived from A‐Train satellite retrievals , 2015 .

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[15]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[16]  Devis Tuia,et al.  Hydrometeor classification from two-dimensional video disdrometer data , 2014 .

[17]  Jacob P. Fugal,et al.  HOLIMO II: a digital holographic instrument for ground-based in situ observations of microphysical properties of mixed-phase clouds , 2013 .

[18]  C. Bretherton,et al.  Clouds and Aerosols , 2013 .

[19]  M. Gallagher,et al.  The backscatter cloud probe – a compact low-profile autonomous optical spectrometer , 2013 .

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Timo Nousiainen,et al.  Ice‐cloud particle habit classification using principal components , 2012 .

[22]  T. Leisner,et al.  First correlated measurements of the shape and light scattering properties of cloud particles using the new Particle Habit Imaging and Polar Scattering (PHIPS) probe , 2011 .

[23]  Observations of ice multiplication in a weakly convective cell embedded in supercooled mid-level stratus , 2010 .

[24]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[25]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[26]  P. Kaye,et al.  The Ability of the Small Ice Detector (SID-2) to Characterize Cloud Particle and Aerosol Morphologies Obtained during Flights of the FAAM BAe-146 Research Aircraft , 2010 .

[27]  Jacob P. Fugal,et al.  Practical methods for automated reconstruction and characterization of particles in digital in-line holograms , 2009 .

[28]  Jacob P. Fugal,et al.  Cloud particle size distributions measured with an airborne digital in-line holographic instrument , 2009 .

[29]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[30]  A. Korolev,et al.  Phase transformation of mixed‐phase clouds , 2003 .

[31]  Olivia Freeman,et al.  Talking points personal outcomes approach: practical guide. , 2012 .

[32]  Brad Baker,et al.  An overview of microphysical properties of Arctic clouds observed in May and July 1998 during FIRE ACE , 2001 .

[33]  H. Jonsson,et al.  The cloud, aerosol and precipitation spectrometer: a new instrument for cloud investigations , 2001 .

[34]  A. Korolev,et al.  A Technique for Habit Classification of Cloud Particles , 2000 .

[35]  Mohammad Bagher Menhaj,et al.  Training feedforward networks with the Marquardt algorithm , 1994, IEEE Trans. Neural Networks.

[36]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[37]  Y. T. Zhou,et al.  Computation of optical flow using a neural network , 1988, IEEE 1988 International Conference on Neural Networks.

[38]  D. W. Scott On optimal and data based histograms , 1979 .