Automatic Auroral Detection in Color All-Sky Camera Images

Every winter, the all-sky cameras (ASCs) in the MIRACLE network take images of the night sky at regular intervals of 10-20 s. This amounts to millions of images that not only need to be pruned, but there is also a need for efficient auroral activity detection techniques. In this paper, we describe a method for performing automated classification of ASC images into three mutually exclusive classes: aurora, no aurora, and cloudy. This not only reduces the amount of data to be processed, but also facilitates in building statistical models linking the magnetic fluctuations and auroral activity helping us to get a step closer to forecasting auroral activity. We experimented with different feature extraction techniques coupled with Support Vector Machines classification. Color variants of Scale Invariant Feature Transform (SIFT) features, specifically Opponent SIFT features, were found to perform better than other feature extraction techniques. With Opponent SIFT features, we were able to build a classification model with a cross-validation accuracy of 91%, which was further improved using temporal information and elimination of outliers which makes it accurate enough for operational data pruning purposes. Since the problem is essentially similar to scene detection, local point description features perform better than global- and texture-based feature descriptors.

[1]  Mikko T. Syrjäsuo,et al.  Numeric Image Features for Detection of Aurora , 2012, IEEE Geoscience and Remote Sensing Letters.

[2]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[3]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[4]  T. Pulkkinen,et al.  Observations of Substorm Electrodynamics Using the MIRACLE Network , 1998 .

[5]  Sebastiano B. Serpico,et al.  A Markov random field approach to spatio-temporal contextual image classification , 2003, IEEE Trans. Geosci. Remote. Sens..

[6]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[7]  Hai Tao,et al.  A novel feature descriptor invariant to complex brightness changes , 2009, CVPR.

[8]  Andrew Zisserman,et al.  Representing shape with a spatial pyramid kernel , 2007, CIVR '07.

[9]  M. Syrjäsuo,et al.  Using colour in auroral imaging , 2007 .

[10]  Mikko T. Syrjäsuo,et al.  Using Relevance Feedback in Retrieving Auroral Images , 2005, Computational Intelligence.

[11]  Koen E. A. van de Sande,et al.  Evaluating Color Descriptors for Object and Scene Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Peter Morguet,et al.  Feature extraction methods for consistent spatio-temporal image sequence classification using hidden Markov models , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  K. Kauristie,et al.  Performance study of the new EMCCD-based all-sky cameras for auroral imaging , 2011 .

[14]  Haihong Hu,et al.  Spatial texture based automatic classification of dayside aurora in all-sky images , 2010 .

[15]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[16]  Charles-Edmond Bichot,et al.  Color orthogonal local binary patterns combination for image region description ( Technical Report ) , 2011 .

[17]  Frédéric Jurie,et al.  Creating efficient codebooks for visual recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[18]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Eric F. Donovan,et al.  Low-cost multi-band ground-based imaging of the aurora , 2005, SPIE Optics + Photonics.

[20]  Ying Liu,et al.  A survey of content-based image retrieval with high-level semantics , 2007, Pattern Recognit..

[21]  M. Syrjäsuo,et al.  Analysis of Auroral Images: Detection and Tracking , 2002 .

[22]  Marcel Worring,et al.  Concept-Based Video Retrieval , 2009, Found. Trends Inf. Retr..