Instance Segmentation of Auroral Images for Automatic Computation of Arc Width

The width of auroral arc is one of the most important factors in understanding and examining its physical mechanisms. In this letter, we propose a fully automatic method for computing the width of auroral arcs based on the instance segmentation of auroral images. To accurately detect and segment auroral arcs with oriented bounding boxes, we adapt a state-of-the-art instance segmentation model, Mask region-based convolutional neural network, by designing a two-stage inference process combined with an indispensable random rotation training strategy and designing an effective feature extraction architecture. Given the segmented masks of individual auroral arcs, we present a method for computing the arc width automatically. In our experiments, the instance segmentation model achieves 86.8% of mean average precision on the human-labeled data set. By automatically evaluating the width of 29 938 detected auroral arcs in 18 417 auroral arc images, we obtain a similar arc width distribution to that evaluated by the semiautomatic approach, which demonstrates the effectiveness of our proposed method.

[1]  Quanming Lu,et al.  Widths of dayside auroral arcs observed at the Chinese Yellow River Station , 2013 .

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  L. Cogger,et al.  Width and structure of mesoscale optical auroral arcs , 2001 .

[4]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[5]  H.-Q. Hu,et al.  Throat aurora: The ionospheric signature of magnetosheath particles penetrating into the magnetosphere , 2016 .

[6]  Shu Liu,et al.  Path Aggregation Network for Instance Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Mikko T. Syrjäsuo,et al.  Numeric Image Features for Detection of Aurora , 2012, IEEE Geoscience and Remote Sensing Letters.

[8]  Joseph E. Borovsky,et al.  Auroral arc thicknesses as predicted by various theories , 1993 .

[9]  Haihong Hu,et al.  Spatial texture based automatic classification of dayside aurora in all-sky images , 2010 .

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Quanming Lu,et al.  Orientation variation of dayside auroral arc alignments obtained from all-sky observation at yellow river station, Svalbard , 2016 .

[12]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[14]  T. Davis,et al.  Observed characteristics of auroral forms , 1978 .

[15]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Qian Wang,et al.  Weakly Supervised Semantic Segmentation for Joint Key Local Structure Localization and Classification of Aurora Image , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[17]  Y. Feldstein,et al.  Aurorae and the Large-Scale Structure of the Magnetosphere , 1992 .

[18]  Jimin Liang,et al.  Synoptic distribution of dayside aurora: Multiple-wavelength all-sky observation at Yellow River Station in Ny-Alesund, Svalbard , 2009 .

[19]  Lars Blomberg,et al.  Solar wind dependence of the occurrence and motion of polar auroral arcs : A statistical study , 2002 .

[20]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Xuelong Li,et al.  Aurora image segmentation by combining patch and texture thresholding , 2011, Comput. Vis. Image Underst..

[22]  Qi Tian,et al.  Polar Embedding for Aurora Image Retrieval , 2015, IEEE Transactions on Image Processing.