UVI Image Segmentation of Auroral Oval: Dual Level Set and Convolutional Neural Network Based Approach

The auroral ovals around the Earth’s magnetic poles are produced by the collisions between energetic particles precipitating from solar wind and atoms or molecules in the upper atmosphere. The morphology of auroral oval acts as an important mirror reflecting the solar wind-magnetosphere-ionosphere coupling process and its intrinsic mechanism. However, the classical level set based segmentation methods often fail to extract an accurate auroral oval from the ultraviolet imager (UVI) image with intensity inhomogeneity. The existing methods designed specifically for auroral oval extraction are extremely sensitive to the contour initializations. In this paper, a novel deep feature-based adaptive level set model (DFALS) is proposed to tackle these issues. First, we extract the deep feature from the UVI image with the newly designed convolutional neural network (CNN). Second, with the deep feature, the global energy term and the adaptive time-step are constructed and incorporated into the local information based dual level set auroral oval segmentation method (LIDLSM). Third, we extract the contour of the auroral oval through the minimization of the proposed energy functional. The experiments on the UVI image data set validate the strong robustness of DFALS to different contour initializations. In addition, with the help of deep feature-based global energy term, the proposed method also obtains higher segmentation accuracy in comparison with the state-of-the-art level set based methods.

[1]  Jongyoo Kim,et al.  Deep CNN-Based Blind Image Quality Predictor , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Jeong-Hwan Kim,et al.  Deep learning for multi-year ENSO forecasts , 2019, Nature.

[3]  Hannes Nickisch,et al.  Automatic Classification of Auroral Images From the Oslo Auroral THEMIS (OATH) Data Set Using Machine Learning , 2018, Journal of Geophysical Research: Space Physics.

[4]  Xinbo Gao,et al.  A shape-initialized and intensity-adaptive level set method for auroral oval segmentation , 2014, Inf. Sci..

[5]  Qiang Chen,et al.  Robust noise region-based active contour model via local similarity factor for image segmentation , 2017, Pattern Recognit..

[6]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[7]  Ernesto Damiani,et al.  An interval type-2 fuzzy active contour model for auroral oval segmentation , 2017, Soft Comput..

[8]  Syun-Ichi Akasofu,et al.  Dynamic morphology of auroras , 1965 .

[9]  Timothy S. Newman,et al.  New shape-based auroral oval segmentation driven by LLS-RHT , 2009, Pattern Recognit..

[10]  Lin Sun,et al.  An Image Segmentation Method Using an Active Contour Model Based on Improved SPF and LIF , 2018, Applied Sciences.

[11]  Lei Zhang,et al.  Active contours driven by local image fitting energy , 2010, Pattern Recognit..

[12]  James M. Weygand,et al.  Size of the auroral oval: UV ovals and precipitation boundaries compared , 1999 .

[13]  Zeming Zhou,et al.  Auroral oval segmentation using dual level set based on local information , 2017 .

[14]  Z. Sheng,et al.  Determination of the “Wave Turbopause” Using a Numerical Differentiation Method , 2019, Journal of Geophysical Research: Atmospheres.

[15]  Tomasz Kryjak,et al.  FPGA Implementation of Multi-scale Face Detection Using HOG Features and SVM Classifier , 2016 .

[16]  James F. Carbary,et al.  Auroral boundary correlations between UVI and DMSP , 2003 .

[17]  David G. Sibeck,et al.  Observation of IMF and seasonal effects in the location of auroral substorm onset , 2001 .

[18]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[19]  Lin Sun,et al.  An Image Segmentation Method Based on Improved Regularized Level Set Model , 2018, Applied Sciences.

[20]  Lei Zhang,et al.  Active contours with selective local or global segmentation: A new formulation and level set method , 2010, Image Vis. Comput..

[21]  W. J. Burke,et al.  DMSP/F2 electron observations of equatorward auroral boundaries and their relationship to the solar wind velocity and the north‐south component of the interplanetary magnetic field , 1981 .

[22]  Hu Zejun,et al.  Extraction of auroral oval boundaries from UVI images: A new FLICM clustering-based method and its evaluation , 2011 .

[23]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[24]  Jimin Liang,et al.  Variation and modeling of ultraviolet auroral oval boundaries associated with interplanetary and geomagnetic parameters , 2017 .

[25]  Zeming Zhou,et al.  A prior shape-based level-set method for auroral oval segmentation , 2018, Remote Sensing Letters.

[26]  James F. Spann,et al.  Auroral observations by the polar Ultraviolet Imager (UVI) , 1997 .

[27]  A. Boudouridis,et al.  Effect of solar wind pressure pulses on the size and strength of the auroral oval , 2003 .

[28]  J. Vierinen,et al.  The 3‐D Distribution of Artificial Aurora Induced by HF Radio Waves in the Ionosphere , 2018, Journal of Geophysical Research: Space Physics.

[29]  Shie Mannor,et al.  A Tutorial on the Cross-Entropy Method , 2005, Ann. Oper. Res..

[30]  Dacheng Tao,et al.  Extracting Auroral Key Local Structures From All‐Sky Auroral Images by Artificial Intelligence Technique , 2019, Journal of Geophysical Research: Space Physics.

[31]  Bo Chen,et al.  A new auroral boundary determination algorithm based on observations from TIMED/GUVI and DMSP/SSUSI , 2017 .

[32]  A. Boudouridis,et al.  Enhanced solar wind geoeffectiveness after a sudden increase in dynamic pressure during southward IMF orientation , 2005 .