The automated prediction of solar flares from SDO images using deep learning

Abstract In the last few years, there has been growing interest in near-real-time solar data processing, especially for space weather applications. This is due to space weather impacts on both space-borne and ground-based systems, and industries, which subsequently impacts our lives. In the current study, the deep learning approach is used to establish an automated hybrid computer system for a short-term forecast; it is achieved by using the complexity level of the sunspot group on SDO/HMI Intensitygram images. Furthermore, this suggested system can generate the forecast for solar flare occurrences within the following 24 hours. The input data for the proposed system are SDO/HMI full-disk Intensitygram images and SDO/HMI full-disk magnetogram images. System outputs are the “Flare or Non-Flare” of daily flare occurrences (C, M, and X classes). This system integrates an image processing system to automatically detect sunspot groups on SDO/HMI Intensitygram images using active-region data extracted from SDO/HMI magnetogram images (presented by ( Colak and Qahwaji, 2008 )) and deep learning to generate these forecasts. Our deep learning-based system is designed to analyze sunspot groups on the solar disk to predict whether this sunspot group is capable of releasing a significant flare or not. Our system introduced in this work is called ASAP_Deep. The deep learning model used in our system is based on the integration of the Convolutional Neural Network (CNN) and Softmax classifier to extract special features from the sunspot group images detected from SDO/HMI (Intensitygram and magnetogram) images. Furthermore, a CNN training scheme based on the integration of a back-propagation algorithm and a mini-batch AdaGrad optimization method is suggested for weight updates and to modify learning rates, respectively. The images of the sunspot regions are cropped automatically by the imaging system and processed using deep learning rules to provide near real-time predictions. The major results of this study are as follows. Firstly, the ASAP_Deep system builds on the ASAP system introduced in ( Colak and Qahwaji, 2009 ) but improves the system with an updated deep learning-based prediction capability. Secondly, we successfully apply CNN to the sunspot group image without any pre-processing or feature extraction. Thirdly, our system results are considerably better, especially for the false alarm ratio (FAR); this reduces the losses resulting from the protection measures applied by companies. Also, the proposed system achieves a relatively high scores for True Skill Statistics (TSS) and Heidke Skill Score (HSS).

[1]  Y. Moon,et al.  PREDICTION OF DAILY MAXIMUM X-RAY FLUX USING MULTILINEAR REGRESSION AND AUTOREGRESSIVE TIME-SERIES METHODS , 2007 .

[2]  Rafal A. Angryk,et al.  Challenges with Extreme Class-Imbalance and Temporal Coherence: A Study on Solar Flare Data , 2019, 2019 IEEE International Conference on Big Data (Big Data).

[3]  Rami Qahwaji,et al.  Automated Solar Activity Prediction: A hybrid computer platform using machine learning and solar imaging for automated prediction of solar flares , 2009 .

[4]  Huaning Wang,et al.  Influences of misprediction costs on solar flare prediction , 2012 .

[5]  Rami Qahwaji,et al.  Solar Flare Prediction Using Advanced Feature Extraction, Machine Learning, and Feature Selection , 2011, Solar Physics.

[6]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[7]  Haimin Wang,et al.  Active-Region Monitoring and Flare Forecasting – I. Data Processing and First Results , 2002 .

[8]  A. F. Barghouty,et al.  A tool for empirical forecasting of major flares, coronal mass ejections, and solar particle events from a proxy of active‐region free magnetic energy , 2011 .

[9]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[10]  Fuh-Gwo Yuan,et al.  Impact diagnosis in stiffened structural panels using a deep learning approach , 2020, Structural Health Monitoring.

[11]  Y. Moon,et al.  Application of the Deep Convolutional Neural Network to the Forecast of Solar Flare Occurrence Using Full-disk Solar Magnetograms , 2018, The Astrophysical Journal.

[12]  Haimin Wang,et al.  Predicting Solar Flares Using SDO/HMI Vector Magnetic Data Products and the Random Forest Algorithm , 2017, 1706.02422.

[13]  Zhiguang Wang,et al.  Deep Learning Technology for Predicting Solar Flares from (Geostationary Operational Environmental Satellite) Data , 2018 .

[14]  D. S. Bloomfield,et al.  TOWARD RELIABLE BENCHMARKING OF SOLAR FLARE FORECASTING METHODS , 2012, 1202.5995.

[15]  H. Cane,et al.  Geoeffectiveness (Dst and Kp) of interplanetary coronal mass ejections during 1995–2009 and implications for storm forecasting , 2011 .

[16]  Ayman El-Sayed,et al.  Multi-Biometric Systems: A State of the Art Survey and Research Directions , 2015, International Journal of Advanced Computer Science and Applications.

[17]  Derek C. Rose,et al.  Deep Machine Learning - A New Frontier in Artificial Intelligence Research [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[18]  David G. Stork,et al.  Pattern Classification , 1973 .

[19]  Monica G. Bobra,et al.  SOLAR FLARE PREDICTION USING SDO/HMI VECTOR MAGNETIC FIELD DATA WITH A MACHINE-LEARNING ALGORITHM , 2014, 1411.1405.

[20]  Jinfu Liu,et al.  Deep Learning Based Solar Flare Forecasting Model. I. Results for Line-of-sight Magnetograms , 2018 .

[21]  Volodymyr Turchenko,et al.  Creation of a deep convolutional auto-encoder in Caffe , 2015, 2017 9th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems: Technology and Applications (IDAACS).

[22]  Feng Lin,et al.  A Hybrid Deep Learning Model With Attention-Based Conv-LSTM Networks for Short-Term Traffic Flow Prediction , 2021, IEEE Transactions on Intelligent Transportation Systems.

[23]  Xin Huang,et al.  Solar flare forecasting using learning vector quantity and unsupervised clustering techniques , 2011 .

[24]  Predicting Solar Flares Using a Novel Deep Convolutional Neural Network , 2020 .

[25]  Li Jun Jiang,et al.  Enhanced Deep Learning Approach Based on the Deep Convolutional Encoder–Decoder Architecture for Electromagnetic Inverse Scattering Problems , 2020, IEEE Antennas and Wireless Propagation Letters.

[26]  Mark Moldwin,et al.  An Introduction to Space Weather , 2008 .

[27]  Rami Qahwaji,et al.  Automated Feature Detection and Solar Flare Prediction Using SDO Data , 2010 .

[28]  Y Ichioka,et al.  Parallel distributed processing model with local space-invariant interconnections and its optical architecture. , 1990, Applied optics.

[29]  Rami Qahwaji,et al.  Automated McIntosh-Based Classification of Sunspot Groups Using MDI Images , 2008 .

[30]  Manolis K. Georgoulis,et al.  Predicting Flares and Solar Energetic Particle Events: The FORSPEF Tool , 2017 .

[31]  Mohamed Abid,et al.  Development a New Algorithm for Iris Biometric Recognition , 2012 .

[32]  Stanley S. Ipson,et al.  A multi-biometric iris recognition system based on a deep learning approach , 2017, Pattern Analysis and Applications.

[33]  Jiasong Wu,et al.  Quaternion softmax classifier , 2014 .

[34]  Lubaina Ehsan,et al.  HMIC: Hierarchical Medical Image Classification, A Deep Learning Approach , 2020, Inf..

[35]  Rami Qahwaji,et al.  Automatic Short-Term Solar Flare Prediction Using Machine Learning and Sunspot Associations , 2007 .

[36]  Jamal Kharroubi,et al.  A deep learning approach for speaker recognition , 2020, Int. J. Speech Technol..

[37]  Jinung An,et al.  Minimizing inter-subject variability in fNIRS based Brain Computer Interfaces via multiple-kernel support vector learning , 2012, Medical engineering & physics.

[38]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.