Learning the solar latent space: sigma-variational autoencoders for multiple channel solar imaging

This study uses a sigma-variational autoencoder to learn a latent space of solar images using the 12 channels taken by Atmospheric Imaging Assembly (AIA) and the Helioseismic and Magnetic Imager (HMI) instruments on-board the NASA Solar Dynamics Observatory. The model is able to significantly compress the large image dataset to 0.19% of its original size while still proficiently reconstructing the original images. As a downstream task making use of the learned representation, this study demonstrates the of use the learned latent space as an input to improve the forecasts of the F30 solar radio flux index, compared to an off-the-shelf pretrained ResNet feature extractor. Finally, the developed models can be used to generate realistic synthetic solar images by sampling from the learned latent space.

[1]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[2]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[3]  C. J. Wolfson,et al.  The Atmospheric Imaging Assembly (AIA) on the Solar Dynamics Observatory (SDO) , 2011 .

[4]  J. T. Hoeksema,et al.  The Helioseismic and Magnetic Imager (HMI) Investigation for the Solar Dynamics Observatory (SDO) , 2012 .

[5]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[6]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  S. Bruinsma,et al.  The 30 cm radio flux as a solar proxy for thermosphere density modelling , 2017 .

[9]  Christopher Burgess,et al.  beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework , 2016, ICLR 2016.

[10]  Abien Fred Agarap.  Deep Learning using Rectified Linear Units (ReLU) , 2018, ArXiv.

[11]  Yang Liu,et al.  A Machine-learning Data Set Prepared from the NASA Solar Dynamics Observatory Mission , 2019, The Astrophysical Journal Supplement Series.

[12]  Yong-Jae Moon,et al.  Generation of Solar UV and EUV Images from SDO/HMI Magnetograms by Deep Learning , 2019, The Astrophysical Journal.

[13]  Ganapathy Krishnamurthi,et al.  Solar Wind Prediction Using Deep Learning , 2020, Space Weather.

[14]  S. Levine,et al.  Simple and Effective VAE Training with Calibrated Decoders , 2020, ICML.