Machine learning for quality assessment of ground-based optical images of satellites

Abstract. Astronomical images collected by ground-based telescopes suffer from degradation and perturbations attributed to atmospheric turbulence. We investigate the application of convolutional neural networks (CNNs) to ground-based satellite imaging to address two existing problems. First, the multiframe blind deconvolution (MFBD) algorithms that can extract well-resolved images from these degraded data frames are computationally expensive, requiring supercomputing infrastructure for relatively fast performance and currently cannot be done in real time. Because of this, it is difficult to optimize collection parameters to maximize the likelihood of producing a resolved image with MFBD. Second, the space-object National Imagery Interpretability Rating Scale (SNIIRS) allows human analysts to provide a quantitative score of image quality based on identification of target features. It is naturally difficult to automate this scoring process, not only because the scale is based on identifiable features but also because the images may be in an almost-resolved image quality regime that is difficult to handle for traditional computer vision techniques. For both applications, we present our results using CNNs on data collected at the Maui Space Surveillance Site as well as a new synthetic dataset we introduce containing over a million SNIIRS rated pairings of perturbed and pristine ground-based satellite images.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  James F. Riker,et al.  The time-domain analysis simulation for advanced tracking (TASAT) approaches to compensated imaging , 1992, Defense, Security, and Sensing.

[3]  John M. Irvine,et al.  National imagery interpretability rating scales (NIIRS): overview and methodology , 1997, Optics & Photonics.

[4]  Roberto Furfaro,et al.  Space Objects Classification via Light-Curve Measurements: Deep Convolutional Neural Networks and Model-based Transfer Learning , 2018 .

[5]  J C Leachtenauer,et al.  General Image-Quality Equation: GIQE. , 1997, Applied optics.

[6]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[7]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[9]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[10]  Genshe Chen,et al.  Space object classification using deep neural networks , 2018, 2018 IEEE Aerospace Conference.

[11]  Keith A. Bush,et al.  Satellite discrimination from active and passive polarization signatures: simulation predictions using the TASAT satellite model , 2002, SPIE Optics + Photonics.

[12]  Richard B Holmes,et al.  Analytical expressions for the log-amplitude correlation function for plane wave propagation in anisotropic non-Kolmogorov refractive turbulence. , 2012, Journal of the Optical Society of America. A, Optics, image science, and vision.

[13]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Roberto Furfaro,et al.  Space Object classification using deep Convolutional Neural Networks , 2016, 2016 19th International Conference on Information Fusion (FUSION).

[15]  D. Fried Optical Resolution Through a Randomly Inhomogeneous Medium for Very Long and Very Short Exposures , 1966 .

[16]  Fiona J Gilbert,et al.  Improving Workflow Efficiency for Mammography Using Machine Learning. , 2020, Journal of the American College of Radiology : JACR.

[17]  Stockholm University,et al.  Real-time multiframe blind deconvolution of solar images. , 2018, 1806.07150.

[18]  Levi Fussell,et al.  Forging new worlds: high-resolution synthetic galaxies with chained generative adversarial networks , 2018, Monthly Notices of the Royal Astronomical Society.

[19]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Neil Davey,et al.  An automatic taxonomy of galaxy morphology using unsupervised machine learning , 2017, 1709.05834.

[21]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Timothy J. Schulz,et al.  Multiframe blind deconvolution of astronomical images , 1993 .

[23]  Richard B Holmes,et al.  Analytical expressions for the log-amplitude correlation function for spherical wave propagation through anisotropic non-Kolmogorov atmosphere. , 2014, Journal of the Optical Society of America. A, Optics, image science, and vision.

[24]  Brandoch Calef,et al.  Recovering astronomical images with deep neural network supported bispectrum processing , 2018 .

[25]  Richard B. Holmes,et al.  Phase screen simulations of laser propagation through non-Kolmogorov atmospheric turbulence , 2011, Defense + Commercial Sensing.

[26]  Michael Kelley,et al.  National imagery interpretation rating system and the probabilities of detection, recognition, and identification , 1997 .

[27]  J. Mooney,et al.  Modular Mount Control System for Telescopes , 2017 .

[28]  Ce Zhang,et al.  Generative Adversarial Networks recover features in astrophysical images of galaxies beyond the deconvolution limit , 2017, ArXiv.

[29]  T. L. Reguianski The Air Force Institute of Technology , 1962 .

[30]  Mihaela van der Schaar,et al.  MAMMO: A Deep Learning Solution for Facilitating Radiologist-Machine Collaboration in Breast Cancer Diagnosis , 2018, ArXiv.

[31]  D. Buscher,et al.  Interferometric imaging of geo-synchronous satellites with ground-based telescopes , 2013, 2013 IEEE Aerospace Conference.