Advances in Deep Space Exploration via Simulators & Deep Learning

Abstract The NASA Starlight and Breakthrough Starshot programs conceptualize fast interstellar travel via small relativistic spacecraft that are propelled by directed energy. This process is radically different from traditional space travel and trades large and slow spacecraft for small, fast, inexpensive, and fragile ones. The main goal of these wafer satellites is to gather useful images during their deep space journey. We introduce and solve some of the main problems that accompany this concept. First, we need an object detection system that can detect planets that we have never seen before, some containing features that we may not even know exist in the universe. Second, once we have images of exoplanets, we need a way to take these images and rank them by importance. Equipment fails and data rates are slow, thus we need a method to ensure that the most important images to humankind are the ones that are prioritized for data transfer. Finally, the energy on board is minimal and must be conserved and used sparingly. No exoplanet images should be missed, but using energy erroneously would be detrimental. We introduce simulator-based methods that leverage artificial intelligence, mostly in the form of computer vision, in order to solve all three of these issues. Our results confirm that simulators provide an extremely rich training environment that surpasses that of real images, and can be used to train models on features that have yet to be observed by humans. We also show that the immersive and adaptable environment provided by the simulator, combined with deep learning, lets us navigate and save energy in an otherwise implausible way.

[1]  Ryosuke Yoshihashi,et al.  Deep Convolutional Neural Networks: A survey of the foundations, selected improvements, and some current applications , 2020, ArXiv.

[2]  Tae-Hyun Oh,et al.  Co-domain Embedding using Deep Quadruplet Networks for Unseen Traffic Sign Recognition , 2017, AAAI.

[3]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Jason J. Wang,et al.  A Bayesian Framework for Exoplanet Direct Detection and Non-detection , 2018, The Astronomical Journal.

[5]  Eugenio Culurciello,et al.  An Analysis of Deep Neural Network Models for Practical Applications , 2016, ArXiv.

[6]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  John Tran,et al.  cuDNN: Efficient Primitives for Deep Learning , 2014, ArXiv.

[8]  Daniel McDuff,et al.  Identifying Bias in AI using Simulation , 2018, ArXiv.

[9]  P. Lubin,et al.  Relativistic Spacecraft Propelled by Directed Energy , 2017, 1710.10732.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Raja Giryes,et al.  Shallow Transits—Deep Learning. I. Feasibility Study of Deep Learning to Detect Periodic Transits of Exoplanets , 2017, 1711.03163.

[12]  Pavlos Protopapas,et al.  Deep Learning for Image Sequence Classification of Astronomical Events , 2018, Publications of the Astronomical Society of the Pacific.

[13]  Joeri van Leeuwen,et al.  Applying Deep Learning to Fast Radio Burst Classification , 2018, The Astronomical Journal.

[14]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[15]  J. Kneib,et al.  Deep convolutional neural networks as strong gravitational lens detectors , 2017, 1705.07132.

[16]  Erik Asphaug,et al.  On-Orbit Smart Camera System to Observe Illuminated and Unilluminated Space Objects , 2018, ArXiv.

[17]  Hesham F. A. Hamed,et al.  Deep Convolutional Neural Networks , 2020, Deep Learning in Computer Vision.

[18]  Christopher J. Shallue,et al.  Identifying Exoplanets with Deep Learning: A Five-planet Resonant Chain around Kepler-80 and an Eighth Planet around Kepler-90 , 2017, 1712.05044.

[19]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[20]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[21]  Pavlos Protopapas,et al.  Deep Learning for Image Sequence Classification of Astronomical Events , 2018, Publications of the Astronomical Society of the Pacific.

[22]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Stephen R. Marsland,et al.  A self-organising network that grows when required , 2002, Neural Networks.

[24]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[25]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[26]  Kyle A. Pearson,et al.  Searching for exoplanets using artificial intelligence , 2017, Monthly Notices of the Royal Astronomical Society.

[27]  Michael G. Madden,et al.  Using a Game Engine to Simulate Critical Incidents and Data Collection by Autonomous Drones , 2018, 2018 IEEE Games, Entertainment, Media Conference (GEM).