Learning to predict the cosmological structure formation

Significance To understand the evolution of the Universe requires a concerted effort of accurate observation of the sky and fast prediction of structures in the Universe. N-body simulation is an effective approach to predicting structure formation of the Universe, though computationally expensive. Here, we build a deep neural network to predict structure formation of the Universe. It outperforms the traditional fast-analytical approximation and accurately extrapolates far beyond its training data. Our study proves that deep learning is an accurate alternative to the traditional way of generating approximate cosmological simulations. Our study shows that one can use deep learning to generate complex 3D simulations in cosmology. This suggests that deep learning can provide a powerful alternative to traditional numerical simulations in cosmology. Matter evolved under the influence of gravity from minuscule density fluctuations. Nonperturbative structure formed hierarchically over all scales and developed non-Gaussian features in the Universe, known as the cosmic web. To fully understand the structure formation of the Universe is one of the holy grails of modern astrophysics. Astrophysicists survey large volumes of the Universe and use a large ensemble of computer simulations to compare with the observed data to extract the full information of our own Universe. However, to evolve billions of particles over billions of years, even with the simplest physics, is a daunting task. We build a deep neural network, the Deep Density Displacement Model (D3M), which learns from a set of prerun numerical simulations, to predict the nonlinear large-scale structure of the Universe with the Zel’dovich Approximation (ZA), an analytical approximation based on perturbation theory, as the input. Our extensive analysis demonstrates that D3M outperforms the second-order perturbation theory (2LPT), the commonly used fast-approximate simulation method, in predicting cosmic structure in the nonlinear regime. We also show that D3M is able to accurately extrapolate far beyond its training data and predict structure formation for significantly different cosmological parameters. Our study proves that deep learning is a practical and accurate alternative to approximate 3D simulations of the gravitational structure formation of the Universe.

[1]  Y. Zel’dovich Gravitational instability: An Approximate theory for large density perturbations , 1969 .

[2]  G. Efstathiou,et al.  The evolution of large-scale structure in a universe dominated by cold dark matter , 1985 .

[3]  T. Buchert Lagrangian theory of gravitational instability of Friedman-Lemaître cosmologies: a generic third-order model for non-linear clustering , 1993, astro-ph/9309055.

[4]  J. Bond,et al.  How filaments of galaxies are woven into the cosmic web , 1995, Nature.

[5]  F. Pearce,et al.  A new parallel PM3 code for very large-scale cosmological simulations , 1998, astro-ph/9805096.

[6]  S.Cole,et al.  The 2dF Galaxy Redshift Survey: spectra and redshifts , 2001, astro-ph/0106498.

[7]  V. Springel,et al.  GADGET: a code for collisionless and gasdynamical cosmological simulations , 2000, astro-ph/0003162.

[8]  J. Bagla TreePM: A code for cosmological N-body simulations , 1999, astro-ph/9911025.

[9]  W. M. Wood-Vasey,et al.  SDSS-III: MASSIVE SPECTROSCOPIC SURVEYS OF THE DISTANT UNIVERSE, THE MILKY WAY, AND EXTRA-SOLAR PLANETARY SYSTEMS , 2011, 1101.1529.

[10]  O. Lahav,et al.  The 6dF Galaxy Survey: final redshift release (DR3) and southern large-scale structures , 2009, 0903.5451.

[11]  O. Lahav,et al.  The 6 dF Galaxy Survey : final redshift release ( DR 3 ) and southern large-scale structures , 2009 .

[12]  C. Baltay,et al.  Wide-Field InfraRed Survey Telescope WFIRST Final Report , 2012 .

[13]  Francisco-Shu Kitaura,et al.  The Initial Conditions of the Universe from Constrained Simulations , 2012, ArXiv.

[14]  W. M. Wood-Vasey,et al.  THE BARYON OSCILLATION SPECTROSCOPIC SURVEY OF SDSS-III , 2012, 1208.0022.

[15]  Jessica B. Hamrick,et al.  Simulation as an engine of physical scene understanding , 2013, Proceedings of the National Academy of Sciences.

[16]  B. Wandelt,et al.  Bayesian physical reconstruction of initial conditions from large-scale structure surveys , 2012, 1203.3639.

[17]  Kwan Chuen Chan Helmholtz decomposition of the Lagrangian displacement , 2013, 1309.2243.

[18]  M. White The Zel'dovich approximation , 2014, 1401.5466.

[19]  Balázs Kégl,et al.  The Higgs boson machine learning challenge , 2014, HEPML@NIPS.

[20]  D. Eisenstein,et al.  Computing the Three-Point Correlation Function of Galaxies in $\mathcal{O}(N^2)$ Time , 2015, 1506.02040.

[21]  J. A. Vázquez-Mata,et al.  Galaxy and mass assembly (GAMA): End of survey report and data release 2 , 2015, 1506.08222.

[22]  Lisa Anne Hendricks,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2015, CVPR.

[23]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[24]  Jiajun Wu,et al.  Galileo: Perceiving Physical Object Properties by Integrating a Physics Engine with Deep Learning , 2015, NIPS.

[25]  C. A. Oxborrow,et al.  Planck2015 results , 2015, Astronomy & Astrophysics.

[26]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Edward J. Wollack,et al.  Wide-Field InfrarRed Survey Telescope-Astrophysics Focused Telescope Assets WFIRST-AFTA 2015 Report , 2015, 1503.03757.

[29]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[30]  Trevor Darrell,et al.  Long-term recurrent convolutional networks for visual recognition and description , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  B. Frey,et al.  Predicting the sequence specificities of DNA- and RNA-binding proteins by deep learning , 2015, Nature Biotechnology.

[32]  Jiajun Wu,et al.  Physics 101: Learning Physical Object Properties from Unlabeled Videos , 2016, BMVC.

[33]  Barnabás Póczos,et al.  Estimating Cosmological Parameters from the Dark Matter Distribution , 2016, ICML.

[34]  Jitendra Malik,et al.  Learning Visual Predictive Models of Physics for Playing Billiards , 2015, ICLR.

[35]  Ali Farhadi,et al.  Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Images , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[37]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[38]  David R. Silva,et al.  The DESI Experiment Part I: Science,Targeting, and Survey Design , 2016, 1611.00036.

[39]  P. Mcdonald,et al.  FastPM: a new scheme for fast simulations of dark matter and haloes , 2016, 1603.00476.

[40]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[41]  E. Jennings,et al.  Biased Tracers in Redshift Space in the EFT of Large-Scale Structure , 2016, 1610.09321.

[42]  Jitendra Malik,et al.  Learning to Poke by Poking: Experiential Learning of Intuitive Physics , 2016, NIPS.

[43]  Chong Wang,et al.  Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin , 2015, ICML.

[44]  W. M. Wood-Vasey,et al.  THE SDSS-IV EXTENDED BARYON OSCILLATION SPECTROSCOPIC SURVEY: OVERVIEW AND EARLY DATA , 2015, 1508.04473.

[45]  O. Lahav,et al.  PHOTOMETRIC SUPERNOVA CLASSIFICATION WITH MACHINE LEARNING , 2016, 1603.00882.

[46]  Razvan Pascanu,et al.  Interaction Networks for Learning about Objects, Relations and Physics , 2016, NIPS.

[47]  B. Garilli,et al.  The VIMOS Public Extragalactic Redshift Survey (VIPERS). Full spectroscopic data and auxiliary information release (PDR-2) , 2016, 1611.07048.

[48]  Sergey Levine,et al.  End-to-End Training of Deep Visuomotor Policies , 2015, J. Mach. Learn. Res..

[49]  Rob Fergus,et al.  Learning Physical Intuition of Block Towers by Example , 2016, ICML.

[50]  Edward J. Kim,et al.  Star-galaxy Classification Using Deep Convolutional Neural Networks , 2016, ArXiv.

[51]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[52]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[53]  Razvan Pascanu,et al.  Visual Interaction Networks: Learning a Physics Simulator from Video , 2017, NIPS.

[54]  Eric P. Xing,et al.  Toward Controlled Generation of Text , 2017, ICML.

[55]  Laurence Perreault Levasseur,et al.  Fast automated analysis of strong gravitational lenses with convolutional neural networks , 2017, Nature.

[56]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  Joshua B. Tenenbaum,et al.  A Compositional Object-Based Approach to Learning Physical Dynamics , 2016, ICLR.

[58]  Ken Perlin,et al.  Accelerating Eulerian Fluid Simulation With Convolutional Networks , 2016, ICML.

[59]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[60]  Matthias Troyer,et al.  Solving the quantum many-body problem with artificial neural networks , 2016, Science.

[61]  Aaron C. Courville,et al.  Improved Training of Wasserstein GANs , 2017, NIPS.

[62]  Prabhat,et al.  CosmoFlow: Using Deep Learning to Learn the Universe at Scale , 2018, SC18: International Conference for High Performance Computing, Networking, Storage and Analysis.

[63]  U. Seljak,et al.  Exploring the posterior surface of the large scale structure reconstruction , 2018, Journal of Cosmology and Astroparticle Physics.

[64]  Siamak Ravanbakhsh,et al.  Analysis of Cosmic Microwave Background with Deep Learning , 2018, ICLR.

[65]  Shaun A. Thomas,et al.  Cosmology and Fundamental Physics with the Euclid Satellite , 2012, Living Reviews in Relativity.

[66]  B. Póczos,et al.  CMU DeepLens: deep learning for automatic image-based galaxy–galaxy strong lens finding , 2017, Monthly Notices of the Royal Astronomical Society.

[67]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[68]  Philippe Berger,et al.  A volumetric deep Convolutional Neural Network for simulation of dark matter halo catalogues , 2018, Monthly Notices of the Royal Astronomical Society.

[69]  Yu Feng,et al.  nbodykit: An Open-source, Massively Parallel Toolkit for Large-scale Structure , 2017, The Astronomical Journal.

[70]  Anne E Carpenter,et al.  Opportunities and obstacles for deep learning in biology and medicine , 2017, bioRxiv.

[71]  Rob Fergus,et al.  Stochastic Video Generation with a Learned Prior , 2018, ICML.

[72]  Alexander T. Ihler,et al.  ContextNet: Deep learning for Star Galaxy Classification , 2018, ICML.

[73]  Mike Preuss,et al.  Planning chemical syntheses with deep neural networks and symbolic AI , 2017, Nature.

[74]  M. Aragon-Calvo Classifying the large-scale structure of the universe with deep neural networks , 2018, Monthly Notices of the Royal Astronomical Society.

[75]  B. Nord,et al.  DeepCMB: Lensing Reconstruction of the Cosmic Microwave Background with Deep Neural Networks , 2018, Astron. Comput..

[76]  Eduardo Serrano,et al.  LSST: From Science Drivers to Reference Design and Anticipated Data Products , 2008, The Astrophysical Journal.

[77]  Nathanael Perraudin,et al.  DeepSphere: Efficient spherical Convolutional Neural Network with HEALPix sampling for cosmological applications , 2018, Astron. Comput..