Visualization in Astrophysics: Developing New Methods, Discovering Our Universe, and Educating the Earth

We present a state‐of‐the‐art report on visualization in astrophysics. We survey representative papers from both astrophysics and visualization and provide a taxonomy of existing approaches based on data analysis tasks. The approaches are classified based on five categories: data wrangling, data exploration, feature identification, object reconstruction, as well as education and outreach. Our unique contribution is to combine the diverse viewpoints from both astronomers and visualization experts to identify challenges and opportunities for visualization in astrophysics. The main goal is to provide a reference point to bring modern data analysis and visualization techniques to the rich datasets in astrophysics.

[1]  Frédéric Vogt,et al.  Stereo pairs in Astrophysics , 2011, Astrophysics and Space Science.

[2]  Jonathan Woodring,et al.  ANALYZING AND VISUALIZING COSMOLOGICAL SIMULATIONS WITH ParaView , 2010, 1010.6128.

[3]  K. Howell,et al.  Enhanced Visualization and Autonomous Extraction of Poincaré Map Topology , 2014 .

[4]  Vijay Natarajan,et al.  Felix: A Topology Based Framework for Visual Exploration of Cosmic Filaments , 2015, IEEE Transactions on Visualization and Computer Graphics.

[5]  G. Elisabeta Marai,et al.  Cavern Halos: Exploring spatial and nonspatial cosmological data in an immersive virtual environment , 2015, 2015 IEEE Scientific Visualization Conference (SciVis).

[6]  Kwan-Liu Ma,et al.  Scientific Storytelling Using Visualization , 2012, IEEE Computer Graphics and Applications.

[7]  M. Dopita,et al.  Linking the X3D Pathway to Integral Field Spectrographs: YSNR 1E 0102.2-7219 in the SMC as a Case Study , 2016, 1611.03862.

[8]  Xin Xu,et al.  Finding cosmic voids and filament loops using topological data analysis , 2018, Astron. Comput..

[9]  Kumiko Usuda-Sato,et al.  Making ‘real astronomy’ visible to the public , 2018 .

[10]  Kathleen C. Howell,et al.  Extraction and Visualization of Poincare Map Topology for Spacecraft Trajectory Design , 2020, IEEE Transactions on Visualization and Computer Graphics.

[11]  Annalisa Pillepich,et al.  Simulating galaxy formation with the IllustrisTNG model , 2017, 1703.02970.

[12]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[13]  C. Aime,et al.  Reconstructing Images in Astrophysics, an Inverse Problem Point of View , 2016 .

[14]  A. Forbes,et al.  Volumetric Reconstruction for Interactive Analysis of the Cosmic Web , 2020 .

[15]  Eduard Gröller,et al.  InCorr: Interactive Data-Driven Correlation Panels for Digital Outcrop Analysis , 2021, IEEE Transactions on Visualization and Computer Graphics.

[16]  Juergen Ott,et al.  CARTA: Cube Analysis and Rendering Tool for Astronomy , 2020 .

[17]  Alexander Bock,et al.  OpenSpace: A System for Astrographics , 2020, IEEE Transactions on Visualization and Computer Graphics.

[18]  Kalina Borkiewicz,et al.  Introduction to cinematic scientific visualization , 2020, SIGGRAPH Courses.

[19]  Chi-Wing Fu,et al.  A Transparently Scalable Visualization Architecture for Exploring the Universe , 2007, IEEE Transactions on Visualization and Computer Graphics.

[20]  Alexander Bock,et al.  Dynamic Scene Graph: Enabling Scaling, Positioning, and Navigation in the Universe , 2017, Comput. Graph. Forum.

[21]  Dominic C. Marcello,et al.  Visual Analysis of Structure Formation in Cosmic Evolution , 2019, 2019 IEEE Scientific Visualization Conference (SciVis).

[22]  Edward J. Kim,et al.  Star-galaxy Classification Using Deep Convolutional Neural Networks , 2016, ArXiv.

[23]  Sara Price,et al.  Walking Through an Exploded Star: Rendering Supernova Remnant Cassiopeia A into Virtual Reality , 2018, ArXiv.

[24]  Christopher J. Fluke,et al.  Scientific Visualization in Astronomy: Towards the Petascale Astronomy Era , 2011, Publications of the Astronomical Society of Australia.

[25]  Chenzhou Cui,et al.  AAS WorldWide Telescope: A Seamless, Cross-platform Data Visualization Engine for Astronomy Research, Education, and Democratizing Data , 2018, 1801.09119.

[26]  Lisa M. Frattare,et al.  The Aesthetics of Astrophysics: How to Make Appealing Color-composite Images that Convey the Science , 2017, 1703.00490.

[27]  D. Wells,et al.  Fits: a flexible image transport system , 1981 .

[28]  Alexander Bock,et al.  Globe Browsing: Contextualized Spatio-Temporal Planetary Surface Visualization , 2018, IEEE Transactions on Visualization and Computer Graphics.

[29]  Anders Ynnerman,et al.  Interactive visualization of 3d scanned mummies at public venues , 2016, Commun. ACM.

[30]  Paul Rosen,et al.  Using Contour Trees in the Analysis and Visualization of Radio Astronomy Data Cubes , 2017, Mathematics and Visualization.

[31]  F. Marinacci,et al.  A Deep Learning Approach to Galaxy Cluster X-Ray Masses , 2018, The Astrophysical Journal.

[32]  Hal Finkel,et al.  HACC: Simulating Sky Surveys on State-of-the-Art Supercomputing Architectures , 2014, 1410.2805.

[33]  Yang Gao,et al.  Interactive visual exploration of halos in large-scale cosmology simulation , 2014, J. Vis..

[34]  Mark Taylor,et al.  TOPCAT: Desktop Exploration of Tabular Data for Astronomy and Beyond , 2017, Informatics.

[35]  C. Frenk,et al.  The Aquarius Project : the subhalos of galactic halos , 2008 .

[36]  Chi-Wing Fu,et al.  Visualizing Large-Scale Uncertainty in Astrophysical Data , 2007, IEEE Transactions on Visualization and Computer Graphics.

[37]  M. Norman,et al.  yt: A MULTI-CODE ANALYSIS TOOLKIT FOR ASTROPHYSICAL SIMULATION DATA , 2010, 1011.3514.

[38]  Rien van de Weygaert,et al.  Tracing the cosmic web , 2017, 1705.03021.

[39]  Timo Ropinski,et al.  Visual verification of space weather ensemble simulations , 2015, 2015 IEEE Scientific Visualization Conference (SciVis).

[40]  Gerd Heber,et al.  An overview of the HDF5 technology suite and its applications , 2011, AD '11.

[41]  Marcus A. Magnor,et al.  Shape: A 3D Modeling Tool for Astrophysics , 2010, IEEE Transactions on Visualization and Computer Graphics.

[42]  Christopher J. Fluke,et al.  An Advanced, Three-Dimensional Plotting Library for Astronomy , 2006, Publications of the Astronomical Society of Australia.

[43]  R. Forman A USER'S GUIDE TO DISCRETE MORSE THEORY , 2002 .

[44]  Visualizing the Temporal Evolution of the Universe from Cosmology Simulations , 2019, 2019 IEEE Scientific Visualization Conference (SciVis).

[45]  Klaus H. Hinrichs,et al.  Interactive Exploration of Cosmological Dark-Matter Simulation Data , 2017, IEEE Computer Graphics and Applications.

[46]  Dominique Brodbeck,et al.  Research directions in data wrangling: Visualizations and transformations for usable and credible data , 2011, Inf. Vis..

[47]  Mark Taylor,et al.  TOPCAT & STIL: Starlink Table/VOTable Processing Software , 2005 .

[48]  Alexander Bock,et al.  OpenSpace: Bringing NASA Missions to the Public , 2018, IEEE Computer Graphics and Applications.

[49]  M. Dopita,et al.  The 3D structure of N132D in the LMC: a late-stage young supernova remnant , 2010, 1009.0964.

[50]  Aneta Siemiginowska,et al.  The Role of Machine Learning in the Next Decade of Cosmology , 2019, 1902.10159.

[51]  Y. Hoffman,et al.  The Cosmic V-Web , 2017, 1706.03413.

[52]  Benedikt Diemer,et al.  The Fabric of the Universe: Exploring the Cosmic Web in 3D Prints and Woven Textiles , 2017, 1702.03897.

[53]  Oskar Elek,et al.  Polyphorm: Structural Analysis of Cosmological Datasets via Interactive Physarum Polycephalum Visualization , 2020, IEEE Transactions on Visualization and Computer Graphics.

[54]  Devin W. Silvia,et al.  ENZO: AN ADAPTIVE MESH REFINEMENT CODE FOR ASTROPHYSICS , 2013, J. Open Source Softw..

[55]  Zesheng Tang,et al.  3D visualization of solar wind ion data from the Chang'E-1 exploration , 2011, Comput. Geosci..

[56]  Tobias Isenberg,et al.  Efficient Structure-Aware Selection Techniques for 3D Point Cloud Visualizations with 2DOF Input , 2012, IEEE Transactions on Visualization and Computer Graphics.

[57]  Govinda R. Poudel,et al.  Large-scale comparative visualisation of sets of multidimensional data , 2016, PeerJ Comput. Sci..

[58]  Kalina Borkiewicz,et al.  Houdini for Astrophysical Visualization , 2017 .

[59]  Alexander Bock,et al.  Interactive Visualization of Atmospheric Effects for Celestial Bodies , 2020, IEEE Transactions on Visualization and Computer Graphics.

[60]  Sara Nieto,et al.  Visualization of Multi-mission Astronomical Data with ESASky , 2017, 1701.02533.

[61]  Stefan Jaeger,et al.  The Common Astronomy Software Application (CASA) , 2008 .

[62]  Timo Ropinski,et al.  Interaction techniques as a communication channel when presenting 3D visualizations , 2014, 2014 IEEE VIS International Workshop on 3DVis (3DVis).

[63]  A. Ghez,et al.  A population of dust-enshrouded objects orbiting the Galactic black hole , 2020, Nature.

[64]  Demitri Muna Introducing Nightlight: A New FITS Viewer , 2017 .

[65]  Ralf Kähler,et al.  A Novel Approach to Visualizing Dark Matter Simulations , 2012, IEEE Transactions on Visualization and Computer Graphics.

[66]  G. Bruce Berriman,et al.  The Application of the Montage Image Mosaic Engine to the Visualization of Astronomical Images , 2017, 1702.02593.

[67]  Claudio Gheller,et al.  Interactive 3D Visualization for Theoretical Virtual Observatories , 2018, ArXiv.

[68]  Nicholas F. Polys,et al.  Visualize This: Lessons from the Front-lines of High Performance Visualization , 2020 .

[69]  Durham,et al.  The Aquarius Project: the subhaloes of galactic haloes , 2008, 0809.0898.

[70]  Jill Naiman,et al.  Cinematic Visualization of Multiresolution Data: Ytini for Adaptive Mesh Refinement in Houdini , 2018, The Astronomical Journal.

[71]  Mark Taylor Visualising Large Datasets in TOPCAT v4 , 2014, ArXiv.

[72]  Christopher J. Fluke,et al.  Future Directions in Astronomy Visualization , 2006, Publications of the Astronomical Society of Australia.

[73]  Alexandros Labrinidis,et al.  Large-Scale Overlays and Trends: Visually Mining, Panning and Zoomingthe Observable Universe , 2014, IEEE Transactions on Visualization and Computer Graphics.

[74]  S. Colombi,et al.  Skeleton as a probe of the cosmic web : the two-dimensional case , 2003, astro-ph/0307003.

[75]  Keivan G. Stassun,et al.  Filtergraph: An Interactive Web Application for Visualization of Astronomy Datasets , 2013 .

[76]  C. Pichon,et al.  The persistent cosmic web and its filamentary structure II: Illustrations , 2010, 1009.4014.

[77]  A. Benson Galacticus: A Semi-Analytic Model of Galaxy Formation , 2010, 1008.1786.

[78]  J. Prochaska,et al.  Revealing the Dark Threads of the Cosmic Web , 2020, The Astrophysical Journal.

[79]  Maarten A. Breddels,et al.  Vaex: big data exploration in the era of Gaia , 2018, Astronomy & Astrophysics.

[80]  S. T. Timmer,et al.  First M87 Event Horizon Telescope Results. I. The Shadow of the Supermassive Black Hole , 2019, 1906.11238.

[81]  J. C. Dainty,et al.  Progress In Object Reconstruction In Astronomy , 1985, Other Conferences.

[82]  T. Sousbie The persistent cosmic web and its filamentary structure I: Theory and implementation , 2010, 1009.4015.

[83]  Issei Fujishiro,et al.  TimeTubes: Design of a Visualization Tool for Time-Dependent, Multivariate Blazar Datasets , 2016, 2016 Nicograph International (NicoInt).

[84]  Lars Linsen,et al.  Interactive Multi-Level Visualization of Combined Particle and Multi-Field Cosmology Data , 2019, 2019 IEEE Scientific Visualization Conference (SciVis).

[85]  Rémi Flamary,et al.  Astronomical image reconstruction with convolutional neural networks , 2016, 2017 25th European Signal Processing Conference (EUSIPCO).

[86]  Madicken Munk,et al.  widgyts: Custom Jupyter Widgets for Interactive Data Exploration with yt , 2020, J. Open Source Softw..

[87]  Mat'ias G'arate,et al.  Voxel Datacubes for 3D Visualization in Blender , 2016, 1611.06965.

[88]  Rhys Taylor FRELLED : A Realtime Volumetric Data Viewer For Astronomers , 2015 .

[90]  Daniel S. Katz,et al.  Web-based Tools -- Montage: An astronomical image mosaic engine , 2007 .

[91]  G. Elisabeta Marai,et al.  DarkSky Halos: Use-Based Exploration of Dark Matter Formation Data in a Hybrid Immersive Virtual Environment , 2019, Front. Robot. AI.

[92]  A. Goodman,et al.  New Thinking on, and with, Data Visualization , 2018, 1805.11300.

[93]  Thomas Müller,et al.  Gaia Sky: Navigating the Gaia Catalog , 2019, IEEE Transactions on Visualization and Computer Graphics.

[94]  Sara Price,et al.  Touching the stars: improving NASA 3D printed data sets with blind and visually impaired audiences , 2019, Journal of Science Communication.

[95]  R. Brent Tully,et al.  Cosmography and Data Visualization , 2017, 1702.01941.

[96]  Timo Ropinski,et al.  Voreen: A Rapid-Prototyping Environment for Ray-Casting-Based Volume Visualizations , 2009, IEEE Computer Graphics and Applications.

[97]  J. E. Ruiz,et al.  LSSGalPy: Interactive Visualization of the Large-scale Environment Around Galaxies , 2017, 1702.04268.

[98]  3DMAP-VR, A Project to Visualize Three-dimensional Models of Astrophysical Phenomena in Virtual Reality , 2019, 1912.02649.

[99]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[100]  Marcus A. Magnor,et al.  Constrained inverse volume rendering for planetary nebulae , 2004, IEEE Visualization 2004.

[101]  Jonathan C. Roberts,et al.  Visualization for the Physical Sciences , 2012, Comput. Graph. Forum.

[102]  Michal Maciejewski,et al.  Structure finding in cosmological simulations: the state of affairs , 2013, 1304.0585.

[103]  Kalina Borkiewicz,et al.  Cinematic scientific visualization: the art of communicating science , 2019, SIGGRAPH Courses.

[104]  Franz Sauer,et al.  An integrated visualization system for interactive analysis of large, heterogeneous cosmology data , 2016, 2016 IEEE Pacific Visualization Symposium (PacificVis).

[105]  Jonathan C. Roberts,et al.  Visualization for the Physical Sciences , 2012, Comput. Graph. Forum.

[106]  J. Peacock,et al.  Simulations of the formation, evolution and clustering of galaxies and quasars , 2005, Nature.

[107]  T. Tsutsumi,et al.  The CASA software for radio astronomy: status update from ADASS 2019 , 2019, 1912.09437.

[108]  Sebastian Koch,et al.  Visual Analysis and Dissemination of Scientific Literature Collections with SurVis , 2016, IEEE Transactions on Visualization and Computer Graphics.

[109]  Frédéric P. A. Vogt,et al.  Augmented Reality in astrophysics , 2013, ArXiv.

[110]  Angus Graeme Forbes,et al.  Halos in a dark sky: Interactively exploring the structure of dark matter halo merger trees , 2015, 2015 IEEE Scientific Visualization Conference (SciVis).

[111]  Thomas I. Madura,et al.  A Case Study in Astronomical 3D Printing: The Mysterious η Carinae , 2016, 1611.09994.

[112]  Christopher J. Fluke,et al.  Incorporating interactive three-dimensional graphics in astronomy research papers , 2007, 0709.2734.

[113]  R. Taylor Visualizing Three-dimensional Volumetric Data with an Arbitrary Coordinate System , 2016, 1611.02517.

[114]  Johanna Beyer,et al.  TimeTubesX: A Query-Driven Visual Exploration of Observable, Photometric, and Polarimetric Behaviors of Blazars. , 2020, IEEE transactions on visualization and computer graphics.

[115]  Brian R. Kent,et al.  Spherical Panoramas for Astrophysical Data Visualization , 2017, 1701.08807.

[116]  Helwig Hauser,et al.  Story Telling for Presentation in Volume Visualization , 2007, EuroVis.

[117]  Tobias Isenberg,et al.  CAST: Effective and Efficient User Interaction for Context-Aware Selection in 3D Particle Clouds , 2016, IEEE Transactions on Visualization and Computer Graphics.

[118]  T. R. Gosnell,et al.  Digital Image Reconstruction: Deblurring and Denoising , 2005 .

[119]  Sahar Shahaf,et al.  Detecting outliers and learning complex structures with large spectroscopic surveys - a case study with APOGEE stars , 2017, 1711.00022.

[120]  Canada.,et al.  Data Mining and Machine Learning in Astronomy , 2009, 0906.2173.

[121]  M. Aragon-Calvo Classifying the large-scale structure of the universe with deep neural networks , 2018, Monthly Notices of the Royal Astronomical Society.

[122]  J. X. Prochaska,et al.  IGM‐Vis: Analyzing Intergalactic and Circumgalactic Medium Absorption Using Quasar Sightlines in a Cosmic Web Context , 2018, Comput. Graph. Forum.

[123]  Alexander Bock,et al.  IDEAS: Immersive Dome Experiences for Accelerating Science , 2019, 1907.05383.

[124]  Brian R. Kent,et al.  Visualizing Astronomical Data with Blender , 2013, ArXiv.

[125]  L. Verdes-Montenegro,et al.  ADVANCED DATA VISUALIZATION IN ASTROPHYSICS: THE X3D PATHWAY , 2015, 1510.02796.

[126]  Elmar Eisemann,et al.  Interactive Black-Hole Visualization , 2020, IEEE Transactions on Visualization and Computer Graphics.

[127]  Anders Ynnerman,et al.  Uniview - Visualizing the Universe , 2010, Eurographics.

[128]  Hans Hagen,et al.  A Survey of Topology‐based Methods in Visualization , 2016, Comput. Graph. Forum.

[129]  H. Courtois,et al.  COSMICFLOWS-2: THE DATA , 2013, 1307.7213.

[130]  Igor Soszyński,et al.  A three-dimensional map of the Milky Way using classical Cepheid variable stars , 2018, Science.

[131]  Anders Ynnerman,et al.  Exploranation: A New Science Communication Paradigm , 2018, IEEE Computer Graphics and Applications.

[132]  Anders Ynnerman,et al.  Astrographics: Interactive Data-Driven Journeys through Space (Dagstuhl Seminar 19262) , 2019, Dagstuhl Reports.

[133]  J. P. Naiman,et al.  AstroBlend: An astrophysical visualization package for Blender , 2016, Astron. Comput..

[134]  Tzu-Hsuan Wei,et al.  Visualizing the life and anatomy of dark matter , 2015, 2015 IEEE Scientific Visualization Conference (SciVis).

[135]  Vung Pham,et al.  Visualization of Data from HACC Simulations by Paraview , 2019, 2019 IEEE Scientific Visualization Conference (SciVis).

[136]  Colin Jacobs,et al.  Surveying the reach and maturity of machine learning and artificial intelligence in astronomy , 2019, WIREs Data Mining Knowl. Discov..

[137]  A. Comrie,et al.  Development and application of an HDF5 schema for SKA-scale image cube visualization , 2020 .

[138]  M. Lombardi,et al.  3D shape of Orion A from Gaia DR2 , 2018, Astronomy & Astrophysics.

[139]  Marcus A. Magnor,et al.  Fast Image‐Based Modeling of Astronomical Nebulae , 2013, Comput. Graph. Forum.

[140]  Sibo Wang,et al.  Unsupervised learning and data clustering for the construction of Galaxy Catalogs in the Dark Energy Survey , 2018, Physics Letters B.

[141]  Marcus A. Magnor,et al.  Visualization of Astronomical Nebulae via Distributed Multi-GPU Compressed Sensing Tomography , 2012, IEEE Transactions on Visualization and Computer Graphics.

[142]  B. Hasenberger,et al.  AVIATOR: Morphological object reconstruction in 3D , 2019, Astronomy & Astrophysics.

[143]  Alyssa A. Goodman,et al.  Principles of high‐dimensional data visualization in astronomy , 2012, 1205.4747.