Applications of physics informed neural operators

We present a critical analysis of physics-informed neural operators to solve partial differential equations that are ubiquitous in the study and modeling of physics phenomena using carefully curated datasets. Further, we provide a benchmarking suite which can be used to evaluate physics-informed neural operators in solving such problems. We first demonstrate that our methods reproduce the accuracy and performance of other neural operators published elsewhere in the literature to learn the 1D wave equation and the 1D Burgers equation. Thereafter, we apply our physics-informed neural operators to learn new types of equations, including the 2D Burgers equation in the scalar, inviscid and vector types. Finally, we show that our approach is also applicable to learn the physics of the 2D linear and nonlinear shallow water equations, which involve three coupled partial differential equations. We release our artificial intelligence surrogates and scientific software to produce initial data and boundary conditions to study a broad range of physically motivated scenarios. We provide the \href{https://github.com/shawnrosofsky/PINO_Applications/tree/main}{source code}, an interactive \href{https://shawnrosofsky.github.io/PINO_Applications/}{website} to visualize the predictions of our physics informed neural operators, and a tutorial for their use at the \href{https://www.dlhub.org}{Data and Learning Hub for Science}.

[1]  M. Wattenberg,et al.  Interpreting a Machine Learning Model for Detecting Gravitational Waves , 2022, ArXiv.

[2]  E. Huerta,et al.  Inference-Optimized AI and High Performance Computing for Gravitational Wave Detection at Scale , 2022, Frontiers in Artificial Intelligence.

[3]  R. Haas,et al.  A New Moment-Based General-Relativistic Neutrino-Radiation Transport Code: Methods and First Applications to Neutron Star Mergers , 2021, Monthly Notices of the Royal Astronomical Society.

[4]  Asad Khan,et al.  Interpretable AI forecasting for numerical relativity waveforms of quasi-circular, spinning, non-precessing binary black hole mergers , 2021, Physical Review D.

[5]  Sang Eon Park,et al.  A FAIR and AI-ready Higgs boson decay dataset , 2021, Scientific Data.

[6]  Nikola B. Kovachki,et al.  Physics-Informed Neural Operator for Learning Partial Differential Equations , 2021, ArXiv.

[7]  Nikola B. Kovachki,et al.  Neural Operator: Learning Maps Between Function Spaces , 2021, ArXiv.

[8]  Mark Ainsworth,et al.  Galerkin Neural Networks: A Framework for Approximating Variational Equations with Error Control , 2021, SIAM J. Sci. Comput..

[9]  Zhizhen Zhao,et al.  Advances in Machine and Deep Learning for Modeling and Real-time Detection of Multi-Messenger Sources , 2021, Handbook of Gravitational Wave Astronomy.

[10]  Paris Perdikaris,et al.  Learning the solution operator of parametric partial differential equations with physics-informed DeepONets , 2021, Science advances.

[11]  Volodymyr Kindratenko,et al.  Accelerated, scalable and reproducible AI-driven gravitational wave detection , 2020, Nature Astronomy.

[12]  Kai Staats,et al.  Enhancing gravitational-wave science with machine learning , 2020, Mach. Learn. Sci. Technol..

[13]  George Em Karniadakis,et al.  Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators , 2019, Nature Machine Intelligence.

[14]  F. Foucart A Brief Overview of Black Hole-Neutron Star Mergers , 2020, Frontiers in Astronomy and Space Sciences.

[15]  Nikola B. Kovachki,et al.  Multipole Graph Neural Operator for Parametric Partial Differential Equations , 2020, NeurIPS.

[16]  D. Radice Binary Neutron Star Merger Simulations with a Calibrated Turbulence Model , 2020, Symmetry.

[17]  Daniel S. Katz,et al.  Convergence of artificial intelligence and high performance computing on NSF-supported cyberinfrastructure , 2020, Journal of Big Data.

[18]  E. Huerta,et al.  Artificial neural network subgrid models of 2D compressible magnetohydrodynamic turbulence , 2019, Physical Review D.

[19]  Philip D. Plowright Front , 2019, 2020 Fourth World Conference on Smart Trends in Systems, Security and Sustainability (WorldS4).

[20]  Zhiping Mao,et al.  DeepXDE: A Deep Learning Library for Solving Differential Equations , 2019, AAAI Spring Symposium: MLPS.

[21]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[22]  Hongyu Shen,et al.  Enabling real-time multi-messenger astrophysics discoveries with deep learning , 2019, Nature Reviews Physics.

[23]  Jaime S. Cardoso,et al.  Machine Learning Interpretability: A Survey on Methods and Metrics , 2019, Electronics.

[24]  Kyle Chard,et al.  A data ecosystem to support machine learning in materials science , 2019, MRS Communications.

[25]  Brookhaven National Laboratory,et al.  Accelerating parameter inference with graphics processing units , 2019, Physical Review D.

[26]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[27]  Ian T. Foster,et al.  DLHub: Model and Data Serving for Science , 2018, 2019 IEEE International Parallel and Distributed Processing Symposium (IPDPS).

[28]  George Em Karniadakis,et al.  fPINNs: Fractional Physics-Informed Neural Networks , 2018, SIAM J. Sci. Comput..

[29]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.

[30]  Paris Perdikaris,et al.  Physics Informed Deep Learning (Part II): Data-driven Discovery of Nonlinear Partial Differential Equations , 2017, ArXiv.

[31]  Paris Perdikaris,et al.  Physics Informed Deep Learning (Part I): Data-driven Solutions of Nonlinear Partial Differential Equations , 2017, ArXiv.

[32]  A Erba,et al.  Large-Scale Condensed Matter DFT Simulations: Performance and Capabilities of the CRYSTAL Code. , 2017, Journal of chemical theory and computation.

[33]  Been Kim,et al.  Towards A Rigorous Science of Interpretable Machine Learning , 2017, 1702.08608.

[34]  Erik Schultes,et al.  The FAIR Guiding Principles for scientific data management and stewardship , 2016, Scientific Data.

[35]  A. P. Siebesma,et al.  Weather Forecasting Using GPU-Based Large-Eddy Simulations , 2015 .

[36]  杨鉴初 “Bulletin of the American Meteorological Society”杂志第32卷中文摘 , 2013 .

[37]  John Feo,et al.  Proceedings of the 9th conference on Computing Frontiers , 2012 .

[38]  Farhan Feroz,et al.  BAMBI: blind accelerated multimodal Bayesian inference , 2011, 1110.2997.

[39]  Mohamed Taher,et al.  Accelerating scientific applications using GPU's , 2009, 2009 4th International Design and Test Workshop (IDT).

[40]  Klaus Schulten,et al.  GPU acceleration of cutoff pair potentials for molecular modeling applications , 2008, CF '08.

[41]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[42]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[43]  R. Geroch Partial Differential Equations of Physics , 1996, gr-qc/9602055.