Scattering with Neural Operators

Recent advances in machine learning establish the ability of certain neural-network architectures called neural operators to approximate maps between function spaces. Motivated by a prospect of employing them in fundamental physics, we examine applications to scattering processes in quantum mechanics. We use an iterated variant of Fourier neural operators to learn the physics of Schr\"odinger operators, which map from the space of initial wave functions and potentials to the final wave functions. These deep operator learning ideas are put to test in two concrete problems: a neural operator predicting the time evolution of a wave packet scattering off a central potential in $1+1$ dimensions, and the double-slit experiment in $2+1$ dimensions. At inference, neural operators can become orders of magnitude more efficient compared to traditional finite-difference solvers.

[1]  Nikola B. Kovachki,et al.  Multi-Grid Tensorized Fourier Neural Operator for High-Resolution PDEs , 2023, ArXiv.

[2]  G. Karniadakis,et al.  Real-time Inference and Extrapolation via a Diffusion-inspired Temporal Transformer Operator (DiTTO) , 2023, 2307.09072.

[3]  Youzuo Lin,et al.  Fourier-DeepONet: Fourier-enhanced deep operator networks for full waveform inversion with improved accuracy, generalizability, and robustness , 2023, Computer Methods in Applied Mechanics and Engineering.

[4]  Yanhua O. Yuan,et al.  Fourier-MIONet: Fourier-enhanced multiple-input neural operators for multiphase modeling of geological carbon sequestration , 2023, ArXiv.

[5]  G. Karniadakis,et al.  Reliable extrapolation of deep neural operators informed by physics or sparse observations , 2022, SSRN Electronic Journal.

[6]  L. Wolf,et al.  Semi-supervised Learning of Partial Differential Operators and Dynamical Flows , 2022, UAI.

[7]  Daniel Z. Huang,et al.  Fourier Neural Operator with Learned Deformations for PDEs on General Geometries , 2022, J. Mach. Learn. Res..

[8]  G. Karniadakis,et al.  Physics-Informed Deep Neural Operator Networks , 2022, ArXiv.

[9]  Tim De Ryck,et al.  Generic bounds on the approximation error for physics-informed (and) operator learning , 2022, NeurIPS.

[10]  K. Azizzadenesheli,et al.  Generative Adversarial Neural Operators , 2022, Trans. Mach. Learn. Res..

[11]  K. Azizzadenesheli,et al.  U-NO: U-shaped Neural Operators , 2022, Trans. Mach. Learn. Res..

[12]  Steven G. Johnson,et al.  Multifidelity deep neural operators for efficient learning of partial differential equations with application to fast inverse design of nanoscale heat transport , 2022, Physical Review Research.

[13]  T. Neumann,et al.  Computational Challenges for Multi-loop Collider Phenomenology , 2022, Computing and Software for Big Science.

[14]  D. Whiteson,et al.  Machine learning and LHC event generation , 2022, SciPost Physics.

[15]  S. Weinzierl,et al.  The Path forward to N$^3$LO , 2022, 2203.06730.

[16]  Lu Lu,et al.  MIONet: Learning multiple-input operators via tensor product , 2022, SIAM J. Sci. Comput..

[17]  David Shih,et al.  Machine learning in the search for new fundamental physics , 2021, Nature Reviews Physics.

[18]  Bryan Catanzaro,et al.  Adaptive Fourier Neural Operators: Efficient Token Mixers for Transformers , 2021, ArXiv.

[19]  G. Karniadakis,et al.  A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data , 2021, Computer Methods in Applied Mechanics and Engineering.

[20]  Paul Bogdan,et al.  Multiwavelet-based Operator Learning for Differential Equations , 2021, NeurIPS.

[21]  Nikola B. Kovachki,et al.  Neural Operator: Learning Maps Between Function Spaces , 2021, ArXiv.

[22]  Siddhartha Mishra,et al.  On universal approximation and error bounds for Fourier Neural Operators , 2021, J. Mach. Learn. Res..

[23]  Shuhao Cao.  Choose a Transformer: Fourier or Galerkin , 2021, NeurIPS.

[24]  Paris Perdikaris,et al.  Learning the solution operator of parametric partial differential equations with physics-informed DeepONets , 2021, Science advances.

[25]  George Em Karniadakis,et al.  Convergence rate of DeepONets for learning operators arising from advection-diffusion equations , 2021, ArXiv.

[26]  George Em Karniadakis,et al.  Error estimates for DeepOnets: A deep learning framework in infinite dimensions , 2021, Transactions of Mathematics and Its Applications.

[27]  Nikola B. Kovachki,et al.  Fourier Neural Operator for Parametric Partial Differential Equations , 2020, ICLR.

[28]  George Em Karniadakis,et al.  DeepM&Mnet: Inferring the electroconvection multiphysics fields based on operator approximation by neural networks , 2020, J. Comput. Phys..

[29]  Nikola B. Kovachki,et al.  Multipole Graph Neural Operator for Parametric Partial Differential Equations , 2020, NeurIPS.

[30]  Nikola B. Kovachki,et al.  Model Reduction and Neural Networks for Parametric PDEs , 2020, The SMAI journal of computational mathematics.

[31]  Kamyar Azizzadenesheli,et al.  Neural Operator: Graph Kernel Network for Partial Differential Equations , 2020, ICLR 2020.

[32]  George Em Karniadakis,et al.  Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators , 2019, Nature Machine Intelligence.

[33]  Lucy Rosenbloom.  arXiv , 2019, The Charleston Advisor.

[34]  Naftali Tishby,et al.  Machine learning and the physical sciences , 2019, Reviews of Modern Physics.

[35]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[36]  Frank Hutter,et al.  Decoupled Weight Decay Regularization , 2017, ICLR.

[37]  Razvan Pascanu,et al.  Sobolev Training for Neural Networks , 2017, NIPS.

[38]  Hong Chen,et al.  Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems , 1995, IEEE Trans. Neural Networks.

[39]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[40]  L. Sehgal,et al.  Γ and B , 2004 .

[41]  and as an in , 2022 .