Domain Agnostic Fourier Neural Operators

Fourier neural operators (FNOs) can learn highly nonlinear mappings between function spaces, and have recently become a popular tool for learning responses of complex physical systems. However, to achieve good accuracy and efficiency, FNOs rely on the Fast Fourier transform (FFT), which is restricted to modeling problems on rectangular domains. To lift such a restriction and permit FFT on irregular geometries as well as topology changes, we introduce domain agnostic Fourier neural operator (DAFNO), a novel neural operator architecture for learning surrogates with irregular geometries and evolving domains. The key idea is to incorporate a smoothed characteristic function in the integral layer architecture of FNOs, and leverage FFT to achieve rapid computations, in such a way that the geometric information is explicitly encoded in the architecture. In our empirical evaluation, DAFNO has achieved state-of-the-art accuracy as compared to baseline neural operator models on two benchmark datasets of material modeling and airfoil simulation. To further demonstrate the capability and generalizability of DAFNO in handling complex domains with topology changes, we consider a brittle material fracture evolution problem. With only one training crack simulation sample, DAFNO has achieved generalizability to unseen loading scenarios and substantially different crack patterns from the trained scenario.

[1]  F. Bobaru,et al.  PeriFast/Dynamics: A MATLAB Code for Explicit Fast Convolution-based Peridynamic Analysis of Deformation and Fracture , 2023, Journal of Peridynamics and Nonlocal Modeling.

[2]  Yue Yu,et al.  INO: Invariant Neural Operators for Learning Complex Physical Systems with Momentum Conservation , 2022, AISTATS.

[3]  Daniel Z. Huang,et al.  Fourier Neural Operator with Learned Deformations for PDEs on General Geometries , 2022, ArXiv.

[4]  Colton J. Ross,et al.  Learning Deep Implicit Fourier Neural Operators (IFNOs) with Applications to Heterogeneous Material Modeling , 2022, Computer Methods in Applied Mechanics and Engineering.

[5]  Yong Zheng Ong,et al.  IAE-Net: Integral Autoencoders for Discretization-Invariant Learning , 2022, ArXiv.

[6]  G. Karniadakis,et al.  Interfacing Finite Elements with Deep Neural Operators for Fast Multiscale Modeling of Mechanics Problems , 2022, Computer methods in applied mechanics and engineering.

[7]  S. Silling,et al.  Nonlocal Kernel Network (NKN): a Stable and Resolution-Independent Deep Neural Network , 2022, J. Comput. Phys..

[8]  G. Karniadakis,et al.  A comprehensive and fair comparison of two neural operators (with practical extensions) based on FAIR data , 2021, Computer Methods in Applied Mechanics and Engineering.

[9]  Paul Bogdan,et al.  Multiwavelet-based Operator Learning for Differential Equations , 2021, NeurIPS.

[10]  Enrui Zhang,et al.  Simulating progressive intramural damage leading to aortic dissection using DeepONet: an operator–regression neural network , 2021, Journal of the Royal Society Interface.

[11]  Minglang Yin,et al.  Physics-informed neural networks (PINNs) for fluid mechanics: a review , 2021, Acta Mechanica Sinica.

[12]  Adam Larios,et al.  A general and fast convolution-based method for peridynamics: applications to elasticity and brittle fracture , 2021, Computer Methods in Applied Mechanics and Engineering.

[13]  Jay Pathak,et al.  One-shot learning for solution operators of partial differential equations , 2021, ArXiv.

[14]  Chung-Hao Lee,et al.  Manifold learning based data-driven modeling for soft biological tissues. , 2020, Journal of biomechanics.

[15]  Nikola B. Kovachki,et al.  Fourier Neural Operator for Parametric Partial Differential Equations , 2020, ICLR.

[16]  Nikola B. Kovachki,et al.  Multipole Graph Neural Operator for Parametric Partial Differential Equations , 2020, NeurIPS.

[17]  Kamyar Azizzadenesheli,et al.  Neural Operator: Graph Kernel Network for Partial Differential Equations , 2020, ICLR 2020.

[18]  George Em Karniadakis,et al.  Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators , 2019, Nature Machine Intelligence.

[19]  George Em Karniadakis,et al.  DeepONet: Learning nonlinear operators for identifying differential equations based on the universal approximation theorem of operators , 2019, ArXiv.

[20]  David Pfau,et al.  Ab-Initio Solution of the Many-Electron Schrödinger Equation with Deep Neural Networks , 2019, Physical Review Research.

[21]  Naftali Tishby,et al.  Machine learning and the physical sciences , 2019, Reviews of Modern Physics.

[22]  E Weinan,et al.  Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics , 2017, Physical review letters.

[23]  Philippe H. Geubelle,et al.  Handbook of Peridynamic Modeling , 2017 .

[24]  John A. Evans,et al.  Immersogeometric cardiovascular fluid-structure interaction analysis with divergence-conforming B-splines. , 2017, Computer methods in applied mechanics and engineering.

[25]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[26]  Erdogan Madenci,et al.  Predicting crack propagation with peridynamics: a comparative study , 2011 .

[27]  T. Belytschko,et al.  X‐FEM in isogeometric analysis for linear fracture mechanics , 2011 .

[28]  F. Bobaru,et al.  Studies of dynamic crack propagation and crack branching with peridynamics , 2010 .

[29]  Matteo Astorino,et al.  Computational analysis of an aortic valve jet with Lagrangian coherent structures. , 2010, Chaos.

[30]  S. Roux,et al.  “Finite-Element” Displacement Fields Analysis from Digital Images: Application to Portevin–Le Châtelier Bands , 2006 .

[31]  D. Benson,et al.  Contact in a multi-material Eulerian finite element formulation , 2004 .

[32]  E. Kuhl,et al.  An arbitrary Lagrangian Eulerian finite‐element approach for fluid–structure interaction phenomena , 2003 .

[33]  Jamshid Ghaboussi,et al.  Autoprogressive training of neural network constitutive models , 1998 .

[34]  Chi-Wang Shu,et al.  On the Gibbs Phenomenon and Its Resolution , 1997, SIAM Rev..

[35]  James H. Garrett,et al.  Knowledge-Based Modeling of Material Behavior with Neural Networks , 1992 .

[36]  Sylvia J. Day,et al.  Developments in Obtaining Transient Response Using Fourier Transforms , 1965 .

[37]  A. Wills,et al.  Physics-informed machine learning , 2021, Nature Reviews Physics.

[38]  Stewart Andrew Silling,et al.  Dynamic fracture modeling with a meshfree peridynamic code , 2003 .

[39]  J. C. Simo,et al.  An augmented lagrangian treatment of contact problems involving friction , 1992 .