PhyGeoNet: Physics-informed geometry-adaptive convolutional neural networks for solving parameterized steady-state PDEs on irregular domain

Abstract Recently, the advent of deep learning has spurred interest in the development of physics-informed neural networks (PINN) for efficiently solving partial differential equations (PDEs), particularly in a parametric setting. Among all different classes of deep neural networks, the convolutional neural network (CNN) has attracted increasing attention in the scientific machine learning community, since the parameter-sharing feature in CNN enables efficient learning for problems with large-scale spatiotemporal fields. However, one of the biggest challenges is that CNN only can handle regular geometries with image-like format (i.e., rectangular domains with uniform grids). In this paper, we propose a novel physics-constrained CNN learning architecture, aiming to learn solutions of parametric PDEs on irregular domains without any labeled data. In order to leverage powerful classic CNN backbones, elliptic coordinate mapping is introduced to enable coordinate transforms between the irregular physical domain and regular reference domain. The proposed method has been assessed by solving a number of steady-state PDEs on irregular domains, including heat equations, Navier-Stokes equations, and Poisson equations with parameterized boundary conditions, varying geometries, and spatially-varying source fields. Moreover, the proposed method has also been compared against the state-of-the-art PINN with fully-connected neural network (FC-NN) formulation. The numerical results demonstrate the effectiveness of the proposed approach and exhibit notable superiority over the FC-NN based PINN in terms of efficiency and accuracy.

[1]  Gang Bao,et al.  Weak Adversarial Networks for High-dimensional Partial Differential Equations , 2019, J. Comput. Phys..

[2]  George Em Karniadakis,et al.  A composite neural network that learns from multi-fidelity data: Application to function approximation and inverse PDE problems , 2019, J. Comput. Phys..

[3]  Karthik Kashinath,et al.  Enforcing statistical constraints in generative adversarial networks for modeling chaotic dynamical systems , 2019, J. Comput. Phys..

[4]  Markus H. Gross,et al.  Deep Fluids: A Generative Network for Parameterized Fluid Simulations , 2018, Comput. Graph. Forum.

[5]  B. Launder,et al.  The numerical computation of turbulent flows , 1990 .

[6]  Jacques Miriel,et al.  Radiant ceiling panel heating–cooling systems: experimental and simulated study of the performances, thermal comfort and energy consumptions , 2002 .

[7]  Jinlong Wu,et al.  Physics-informed machine learning approach for reconstructing Reynolds stress modeling discrepancies based on DNS data , 2016, 1606.07987.

[8]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[9]  Jian-Xun Wang,et al.  Physics-constrained bayesian neural network for fluid flow reconstruction with sparse and noisy data , 2020, Theoretical and Applied Mechanics Letters.

[10]  Heng Li,et al.  Deep Learning of Subsurface Flow via Theory-guided Neural Network , 2019, ArXiv.

[11]  Hadi Meidani,et al.  A deep learning solution approach for high-dimensional random differential equations , 2019, Probabilistic Engineering Mechanics.

[12]  Todd A. Oliver,et al.  Solving differential equations using deep neural networks , 2020, Neurocomputing.

[13]  Ribana Roscher,et al.  Explainable Machine Learning for Scientific Insights and Discoveries , 2019, IEEE Access.

[14]  Danny Z. Chen,et al.  Flow Field Reduction Via Reconstructing Vector Data From 3-D Streamlines Using Deep Learning , 2019, IEEE Computer Graphics and Applications.

[15]  Li Guo,et al.  SSR-VFD: Spatial Super-Resolution for Vector Field Data Analysis and Visualization , 2020, 2020 IEEE Pacific Visualization Symposium (PacificVis).

[16]  Michael Chertkov,et al.  Embedding Hard Physical Constraints in Neural Network Coarse-Graining of 3D Turbulence , 2020, 2002.00021.

[17]  G. Karniadakis,et al.  Physics-informed neural networks for high-speed flows , 2020, Computer Methods in Applied Mechanics and Engineering.

[18]  Yibo Yang,et al.  Physics-Informed Neural Networks for Cardiac Activation Mapping , 2020, Frontiers in Physics.

[19]  Dimitrios I. Fotiadis,et al.  Artificial neural networks for solving ordinary and partial differential equations , 1997, IEEE Trans. Neural Networks.

[20]  Petros Koumoutsakos,et al.  Machine Learning for Fluid Mechanics , 2019, Annual Review of Fluid Mechanics.

[21]  Timon Rabczuk,et al.  An Energy Approach to the Solution of Partial Differential Equations in Computational Mechanics via Machine Learning: Concepts, Implementation and Applications , 2019, Computer Methods in Applied Mechanics and Engineering.

[22]  Aleksandar Jemcov,et al.  OpenFOAM: A C++ Library for Complex Physics Simulations , 2007 .

[23]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[24]  Ke Li,et al.  D3M: A Deep Domain Decomposition Method for Partial Differential Equations , 2020, IEEE Access.

[25]  George Em Karniadakis,et al.  Hidden fluid mechanics: Learning velocity and pressure fields from flow visualizations , 2020, Science.

[26]  Michael S. Triantafyllou,et al.  Deep learning of vortex-induced vibrations , 2018, Journal of Fluid Mechanics.

[27]  Joe F. Thompson,et al.  Automatic numerical generation of body-fitted curvilinear coordinate system for field containing any number of arbitrary two-dimensional bodies , 1974 .

[28]  Paris Perdikaris,et al.  Multiscale Modeling Meets Machine Learning: What Can We Learn? , 2019 .

[29]  Jinchao Xu,et al.  MgNet: A unified framework of multigrid and convolutional neural network , 2019, Science China Mathematics.

[30]  Nicholas Geneva,et al.  Modeling the Dynamics of PDE Systems with Physics-Constrained Deep Auto-Regressive Networks , 2019, J. Comput. Phys..

[31]  Vanessa Hertzog,et al.  Computational Fluid Mechanics And Heat Transfer , 2016 .

[32]  Kaj Nyström,et al.  A unified deep artificial neural network approach to partial differential equations in complex geometries , 2017, Neurocomputing.

[33]  Teng Wu,et al.  Knowledge-enhanced deep learning for simulation of tropical cyclone boundary-layer winds , 2019, Journal of Wind Engineering and Industrial Aerodynamics.

[34]  Paris Perdikaris,et al.  Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data , 2019, J. Comput. Phys..

[35]  Ali Ramadhan,et al.  Universal Differential Equations for Scientific Machine Learning , 2020, ArXiv.

[36]  Masayuki Numao,et al.  Physics-Guided Neural Network with Model Discrepancy Based on Upper Troposphere Wind Prediction , 2019, 2019 18th IEEE International Conference On Machine Learning And Applications (ICMLA).

[37]  Karthik Duraisamy,et al.  Multi-level Convolutional Autoencoder Networks for Parametric Prediction of Spatio-temporal Dynamics , 2019, Computer Methods in Applied Mechanics and Engineering.

[38]  C. Rhie,et al.  Numerical Study of the Turbulent Flow Past an Airfoil with Trailing Edge Separation , 1983 .

[39]  Karthik Duraisamy,et al.  Prediction of aerodynamic flow fields using convolutional neural networks , 2019, Computational Mechanics.

[40]  J. Anderson,et al.  Computational fluid dynamics : the basics with applications , 1995 .

[41]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[42]  Jian-Xun Wang,et al.  A bi-fidelity surrogate modeling approach for uncertainty propagation in three-dimensional hemodynamic simulations , 2019, 1908.10197.

[43]  Zhiwei Fang,et al.  Deep Physical Informed Neural Networks for Metamaterial Design , 2020, IEEE Access.

[44]  Luning Sun,et al.  Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data , 2019, Computer Methods in Applied Mechanics and Engineering.

[45]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[46]  P. Perdikaris,et al.  Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks , 2019 .

[47]  George Em Karniadakis,et al.  Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problems , 2018, J. Comput. Phys..

[48]  Balaji Srinivasan,et al.  Physics Informed Extreme Learning Machine (PIELM) - A rapid method for the numerical solution of partial differential equations , 2019, Neurocomputing.

[49]  Yan Wang,et al.  Multi-Fidelity Physics-Constrained Neural Network and Its Application in Materials Modeling , 2019, Journal of Mechanical Design.

[50]  Jitesh H. Panchal,et al.  Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks , 2019, J. Comput. Phys..

[51]  Sambuddha Ghosal,et al.  Generative Models for Solving Nonlinear Partial Differential Equations , 2019 .

[52]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[53]  D. Gallo,et al.  Uncertainty propagation of phase contrast-MRI derived inlet boundary conditions in computational hemodynamics models of thoracic aorta , 2017, Computer methods in biomechanics and biomedical engineering.

[54]  Hyuk Lee,et al.  Neural algorithm for solving differential equations , 1990 .

[55]  Liu Yang,et al.  Physics-Informed Generative Adversarial Networks for Stochastic Differential Equations , 2018, SIAM J. Sci. Comput..

[56]  Jun Tao,et al.  FlowNet: A Deep Learning Framework for Clustering and Selection of Streamlines and Stream Surfaces , 2020, IEEE Transactions on Visualization and Computer Graphics.

[57]  Ruiyang Zhang,et al.  Machine Learning Approach for Sequence Clustering with Applications to Ground-Motion Selection , 2020, Journal of Engineering Mechanics.

[58]  Wei Li,et al.  Convolutional Neural Networks for Steady Flow Approximation , 2016, KDD.

[59]  Hessam Babaee,et al.  Deep Learning of Turbulent Scalar Mixing , 2018, Physical Review Fluids.

[60]  George Em Karniadakis,et al.  Learning and meta-learning of stochastic advection–diffusion–reaction systems from sparse measurements , 2019, European Journal of Applied Mathematics.

[61]  Arnulf Jentzen,et al.  Solving high-dimensional partial differential equations using deep learning , 2017, Proceedings of the National Academy of Sciences.

[62]  Heng Xiao,et al.  Physics-Informed Machine Learning for Predictive Turbulence Modeling: Towards a Complete Framework. , 2016 .

[63]  Justin A. Sirignano,et al.  DGM: A deep learning algorithm for solving partial differential equations , 2017, J. Comput. Phys..

[64]  Dimitris G. Papageorgiou,et al.  Neural-network methods for boundary value problems with irregular boundaries , 2000, IEEE Trans. Neural Networks Learn. Syst..

[65]  Ravi Mahajan,et al.  On-chip cooling by superlattice-based thin-film thermoelectrics. , 2009, Nature nanotechnology.

[66]  Chaoli Wang,et al.  TSR-TVD: Temporal Super-Resolution for Time-Varying Data Analysis and Visualization , 2020, IEEE Transactions on Visualization and Computer Graphics.

[67]  Kaj Nyström,et al.  Data-driven discovery of PDEs in complex datasets , 2018, J. Comput. Phys..

[68]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[69]  Yang Liu,et al.  Three-dimensional convolutional neural network (3D-CNN) for heterogeneous material homogenization , 2020, Computational Materials Science.

[70]  Paris Perdikaris,et al.  Adversarial Uncertainty Quantification in Physics-Informed Neural Networks , 2018, J. Comput. Phys..

[71]  Yi Ren,et al.  FEA-Net: A Deep Convolutional Neural Network With PhysicsPrior For Efficient Data Driven PDE Learning , 2019, AIAA Scitech 2019 Forum.

[72]  Jichun Wu,et al.  Integration of adversarial autoencoders with residual dense convolutional networks for inversion of solute transport in non-Gaussian conductivity fields , 2019, ArXiv.

[73]  Bin Dong,et al.  PDE-Net 2.0: Learning PDEs from Data with A Numeric-Symbolic Hybrid Deep Network , 2018, J. Comput. Phys..