A mesh-free method for interface problems using the deep learning approach

Abstract In this paper, we propose a mesh-free method to solve interface problems using the deep learning approach. Two types of PDEs are considered. The first one is an elliptic PDE with a discontinuous and high-contrast coefficient. While the second one is a linear elasticity equation with discontinuous stress tensor. In both cases, we represent the solutions of the PDEs using the deep neural networks (DNNs) and formulate the PDEs into variational problems, which can be solved via the deep learning approach. To deal with inhomogeneous boundary conditions, we use a shallow neural network to approximate the boundary conditions. Instead of using an adaptive mesh refinement method or specially designed basis functions or numerical schemes to compute the PDE solutions, the proposed method has the advantages that it is easy to implement and is mesh-free. Finally, we present numerical results to demonstrate the accuracy and efficiency of the proposed method for interface problems.

[1]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[2]  Paris Perdikaris,et al.  Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data , 2019, J. Comput. Phys..

[3]  Yalchin Efendiev,et al.  Deep Multiscale Model Learning , 2018, J. Comput. Phys..

[4]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[5]  R. LeVeque,et al.  A comparison of the extended finite element method with the immersed interface method for elliptic equations with discontinuous coefficients and singular sources , 2006 .

[6]  Guo-Wei Wei,et al.  Matched interface and boundary method for elasticity interface problems , 2014, J. Comput. Appl. Math..

[7]  E Weinan,et al.  The Deep Ritz Method: A Deep Learning-Based Numerical Algorithm for Solving Variational Problems , 2017, Communications in Mathematics and Statistics.

[8]  Arnulf Jentzen,et al.  Solving high-dimensional partial differential equations using deep learning , 2017, Proceedings of the National Academy of Sciences.

[9]  Allan Pinkus,et al.  Approximation theory of the MLP model in neural networks , 1999, Acta Numerica.

[10]  Dmitry Yarotsky,et al.  Error bounds for approximations with deep ReLU networks , 2016, Neural Networks.

[11]  C. Peskin.  Numerical analysis of blood flow in the heart , 1977 .

[12]  C. Peskin.  The immersed boundary method , 2002, Acta Numerica.

[13]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[14]  Qiang Du,et al.  New error bounds for deep networks using sparse grids. , 2017, 1712.08688.

[15]  Hyuk Lee,et al.  Neural algorithm for solving differential equations , 1990 .

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Andrew J. Meade,et al.  The numerical solution of linear ordinary differential equations by feedforward neural networks , 1994 .

[18]  George Cybenko,et al.  Approximation by superpositions of a sigmoidal function , 1989, Math. Control. Signals Syst..

[19]  Jitesh H. Panchal,et al.  Simulator-free solution of high-dimensional stochastic elliptic partial differential equations using deep neural networks , 2019, J. Comput. Phys..

[20]  Xingzhou Yang,et al.  The immersed interface method for elasticity problems with interfaces , 2002 .

[21]  Qiang Du,et al.  New Error Bounds for Deep ReLU Networks Using Sparse Grids , 2017, SIAM J. Math. Data Sci..

[22]  Lexing Ying,et al.  Solving parametric PDE problems with artificial neural networks , 2017, European Journal of Applied Mathematics.

[23]  Yalchin Efendiev,et al.  Multiscale Finite Element Methods: Theory and Applications , 2009 .

[24]  S. Osher,et al.  A Non-oscillatory Eulerian Approach to Interfaces in Multimaterial Flows (the Ghost Fluid Method) , 1999 .

[25]  Dimitrios I. Fotiadis,et al.  Artificial neural networks for solving ordinary and partial differential equations , 1997, IEEE Trans. Neural Networks.

[26]  Rüdiger Verfürth,et al.  Adaptive finite element methods for elliptic equations with non-smooth coefficients , 2000, Numerische Mathematik.

[27]  J. Zou,et al.  Finite element methods and their convergence for elliptic and parabolic interface problems , 1998 .

[28]  Justin A. Sirignano,et al.  DGM: A deep learning algorithm for solving partial differential equations , 2017, J. Comput. Phys..

[29]  Nadav Cohen,et al.  On the Expressive Power of Deep Learning: A Tensor Analysis , 2015, COLT 2016.

[30]  Jinchao Xu,et al.  Relu Deep Neural Networks and Linear Finite Elements , 2018, Journal of Computational Mathematics.

[31]  Bo Li,et al.  Immersed-Interface Finite-Element Methods for Elliptic Interface Problems with Nonhomogeneous Jump Conditions , 2007, SIAM J. Numer. Anal..

[32]  Yalchin Efendiev,et al.  Multiscale finite element methods for high-contrast problems using local spectral basis functions , 2011, J. Comput. Phys..

[33]  Zhiwen Zhang,et al.  A minimal mechanosensing model predicts keratocyte evolution on flexible substrates , 2018, Journal of the Royal Society Interface.

[34]  Ivo Babuska,et al.  The finite element method for elliptic equations with discontinuous coefficients , 1970, Computing.

[35]  Ivan G. Graham,et al.  A new multiscale finite element method for high-contrast elliptic interface problems , 2010, Math. Comput..

[36]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[37]  G. Karniadakis,et al.  Multistep Neural Networks for Data-driven Discovery of Nonlinear Dynamical Systems , 2018, 1801.01236.

[38]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[39]  Nicholas Zabaras,et al.  Bayesian Deep Convolutional Encoder-Decoder Networks for Surrogate Modeling and Uncertainty Quantification , 2018, J. Comput. Phys..

[40]  E Weinan,et al.  Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential Equations , 2017, Communications in Mathematics and Statistics.

[41]  S. W. Ellacott,et al.  Aspects of the numerical analysis of neural networks , 1994, Acta Numerica.

[42]  Tao Lin,et al.  New Cartesian grid methods for interface problems using the finite element formulation , 2003, Numerische Mathematik.