A deep learning framework for solution and discovery in solid mechanics

We present the application of a class of deep learning, known as Physics Informed Neural Networks (PINN), to learning and discovery in solid mechanics. We explain how to incorporate the momentum balance and constitutive relations into PINN, and explore in detail the application to linear elasticity, and illustrate its extension to nonlinear problems through an example that showcases von~Mises elastoplasticity. While common PINN algorithms are based on training one deep neural network (DNN), we propose a multi-network model that results in more accurate representation of the field variables. To validate the model, we test the framework on synthetic data generated from analytical and numerical reference solutions. We study convergence of the PINN model, and show that Isogeometric Analysis (IGA) results in superior accuracy and convergence characteristics compared with classic low-order Finite Element Method (FEM). We also show the applicability of the framework for transfer learning, and find vastly accelerated convergence during network re-training. Finally, we find that honoring the physics leads to improved robustness: when trained only on a few parameters, we find that the PINN model can accurately predict the solution for a wide range of parameters new to the network---thus pointing to an important application of this framework to sensitivity analysis and surrogate modeling.

[1]  O. C. Zienkiewicz,et al.  Elasto‐plastic solutions of engineering problems ‘initial stress’, finite element approach , 1969 .

[2]  Daniel W. Davies,et al.  Machine learning for molecular and materials science , 2018, Nature.

[3]  T. Hughes,et al.  Isogeometric analysis : CAD, finite elements, NURBS, exact geometry and mesh refinement , 2005 .

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Thomas J. R. Hughes,et al.  Isogeometric Analysis: Toward Integration of CAD and FEA , 2009 .

[6]  Sanguthevar Rajasekaran,et al.  Accelerating materials property predictions using machine learning , 2013, Scientific Reports.

[7]  Barak A. Pearlmutter,et al.  Automatic differentiation in machine learning: a survey , 2015, J. Mach. Learn. Res..

[8]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[9]  Subra Suresh,et al.  Deep elastic strain engineering of bandgap through machine learning , 2019, Proceedings of the National Academy of Sciences.

[10]  Petros Koumoutsakos,et al.  Machine Learning for Fluid Mechanics , 2019, Annual Review of Fluid Mechanics.

[11]  Andrew J. Meade,et al.  The numerical solution of linear ordinary differential equations by feedforward neural networks , 1994 .

[12]  M Mozaffar,et al.  Deep learning predicts path-dependent plasticity , 2019, Proceedings of the National Academy of Sciences.

[13]  Richard G. Baraniuk,et al.  Data-driven semi-supervised and supervised learning algorithms for health monitoring of pipes , 2019, Mechanical Systems and Signal Processing.

[14]  John A. Evans,et al.  Isogeometric analysis using T-splines , 2010 .

[15]  Steven L. Brunton,et al.  Methods for data-driven multiscale model discovery for materials , 2019, Journal of Physics: Materials.

[16]  Peter Gerstoft,et al.  Machine Learning in Seismology: Turning Data into Insights , 2018, Seismological Research Letters.

[17]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[18]  R. A. Guyer,et al.  Machine Learning Reveals the State of Intermittent Frictional Dynamics in a Sheared Granular Fault , 2019, Geophysical Research Letters.

[19]  F. Viégas,et al.  Deep learning of aftershock patterns following large earthquakes , 2018, Nature.

[20]  Dimitrios I. Fotiadis,et al.  Artificial neural networks for solving ordinary and partial differential equations , 1997, IEEE Trans. Neural Networks.

[21]  Zheng Zhang,et al.  MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems , 2015, ArXiv.

[22]  Stephan Hoyer,et al.  Learning data-driven discretizations for partial differential equations , 2018, Proceedings of the National Academy of Sciences.

[23]  Clara E Yoon,et al.  Earthquake detection through computationally efficient similarity search , 2015, Science Advances.

[24]  Arnulf Jentzen,et al.  Solving high-dimensional partial differential equations using deep learning , 2017, Proceedings of the National Academy of Sciences.

[25]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[26]  M. P. Brenner,et al.  Perspective on machine learning for advancing fluid mechanics , 2019, Physical Review Fluids.

[27]  William Stafford Noble,et al.  Machine learning applications in genetics and genomics , 2015, Nature Reviews Genetics.

[28]  Jamshid Ghaboussi,et al.  New nested adaptive neural networks (NANN) for constitutive modeling , 1998 .

[29]  Paris Perdikaris,et al.  Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data , 2019, J. Comput. Phys..

[30]  Peter Stone,et al.  Transfer Learning for Reinforcement Learning Domains: A Survey , 2009, J. Mach. Learn. Res..

[31]  Steven L. Brunton,et al.  Data-Driven Identification of Parametric Partial Differential Equations , 2018, SIAM J. Appl. Dyn. Syst..

[32]  Maarten V. de Hoop,et al.  Machine learning for data-driven discovery in solid Earth geoscience , 2019, Science.

[33]  Surya R. Kalidindi,et al.  Microstructure informatics using higher-order statistics and efficient data-mining protocols , 2011 .

[34]  Dimitris G. Papageorgiou,et al.  Neural-network methods for boundary value problems with irregular boundaries , 2000, IEEE Trans. Neural Networks Learn. Syst..

[35]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..