Physics-Informed Spatiotemporal Deep Learning for Emulating Coupled Dynamical Systems

Accurately predicting the propagation of fractures, or cracks, in brittle materials is an important problem in evaluating the reliability of objects such as airplane wings and concrete structures. Efficient crack propagation emulators that can run in a fraction of the time of high-fidelity physics simulations are needed. A primary challenge of modeling fracture networks and the stress propagation in materials is that the cracks themselves introduce discontinuities, making existing partial differential equation (PDE) discovery models unusable. Furthermore, existing physics-informed neural networks are limited to learning PDEs with either constant initial conditions or changes that do not depend on the PDE outputs at the previous time. In fracture propagation, at each timestep, there is a damage field and a stress field; where the stress causes further damage in the material. The stress field at the next time step is affected by the discontinuities introduced by the propagated damage. Thus, both stress and damage fields are heavily dependent on each other; which makes modeling the system difficult. Spatiotemporal LSTMs have shown promise in the area of real-world video prediction. Building on this success, we approach this physics emulation problem as a video generation problem: training the model on simulation data to learn the underlying dynamic behavior. Our novel deep learning model is a Physics-Informed Spatiotemporal LSTM, that uses modified loss functions and partial derivatives from the stress field to build a data-driven coupled dynamics emulator. Our approach outperforms other neural net architectures at predicting subsequent frames of a simulation, enabling fast and accurate emulation of fracture propagation. Introduction and Motivation Brittle materials fail suddenly with little warning due to the growth of micro-fractures that quickly propagate and coalesce. Prediction of fracture propagation in brittle materials is a multi-scale modeling problem whose time dynamics are well understood at the micro-scale but do not scale well to the macro-scale necessary for practical evaluation of materials under strain (White 2006; Hyman et al. 2016; Kim et al. 2014). Fracture formation in brittle materials Copyright c © 2020 for this paper by its authors. Use permitted under Creative Commons License Attribution International (CC BY 4.0). Continu um mod el Micro cracks and loading in one cell Constitutive model for summary statistics Emulate dynamics Damage evolution accounts for crack interactions

[1]  Arnulf Jentzen,et al.  Solving high-dimensional partial differential equations using deep learning , 2017, Proceedings of the National Academy of Sciences.

[2]  Yann LeCun,et al.  Deep multi-scale video prediction beyond mean square error , 2015, ICLR.

[3]  Barak A. Pearlmutter Learning State Space Trajectories in Recurrent Neural Networks , 1989, Neural Computation.

[4]  Antonio Munjiza,et al.  Validation of a three-dimensional Finite-Discrete Element Method using experimental results of the Split Hopkinson Pressure Bar test , 2014 .

[5]  Philip S. Yu,et al.  PredRNN++: Towards A Resolution of the Deep-in-Time Dilemma in Spatiotemporal Predictive Learning , 2018, ICML.

[6]  Ronald J. Williams,et al.  Gradient-based learning algorithms for recurrent networks and their computational complexity , 1995 .

[7]  H. S. Viswanathan,et al.  Understanding hydraulic fracturing: a multi-scale problem , 2016, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[8]  Charbel Farhat,et al.  Neural Networks Predict Fluid Dynamics Solutions from Tiny Datasets , 2019, ArXiv.

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Bernhard Schölkopf,et al.  Flexible Spatio-Temporal Networks for Video Prediction , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Satish Karra,et al.  dfnWorks: A discrete fracture network framework for modeling subsurface flow and transport , 2015, Comput. Geosci..

[13]  Nils Thürey,et al.  Latent Space Physics: Towards Learning the Temporal Evolution of Fluid Flow , 2018, Comput. Graph. Forum.

[14]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[15]  Hari S. Viswanathan,et al.  Statistically informed upscaling of damage evolution in brittle materials , 2019, Theoretical and Applied Fracture Mechanics.

[16]  Wei Li,et al.  Convolutional Neural Networks for Steady Flow Approximation , 2016, KDD.

[17]  C. Lanczos An iteration method for the solution of the eigenvalue problem of linear differential and integral operators , 1950 .

[18]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[19]  Paul White,et al.  Review of Methods and Approaches for the Structural Risk Assessment of Aircraft , 2006 .

[20]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[21]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition , 2012 .

[22]  Rob Fergus,et al.  Learning Physical Intuition of Block Towers by Example , 2016, ICML.

[23]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[24]  Benjamin Schrauwen,et al.  Training and Analysing Deep Recurrent Neural Networks , 2013, NIPS.

[25]  George J. Moridis,et al.  Fracture Propagation, Fluid Flow, and Geomechanics of Water-Based Hydraulic Fracturing in Shale Gas Systems and Electromagnetic Geophysical Monitoring of Fluid Migration , 2014 .

[26]  Markus H. Gross,et al.  Deep Fluids: A Generative Network for Parameterized Fluid Simulations , 2018, Comput. Graph. Forum.

[27]  Saibal Mukhopadhyay,et al.  HybridNet: Integrating Model-based and Data-driven Learning to Predict Evolution of Dynamical Systems , 2018, CoRL.