Physics-Informed Multi-LSTM Networks for Metamodeling of Nonlinear Structures

This paper introduces an innovative physics-informed deep learning framework for metamodeling of nonlinear structural systems with scarce data. The basic concept is to incorporate physics knowledge (e.g., laws of physics, scientific principles) into deep long short-term memory (LSTM) networks, which boosts the learning within a feasible solution space. The physics constraints are embedded in the loss function to enforce the model training which can accurately capture latent system nonlinearity even with very limited available training datasets. Specifically for dynamic structures, physical laws of equation of motion, state dependency and hysteretic constitutive relationship are considered to construct the physics loss. In particular, two physics-informed multi-LSTM network architectures are proposed for structural metamodeling. The satisfactory performance of the proposed framework is successfully demonstrated through two illustrative examples (e.g., nonlinear structures subjected to ground motion excitation). It turns out that the embedded physics can alleviate overfitting issues, reduce the need of big training datasets, and improve the robustness of the trained model for more reliable prediction. As a result, the physics-informed deep learning paradigm outperforms classical non-physics-guided data-driven neural networks.

[1]  Maziar Raissi,et al.  Deep Hidden Physics Models: Deep Learning of Nonlinear Partial Differential Equations , 2018, J. Mach. Learn. Res..

[2]  James M. W. Brownjohn,et al.  Dynamic Assessment of Curved Cable-Stayed Bridge by Model Updating , 2000 .

[3]  Manolis Papadrakakis,et al.  Neural network based prediction schemes of the non-linear seismic response of 3D buildings , 2012, Adv. Eng. Softw..

[4]  Elisa D. Sotelino,et al.  Nonlinear Finite Element for Reinforced Concrete Slabs , 2005 .

[5]  Stephen A. Billings,et al.  International Journal of Control , 2004 .

[6]  George E. P. Box,et al.  Empirical Model‐Building and Response Surfaces , 1988 .

[7]  Kun Wang,et al.  A multiscale multi-permeability poroplasticity model linked by recursive homogenizations and deep learning , 2018, Computer Methods in Applied Mechanics and Engineering.

[8]  Jerzy Małachowski,et al.  Finite element analysis of vehicle-bridge interaction , 2006 .

[9]  André I. Khuri,et al.  Response surface methodology , 2010 .

[10]  Lakhmi C. Jain,et al.  Recurrent Neural Networks: Design and Applications , 1999 .

[11]  Jian Zhang,et al.  Advanced Markov Chain Monte Carlo Approach for Finite Element Calibration under Uncertainty , 2013, Comput. Aided Civ. Infrastructure Eng..

[12]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[13]  Carlo L. Bottasso,et al.  Structural optimization of wind turbine rotor blades by multilevel sectional/multibody/3D-FEM analysis , 2013, Multibody System Dynamics.

[14]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[15]  Ruiyang Zhang,et al.  Shake table real‐time hybrid simulation techniques for the performance evaluation of buildings with inter‐story isolation , 2017 .

[16]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[17]  Danilo P. Mandic,et al.  Recurrent Neural Networks for Prediction: Learning Algorithms, Architectures and Stability , 2001 .

[18]  WaiChing Sun,et al.  Meta-modeling game for deriving theoretical-consistent, micro-structural-based traction-separation laws via deep reinforcement learning , 2018, Computer Methods in Applied Mechanics and Engineering.

[19]  C. Santiuste,et al.  Machining FEM model of long fiber composites for aeronautical components , 2010 .

[20]  Eleni Chatzi,et al.  Metamodeling of dynamic nonlinear structural systems through polynomial chaos NARX models , 2015 .

[21]  Rih-Teng Wu,et al.  Deep Convolutional Neural Network for Structural Dynamic Response Estimation and System Identification , 2019, Journal of Engineering Mechanics.

[22]  Dimitrios Vamvatsikos,et al.  Incremental dynamic analysis , 2002 .

[23]  Lucia Tirca,et al.  Improving the Seismic Resilience of Existing Braced-Frame Office Buildings , 2016 .

[24]  W. Brekelmans,et al.  Prediction of the mechanical behavior of nonlinear heterogeneous systems by multi-level finite element modeling , 1998 .

[25]  F. Auricchio,et al.  Mechanical behavior of coronary stents investigated through the finite element method. , 2002, Journal of biomechanics.

[26]  Timothy W. Simpson,et al.  Metamodels for Computer-based Engineering Design: Survey and recommendations , 2001, Engineering with Computers.

[27]  Wang Ying,et al.  Artificial Neural Network Prediction for Seismic Response of Bridge Structure , 2009, 2009 International Conference on Artificial Intelligence and Computational Intelligence.

[28]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[29]  Mark F. Horstemeyer,et al.  Metamodeling with Radial Basis Functions , 2005 .

[30]  Kai Qi,et al.  Adaptive H ∞ Filter: Its Application to Structural Identification , 1998 .

[31]  J. Hesthaven,et al.  Data-driven reduced order modeling for time-dependent problems , 2019, Computer Methods in Applied Mechanics and Engineering.

[32]  Ruiyang Zhang,et al.  Cyber-physical approach to the optimization of semiactive structural control under multiple earthquake ground motions , 2019, Comput. Aided Civ. Infrastructure Eng..

[33]  Ruiyang Zhang,et al.  Deep long short-term memory networks for nonlinear structural seismic response prediction , 2019, Computers & Structures.

[34]  Ruiyang Zhang,et al.  Machine Learning Approach for Sequence Clustering with Applications to Ground-Motion Selection , 2020, Journal of Engineering Mechanics.

[35]  Larsgunnar Nilsson,et al.  Finite element modeling of mechanically fastened composite-aluminum joints in aircraft structures , 2014 .

[36]  Pénélope Leyland,et al.  A Continuation Multi Level Monte Carlo (C-MLMC) method for uncertainty quantification in compressible inviscid aerodynamics , 2017 .

[37]  Richard Sause,et al.  Seismic Response and Damage of Reduced-Strength Steel MRF Structures with Nonlinear Viscous Dampers , 2018, Journal of Structural Engineering.

[38]  Y. Wen Method for Random Vibration of Hysteretic Systems , 1976 .

[39]  P. Perdikaris,et al.  Machine learning in cardiovascular flows modeling: Predicting arterial blood pressure from non-invasive 4D flow MRI data using physics-informed neural networks , 2019 .

[40]  Z. Bai Krylov subspace techniques for reduced-order modeling of large-scale dynamical systems , 2002 .

[41]  Paris Perdikaris,et al.  Physics-Constrained Deep Learning for High-dimensional Surrogate Modeling and Uncertainty Quantification without Labeled Data , 2019, J. Comput. Phys..

[42]  Manolis Papadrakakis,et al.  Reliability-based structural optimization using neural networks and Monte Carlo simulation , 2002 .

[43]  François M. Hemez,et al.  Uncertainty and Sensitivity Analysis of Damage Identification Results Obtained Using Finite Element Model Updating , 2009, Comput. Aided Civ. Infrastructure Eng..

[44]  Ole Winther,et al.  Artificial Neural Networks for Nonlinear Dynamic Response Simulation in Mechanical Systems , 2011 .

[45]  Raimondo Betti,et al.  A Hybrid Optimization Algorithm with Bayesian Inference for Probabilistic Model Updating , 2015, Comput. Aided Civ. Infrastructure Eng..

[46]  Qiang Du,et al.  Model Reduction by Proper Orthogonal Decomposition Coupled With Centroidal Voronoi Tessellations (Keynote) , 2002 .

[47]  Nick Gregor,et al.  NGA Project Strong-Motion Database , 2008 .

[48]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[49]  Jan S. Hesthaven,et al.  Model order reduction for large-scale structures with local nonlinearities , 2019, Computer Methods in Applied Mechanics and Engineering.

[50]  Castaneda Aguilar,et al.  Development and validation of a real-time computational framework for hybrid simulation of dynamically-excited steel frame structures , 2012 .

[51]  Ephrahim Garcia,et al.  Improvement in model reduction schemes using the system equivalent reduction expansion process , 1996 .

[52]  Timothy W. Simpson,et al.  Analysis of support vector regression for approximation of complex engineering analyses , 2003, DAC 2003.

[53]  Xiuyu Gao,et al.  Computational Tool for Real-Time Hybrid Simulation of Seismically Excited Steel Frame Structures , 2015 .

[54]  Yang Liu,et al.  Physics-guided Convolutional Neural Network (PhyCNN) for Data-driven Seismic Response Modeling , 2019, Engineering Structures.

[55]  Jack P. C. Kleijnen,et al.  Kriging Metamodeling in Simulation: A Review , 2007, Eur. J. Oper. Res..

[56]  Henri Pierreval,et al.  Regression metamodeling for the design of automated manufacturing system composed of parallel machines sharing a material handling resource , 2004 .

[57]  Sanjay B. Joshi,et al.  Metamodeling: Radial basis functions, versus polynomials , 2002, Eur. J. Oper. Res..

[58]  Dimitrios Vamvatsikos,et al.  Incremental dynamic analysis for estimating seismic performance sensitivity and uncertainty , 2010 .

[59]  Jack W. Baker,et al.  An Improved Algorithm for Selecting Ground Motions to Match a Conditional Spectrum , 2018 .

[60]  J. Ricles,et al.  Development of Direct Integration Algorithms for Structural Dynamics Using Discrete Control Theory , 2008 .

[61]  Daniel J. Fonseca,et al.  Simulation metamodeling through artificial neural networks , 2003 .

[62]  Heng Xiao,et al.  Predictive large-eddy-simulation wall modeling via physics-informed neural networks , 2019, Physical Review Fluids.

[63]  Luning Sun,et al.  Surrogate modeling for fluid flows based on physics-constrained deep learning without simulation data , 2019, Computer Methods in Applied Mechanics and Engineering.