Deep Autoencoder based Energy Method for the Bending, Vibration, and Buckling Analysis of Kirchhoff Plates

In this paper, we present a deep autoencoder based energy method (DAEM) for the bending, vibration and buckling analysis of Kirchhoff plates. The DAEM exploits the higher order continuity of the DAEM and integrates a deep autoencoder and the minimum total potential principle in one framework yielding an unsupervised feature learning method. The DAEM is a specific type of feedforward deep neural network (DNN) and can also serve as function approximator. With robust feature extraction capacity, the DAEM can more efficiently identify patterns behind the whole energy system, such as the field variables, natural frequency and critical buckling load factor studied in this paper. The objective function is to minimize the total potential energy. The DAEM performs unsupervised learning based on random generated points inside the physical domain so that the total potential energy is minimized at all points. For vibration and buckling analysis, the loss function is constructed based on Rayleigh's principle and the fundamental frequency and the critical buckling load is extracted. A scaled hyperbolic tangent activation function for the underlying mechanical model is presented which meets the continuity requirement and alleviates the gradient vanishing/explosive problems under bending analysis. The DAEM can be easily implemented and we employed the Pytorch library and the LBFGS optimizer. A comprehensive study of the DAEM configuration is performed for several numerical examples with various geometries, load conditions, and boundary conditions.

[1]  Shijin Wang,et al.  A deep autoencoder feature learning method for process pattern recognition , 2019, Journal of Process Control.

[2]  Haidong Shao,et al.  A novel deep autoencoder feature learning method for rotating machinery fault diagnosis , 2017 .

[3]  Justin A. Sirignano,et al.  DGM: A deep learning algorithm for solving partial differential equations , 2017, J. Comput. Phys..

[4]  Xiaoying Zhuang,et al.  A deep energy method for finite deformation hyperelasticity , 2020 .

[5]  Fernando Morgado Dias,et al.  Artificial neural networks: a review of commercial hardware , 2004, Eng. Appl. Artif. Intell..

[6]  J. Katsikadelis boundary element method for engineers and scientists : theory and applications , 2016 .

[7]  Paris Perdikaris,et al.  Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations , 2019, J. Comput. Phys..

[8]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[9]  Naif Alajlan,et al.  Artificial Neural Network Methods for the Solution of Second Order Boundary Value Problems , 2019, Computers, Materials & Continua.

[10]  Chong Wang,et al.  Deep Speech 2 : End-to-End Speech Recognition in English and Mandarin , 2015, ICML.

[11]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[12]  Xindong Wu,et al.  Object Detection With Deep Learning: A Review , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[13]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[14]  H. Zheng,et al.  Numerical manifold space of Hermitian form and application to Kirchhoff's thin plate problems , 2013 .

[15]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[16]  C. V. Srinivasa,et al.  Buckling Studies on Laminated Composite Skew Plates , 2012 .

[17]  T. Poggio,et al.  Deep vs. shallow networks : An approximation theory perspective , 2016, ArXiv.

[18]  Wonyong Sung,et al.  Structured Pruning of Deep Convolutional Neural Networks , 2015, ACM J. Emerg. Technol. Comput. Syst..

[19]  Kevin Stanley McFall,et al.  Artificial Neural Network Method for Solution of Boundary Value Problems With Exact Satisfaction of Arbitrary Boundary Conditions , 2009, IEEE Transactions on Neural Networks.

[20]  E Weinan,et al.  Deep Learning-Based Numerical Methods for High-Dimensional Parabolic Partial Differential Equations and Backward Stochastic Differential Equations , 2017, Communications in Mathematics and Statistics.

[21]  Anne E Carpenter,et al.  Opportunities and obstacles for deep learning in biology and medicine , 2017, bioRxiv.

[22]  Arnulf Jentzen,et al.  Solving high-dimensional partial differential equations using deep learning , 2017, Proceedings of the National Academy of Sciences.

[23]  K. Bathe Finite Element Procedures , 1995 .

[24]  E Weinan,et al.  Machine Learning Approximation Algorithms for High-Dimensional Fully Nonlinear Partial Differential Equations and Second-order Backward Stochastic Differential Equations , 2017, J. Nonlinear Sci..

[25]  Dimitris G. Papageorgiou,et al.  Neural-network methods for boundary value problems with irregular boundaries , 2000, IEEE Trans. Neural Networks Learn. Syst..

[26]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[27]  Khaled Shaalan,et al.  Speech Recognition Using Deep Neural Networks: A Systematic Review , 2019, IEEE Access.

[28]  Dimitrios I. Fotiadis,et al.  Artificial neural networks for solving ordinary and partial differential equations , 1997, IEEE Trans. Neural Networks.

[29]  Jan Hendrik Witte,et al.  Deep Learning for Finance: Deep Portfolios , 2016 .

[30]  Wojciech Czarnecki,et al.  On Loss Functions for Deep Neural Networks in Classification , 2017, ArXiv.

[31]  T. Rabczuk,et al.  A Deep Collocation Method for the Bending Analysis of Kirchhoff Plate , 2021, Computers, Materials & Continua.

[32]  C. Brebbia,et al.  Boundary Element Techniques in Engineering , 1979 .

[33]  R. Caflisch Monte Carlo and quasi-Monte Carlo methods , 1998, Acta Numerica.

[34]  Marc Duflot,et al.  Meshless methods: A review and computer implementation aspects , 2008, Math. Comput. Simul..

[35]  H. Zheng,et al.  The linear analysis of thin shell problems using the numerical manifold method , 2018 .

[36]  K. M. Liew,et al.  Analysis of the free vibration of rectangular plates with central cut-outs using the discrete Ritz method , 2003 .

[37]  Josh Patterson,et al.  Deep Learning: A Practitioner's Approach , 2017 .

[38]  H. Zheng,et al.  Numerical manifold method for vibration analysis of Kirchhoff's plates of arbitrary geometry , 2019, Applied Mathematical Modelling.

[39]  E. Ventsel,et al.  Thin Plates and Shells: Theory: Analysis, and Applications , 2001 .

[40]  Y. P. Zhang,et al.  Extension of Hencky bar-net model for vibration analysis of rectangular plates with rectangular cutouts , 2018, Journal of Sound and Vibration.

[41]  Liping Yang,et al.  Visually-Enabled Active Deep Learning for (Geo) Text and Image Classification: A Review , 2018, ISPRS Int. J. Geo Inf..

[42]  Haohan Wang,et al.  Deep Learning for Genomics: A Concise Overview , 2018, ArXiv.

[43]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[44]  Vinh Phu Nguyen,et al.  Isogeometric analysis: An overview and computer implementation aspects , 2012, Math. Comput. Simul..

[45]  Ken-ichi Funahashi,et al.  On the approximate realization of continuous mappings by neural networks , 1989, Neural Networks.

[46]  I. Shufrin,et al.  Semi-analytical modeling of cutouts in rectangular plates with variable thickness – Free vibration analysis , 2016 .

[47]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[48]  Xiaogang Wang,et al.  DeepID-Net: Deformable deep convolutional neural networks for object detection , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Jasper Snoek,et al.  Nonparametric guidance of autoencoder representations using label information , 2012, J. Mach. Learn. Res..

[50]  Charu C. Aggarwal,et al.  Neural Networks and Deep Learning , 2018, Springer International Publishing.

[51]  S. BRODETSKY,et al.  Theory of Plates and Shells , 1941, Nature.

[52]  Tinh Quoc Bui,et al.  A moving Kriging interpolation-based meshfree method for free vibration analysis of Kirchhoff plates , 2011 .

[53]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[54]  Thomas Fischer,et al.  Deep learning with long short-term memory networks for financial market predictions , 2017, Eur. J. Oper. Res..

[55]  K. Y. Lam,et al.  Vibration analysis of plates with cutouts by the modified Rayleigh-Ritz method , 1989 .