A machine learning framework for accelerating the design process using CAE simulations: An application to finite element analysis in structural crashworthiness

Abstract This paper presents a novel framework for predicting computer-aided engineering (CAE) simulation results using machine learning (ML). The framework is applied to finite element (FE) simulations of dynamic axial crushing of rectangular crush tubes that are typically used in vehicle crashworthiness applications. A virtual design of experiments that varies the size and wall thickness of the FE model is performed to generate the necessary training data. This process generates designs with varying numbers of nodes and elements that are handled by the ML system . However, the explicit design parameters and meshing techniques that were used to generate the training data remain unknown to the ML system. Instead, 3D convolutional neural networks (CNN) autoencoders are used to process the initial FE model data (i.e., nodes, elements, thickness, etc.) to automatically determine these features in an unsupervised manner . A voxelization strategy that operates on the mass of individual nodes is proposed to handle the unstructured nature of the nodes and elements while capturing variations in the wall thickness of the FE models. The flattened latent space generated by the 3D-CNN-autoencoder is then used as input into long-short term memory neural networks (LSTM-NN) to predict the force–displacement response as well as the deformation of the mesh. The training process of both the 3D-CNN-autoencoders and LSTM-NN is systematically studied to highlight the robustness of the framework. The proposed ML system utilizes only 16% of the simulations generated in the virtual design of experiments to achieve good predictive capability . Once trained, the proposed framework can predict the deformation of the mesh and resulting force–displacement response of a new design up to ∼ 330 and ∼ 2,960,000 times faster, respectively, than the conventional FE approach with good accuracy. This computational speed up offers design engineers and scientists a potential tool for accelerating the design exploration process with CAE simulation tools, such as FE analysis .

[1]  Kenneth Levenberg A METHOD FOR THE SOLUTION OF CERTAIN NON – LINEAR PROBLEMS IN LEAST SQUARES , 1944 .

[2]  Jürgen Schmidhuber,et al.  LSTM: A Search Space Odyssey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[4]  Lars Greve,et al.  Neural network-based surrogate model for a bifurcating structural fracture response , 2021, Engineering Fracture Mechanics.

[5]  Prof. K. R. Chowdhary Natural Language Processing , 2020, Fundamentals of Artificial Intelligence.

[6]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[7]  Hyun-Chul Kim,et al.  3D convolutional neural network for feature extraction and classification of fMRI volumes , 2018, 2018 International Workshop on Pattern Recognition in Neuroimaging (PRNI).

[8]  Michael J. Worswick,et al.  Development of high crush efficient, extrudable aluminium front rails for vehicle lightweighting , 2016 .

[9]  Martin Fodslette Møller,et al.  A scaled conjugate gradient algorithm for fast supervised learning , 1993, Neural Networks.

[10]  D. Mohr,et al.  Strain rate and temperature dependent fracture of aluminum alloy 7075: Experiments and neural network modeling , 2020 .

[11]  Christopher Burgess,et al.  beta-VAE: Learning Basic Visual Concepts with a Constrained Variational Framework , 2016, ICLR 2016.

[12]  Mateen-ud-Din Qazi,et al.  Nearly-orthogonal sampling and neural network metamodel driven conceptual design of multistage space launch vehicle , 2006, Comput. Aided Des..

[13]  Julian N. Heidenreich,et al.  On the potential of recurrent neural networks for modeling path dependent plasticity , 2020 .

[14]  Geoffrey E. Hinton,et al.  Learning representations of back-propagation errors , 1986 .

[15]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[16]  Prakhar Jaiswal,et al.  FeatureNet: Machining feature recognition based on 3D Convolution Neural Network , 2018, Comput. Aided Des..

[17]  R. Haftka,et al.  Response surface approximations for structural optimization , 1996 .

[18]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[19]  Debra F. Laefer,et al.  Point Cloud Data Conversion into Solid Models via Point-Based Voxelization , 2013 .

[20]  Robert L. Norton,et al.  Design of machinery : an introduction to the synthesis and analysis of mechanisms and machines , 1999 .

[21]  Jaeho Jung,et al.  Deep learned finite elements , 2020 .

[22]  Guangyong Sun,et al.  Energy absorption mechanics for variable thickness thin-walled structures , 2017 .

[23]  Tommaso Mansi,et al.  Deep learning acceleration of Total Lagrangian Explicit Dynamics for soft tissue mechanics , 2020 .

[24]  Gys Albertus Marthinus Meiring,et al.  A Review of Intelligent Driving Style Analysis Systems and Related Artificial Intelligence Algorithms , 2015, Sensors.

[25]  Diego G. Loyola,et al.  Smart sampling and incremental function learning for very large high dimensional data , 2016, Neural Networks.

[26]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[27]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[28]  E. A. Avellone,et al.  Marks' Standard Handbook for Mechanical Engineers , 1916 .

[29]  Christian C. Roth,et al.  Machine-learning based temperature- and rate-dependent plasticity model: Application to analysis of fracture experiments on DP steel , 2019, International Journal of Plasticity.

[30]  Jianxiong Xiao,et al.  3D ShapeNets: A deep representation for volumetric shapes , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Pericles S. Theocaris,et al.  Neural networks for computing in fracture mechanics. Methods and prospects of applications , 1993 .

[32]  Ian J. Sutherland,et al.  Current and Future United States Light-Duty Vehicle Pathways: Cradle-to-Grave Lifecycle Greenhouse Gas Emissions and Economic Assessment. , 2018, Environmental science & technology.

[33]  M. Finn,et al.  High strain rate tensile testing of automotive aluminum alloy sheet , 2005 .

[34]  Hong-Seok Park,et al.  Structural optimization based on CAD-CAE integration and metamodeling techniques , 2010, Comput. Aided Des..

[35]  Rich Caruana,et al.  Multitask Learning , 1997, Machine Learning.

[36]  Sergio Ricci,et al.  Neural network systems to reproduce crash behavior of structural components , 2004 .

[37]  Marcus A. Magnor,et al.  Synthetic Generation of High-Dimensional Datasets , 2011, IEEE Transactions on Visualization and Computer Graphics.

[38]  Lars Greve,et al.  Necking-induced fracture prediction using an artificial neural network trained on virtual test data , 2019, Engineering Fracture Mechanics.

[39]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[40]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[41]  G. Cowper,et al.  STRAIN-HARDENING AND STRAIN-RATE EFFECTS IN THE IMPACT LOADING OF CANTILEVER BEAMS , 1957 .

[42]  Robert R. Mayer,et al.  Influence of forming effects on the axial crush response of hydroformed aluminum alloy tubes , 2010 .

[43]  Iftekhar A. Karimi,et al.  Design of computer experiments: A review , 2017, Comput. Chem. Eng..

[44]  K. Inal,et al.  Using Artificial Intelligence to Aid Vehicle Lightweighting in Crashworthiness with Aluminum , 2020, MATEC Web of Conferences.

[45]  Guillaume Desjardins,et al.  Understanding disentangling in $\beta$-VAE , 2018, 1804.03599.

[46]  Wing Kam Liu,et al.  Nonlinear Finite Elements for Continua and Structures , 2000 .

[47]  Chris Eliasmith,et al.  Legendre Memory Units: Continuous-Time Representation in Recurrent Neural Networks , 2019, NeurIPS.

[48]  Clara Vega,et al.  Rise of the Machines: Algorithmic Trading in the Foreign Exchange Market: Rise of the Machines , 2014 .

[49]  Azim Eskandarian,et al.  Vehicle crash modelling using recurrent neural networks , 1998 .

[50]  D. Mohr,et al.  Neural network model describing the temperature- and rate-dependent stress-strain response of polypropylene , 2020 .

[51]  Javad Marzbanrad,et al.  Multi-Objective Optimization of aluminum hollow tubes for vehicle crash energy absorption using a genetic algorithm and neural networks , 2011 .

[52]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[53]  Mohsen Mohammadi,et al.  Effects of elastic–plastic behaviour on the axial crush response of square tubes , 2015 .

[54]  Pascal Fua,et al.  Geodesic Convolutional Shape Optimization , 2018, ICML.

[55]  M. D. McKay,et al.  A comparison of three methods for selecting values of input variables in the analysis of output from a computer code , 2000 .

[56]  D. Marquardt An Algorithm for Least-Squares Estimation of Nonlinear Parameters , 1963 .

[57]  Xiong Zhang,et al.  Axial crushing and optimal design of square tubes with graded thickness , 2014 .

[58]  J. Min,et al.  A thin-walled structure with tailored properties for axial crushing , 2019, International Journal of Mechanical Sciences.

[59]  Robert R. Mayer,et al.  Effect of anisotropy, kinematic hardening, and strain-rate sensitivity on the predicted axial crush response of hydroformed aluminium alloy tubes , 2010 .

[60]  Georgios Papaioannou,et al.  A Fast Depth-Buffer-Based Voxelization Algorithm , 1999, J. Graphics, GPU, & Game Tools.

[61]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[62]  Wing Kam Liu,et al.  Hierarchical Deep Learning Neural Network (HiDeNN): An artificial intelligence (AI) framework for computational science and engineering , 2021, Computer Methods in Applied Mechanics and Engineering.

[63]  Jian-Sheng Fan,et al.  A general deep learning framework for history-dependent response prediction based on UA-Seq2Seq model , 2020 .

[64]  Inderjit S. Dhillon,et al.  Learning Long Term Dependencies via Fourier Recurrent Units , 2018, ICML.

[65]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[66]  Tom White,et al.  Sampling Generative Networks: Notes on a Few Effective Techniques , 2016, ArXiv.

[67]  Qiang Gao,et al.  Multi-objective lightweight and crashworthiness optimization for the side structure of an automobile body , 2018 .

[68]  Ellen Enkel,et al.  Applied artificial intelligence and trust—The case of autonomous vehicles and medical assistance devices , 2016 .

[69]  Hayit Greenspan,et al.  Multi-view longitudinal CNN for multiple sclerosis lesion segmentation , 2017, Eng. Appl. Artif. Intell..

[70]  A. H. van den Boogaard,et al.  Plasticity and fracture modeling of quench-hardenable boron steel with tailored properties , 2014 .

[71]  Hui Zhang,et al.  Axial crushing of tapered circular tubes with graded thickness , 2015 .

[72]  J. Imbert,et al.  Effects of coupling anisotropic yield functions with the optimization process of extruded aluminum front rail geometries in crashworthiness , 2017 .

[73]  Daan Wierstra,et al.  Stochastic Backpropagation and Approximate Inference in Deep Generative Models , 2014, ICML.

[74]  G. Keoleian,et al.  Economic Assessment of Greenhouse Gas Emissions Reduction by Vehicle Lightweighting Using Aluminum and High‐Strength Steel , 2011 .

[75]  Lu Lu,et al.  Dying ReLU and Initialization: Theory and Numerical Examples , 2019, Communications in Computational Physics.

[76]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[77]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[78]  Michael S. Eldred,et al.  OVERVIEW OF MODERN DESIGN OF EXPERIMENTS METHODS FOR COMPUTATIONAL SIMULATIONS , 2003 .