A Real-Time Iterative Machine Learning Approach for Temperature Profile Prediction in Additive Manufacturing Processes

Additive Manufacturing (AM) is a manufacturing paradigm that builds three-dimensional objects from a computer-aided design model by successively adding material layer by layer. AM has become very popular in the past decade due to its utility for fast prototyping such as 3D printing as well as manufacturing functional parts with complex geometries using processes such as laser metal deposition that would be difficult to create using traditional machining. As the process for creating an intricate part for an expensive metal such as Titanium is prohibitive with respect to cost, computational models are used to simulate the behavior of AM processes before the experimental run. However, as the simulations are computationally costly and time-consuming for predicting multiscale multi-physics phenomena in AM, physics-informed data-driven machine-learning systems for predicting the behavior of AM processes are immensely beneficial. Such models accelerate not only multiscale simulation tools but also empower real-time control systems using in-situ data. In this paper, we design and develop essential components of a scientific framework for developing a data-driven model-based real-time control system. Finite element methods are employed for solving time-dependent heat equations and developing the database. The proposed framework uses extremely randomized trees - an ensemble of bagged decision trees as the regression algorithm iteratively using temperatures of prior voxels and laser information as inputs to predict temperatures of subsequent voxels. The models achieve mean absolute percentage errors below 1% for predicting temperature profiles for AM processes. The code is made available for the research community at https://github.com/paularindam/ml-iter-additive.

[1]  Wing Kam Liu,et al.  Data-driven multi-scale multi-physics models to derive process–structure–property relationships for additive manufacturing , 2018 .

[2]  Klaus-Robert Müller,et al.  Optimizing transition states via kernel-based machine learning. , 2012, The Journal of chemical physics.

[3]  Placid Mathew Ferreira,et al.  A new paradigm for organizing networks of computer numerical control manufacturing resources in cloud manufacturing , 2018 .

[4]  A. Kashani,et al.  Additive manufacturing (3D printing): A review of materials, methods, applications and challenges , 2018, Composites Part B: Engineering.

[5]  Silvio Savarese,et al.  3D-R2N2: A Unified Approach for Single and Multi-view 3D Object Reconstruction , 2016, ECCV.

[6]  Wei-keng Liao,et al.  Data Sampling Schemes for Microstructure Design with Vibrational Tuning Constraints , 2018 .

[7]  Antti Salminen,et al.  Characterization of Process Efficiency Improvement in Laser Additive Manufacturing , 2014 .

[8]  G. K. Lewis,et al.  Practical considerations and capabilities for laser assisted direct metal deposition , 2000 .

[9]  Yuebin Guo,et al.  Residual Stress in Metal Additive Manufacturing , 2018 .

[10]  T. Blacker,et al.  Modeling of additive manufacturing processes for metals: Challenges and opportunities , 2017 .

[11]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[12]  Liang Hou,et al.  Additive manufacturing and its societal impact: a literature review , 2013 .

[13]  Alok Choudhary,et al.  A General-Purpose Machine Learning Framework for Predicting Properties of Inorganic Materials , 2016 .

[14]  Skipper Seabold,et al.  Statsmodels: Econometric and Statistical Modeling with Python , 2010, SciPy.

[15]  Alok Choudhary,et al.  Combinatorial screening for new materials in unconstrained composition space with machine learning , 2014 .

[16]  Jack Beuth,et al.  Anomaly Detection and Classification in a Laser Powder Bed Additive Manufacturing Process using a Trained Computer Vision Algorithm , 2018 .

[17]  Bernhard Mueller,et al.  Additive Manufacturing Technologies – Rapid Prototyping to Direct Digital Manufacturing , 2012 .

[18]  Oleksandr Semeniuta,et al.  Optimization of Process Parameters for Powder Bed Fusion Additive Manufacturing by Combination of Machine Learning and Finite Element Method: A Conceptual Framework , 2018 .

[19]  Kaufui Wong,et al.  A Review of Additive Manufacturing , 2012 .

[20]  Wei-keng Liao,et al.  CheMixNet: Mixed DNN Architectures for Predicting Chemical Properties using Multiple Molecular Representations , 2018, ArXiv.

[21]  Jaimyun Jung,et al.  An efficient machine learning approach to establish structure-property linkages , 2019, Computational Materials Science.

[22]  Stephen Lin,et al.  Acceleration strategies for explicit finite element analysis of metal powder-based additive manufacturing processes using graphical processing units , 2019, Computational Mechanics.

[23]  Wei-keng Liao,et al.  Transfer Learning Using Ensemble Neural Networks for Organic Solar Cell Screening , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[24]  Alok Choudhary,et al.  Extracting Grain Orientations from EBSD Patterns of Polycrystalline Materials Using Convolutional Neural Networks , 2018, Microscopy and Microanalysis.

[25]  T. Belytschko,et al.  A first course in finite elements , 2007 .

[26]  Fengqi You,et al.  Sustainable Manufacturing With Cyber-Physical Discrete Manufacturing Networks: Overview and Modeling Framework , 2019, Journal of Manufacturing Science and Engineering.

[27]  G. B. Olson,et al.  Computational Design of Hierarchically Structured Materials , 1997 .

[28]  Wei-keng Liao,et al.  ElemNet: Deep Learning the Chemistry of Materials From Only Elemental Composition , 2018, Scientific Reports.

[29]  Jack Beuth,et al.  A multi-scale convolutional neural network for autonomous anomaly detection and classification in a laser powder bed fusion additive manufacturing process , 2018, Additive Manufacturing.

[30]  Huan Qi,et al.  Numerical simulation of heat transfer and fluid flow in coaxial laser cladding process for direct metal deposition , 2006 .

[31]  Max Yi Ren,et al.  Microstructure Representation and Reconstruction of Heterogeneous Materials via Deep Belief Network for Computational Material Design , 2016, ArXiv.

[32]  Wei-keng Liao,et al.  Microstructure optimization with constrained design objectives using machine learning-based feedback-aware data-generation , 2019, Computational Materials Science.

[33]  Alireza Rahnama,et al.  Machine learning for predicting occurrence of interphase precipitation in HSLA steels , 2018, Computational Materials Science.

[34]  Kornel Ehmann,et al.  Data-driven prediction of the high-dimensional thermal history in directed energy deposition processes via recurrent neural networks , 2018, Manufacturing Letters.

[35]  Yaoyu Ding,et al.  Development of sensing and control system for robotized laser-based direct metal addition system , 2016 .

[36]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[37]  Ming-Chuan Leu,et al.  Progress in Additive Manufacturing and Rapid Prototyping , 1998 .

[38]  Manish Kumar,et al.  Forecasting Stock Index Movement: A Comparison of Support Vector Machines and Random Forest , 2006 .

[39]  Ugur Ayan,et al.  Ensemble classification over stock market time series and economy news , 2013, 2013 IEEE International Conference on Intelligence and Security Informatics.

[40]  N. Zabaras,et al.  Linear analysis of texture-property relationships using process-based representations of Rodrigues space , 2007 .

[41]  Thomas G. Dietterich.  An Experimental Comparison of Three Methods for Constructing Ensembles of Decision Trees: Bagging, Boosting, and Randomization , 2000, Machine Learning.

[42]  Ulrich Helfenstein.  ARMA and ARIMA Models , 2005 .

[43]  R. Fabbro,et al.  Analytical and numerical modelling of the direct metal deposition laser process , 2008 .

[44]  Wei-keng Liao,et al.  Peak Area Detection Network for Directly Learning Phase Regions from Raw X-ray Diffraction Patterns , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[45]  Alok Choudhary,et al.  Property Prediction of Organic Donor Molecules for Photovoltaic Applications Using Extremely Randomized Trees , 2019, Molecular informatics.

[46]  Hidenori Terasaki,et al.  Microstructural diagram for steel based on crystallography with machine learning , 2019, Computational Materials Science.

[47]  Jeremy Faludi,et al.  Comparing Environmental Impacts of Additive Manufacturing vs. Traditional Machining via Life-Cycle Assessment , 2015 .

[48]  A. Choudhary,et al.  Perspective: Materials informatics and big data: Realization of the “fourth paradigm” of science in materials science , 2016 .

[49]  Chiho Kim,et al.  Machine learning in materials informatics: recent applications and prospects , 2017, npj Computational Materials.

[50]  Jian Cao,et al.  Thermodynamically consistent microstructure prediction of additively manufactured materials , 2016 .

[51]  G. Tapia,et al.  A Review on Process Monitoring and Control in Metal-Based Additive Manufacturing , 2014 .

[52]  Víctor M. Guerrero,et al.  A recursive ARIMA-based procedure for disaggregating a time series variable using concurrent data , 1995 .

[53]  Michael Veilleux,et al.  A thermal-mechanical finite element workflow for directed energy deposition additive manufacturing process modeling , 2018 .

[54]  Orion L. Kafka,et al.  Linking process, structure, property, and performance for metal-based additive manufacturing: computational approaches with experimental support , 2016 .

[55]  William E. Frazier,et al.  Metal Additive Manufacturing: A Review , 2014, Journal of Materials Engineering and Performance.

[56]  Paul A. Colegrove,et al.  Thermo-mechanical analysis of Wire and Arc Additive Layer Manufacturing process on large multi-layer parts , 2011 .

[57]  Jack Beuth,et al.  Using machine learning to identify in-situ melt pool signatures indicative of flaw formation in a laser powder bed fusion additive manufacturing process , 2019, Additive Manufacturing.

[58]  Manh Cuong Nguyen,et al.  On-the-fly machine-learning for high-throughput experiments: search for rare-earth-free permanent magnets , 2014, Scientific Reports.

[59]  A. Choudhary,et al.  Deep materials informatics: Applications of deep learning in materials science , 2019, MRS Communications.

[60]  Wei-keng Liao,et al.  IRNet: A General Purpose Deep Residual Regression Framework for Materials Discovery , 2019, KDD.

[61]  Srinivasa Prakash Regalla,et al.  Modeling and optimization of surface roughness in single point incremental forming process , 2015 .

[62]  Eric J. Faierson,et al.  A framework to link localized cooling and properties of directed energy deposition (DED)-processed Ti-6Al-4V , 2017 .

[63]  Surya R. Kalidindi,et al.  Data science and cyberinfrastructure: critical enablers for accelerated development of hierarchical materials , 2015 .

[64]  J. K. Watson,et al.  A decision-support model for selecting additive manufacturing versus subtractive manufacturing based on energy consumption. , 2018, Journal of cleaner production.