Deep Learning of Variant Geometry in Layerwise Imaging Profiles for Additive Manufacturing Quality Control

Additive manufacturing (AM) is a new paradigm in design-driven build of customized products. Nonetheless, mass customization and low-volume production make the AM quality assurance extremely challenging. Advanced imaging provides an unprecedented opportunity to increase information visibility, cope with the product complexity, and enable on-the-fly quality control in AM. However, in situ images of a customized AM build show a high level of layer-to-layer geometry variation, which hampers the use of powerful image-based learning methods such as deep neural networks (DNNs) for flaw detection. Very little has been done on deep learning of variant geometry for image-guided process monitoring and control. The proposed research is aimed at filling this gap by developing a novel machine learning approach that is focused on variant geometry in each layer of the AM build, namely region of interests, for the characterization and detection of layerwise flaws. Specifically, we leverage the computer-aided design (CAD) file to perform shape-to-image registration and to delineate the regions of interest in layerwise images. Next, a hierarchical dyadic partitioning methodology is developed to split layer-to-layer regions of interest into subregions with the same number of pixels to provide freeform geometry analysis. Then, we propose a semiparametric model to characterize the complex spatial patterns in each customized subregion and boost the computational speed. Finally, a DNN model is designed to learn variant geometry in layerwise imaging profiles and detect fine-grained information of flaws. Experimental results show that the proposed deep learning methodology is highly effective to detect flaws in each layer with an accuracy of 92.50 ± 1.03%. This provides a significant opportunity to reduce interlayer variation in AM prior to completion of a build. The proposed methodology can also be generally applicable in a variety of engineering and medical domains that entail customized design, variant geometry, and image-guided process control.

[1]  Gerd Witt,et al.  ERROR DETECTION IN LASER BEAM MELTING SYSTEMS BY HIGH RESOLUTION IMAGING , 2012 .

[2]  Hui Yang,et al.  Process Mapping and In-Process Monitoring of Porosity in Laser Powder Bed Fusion Using Layerwise Optical Imaging , 2018, Journal of Manufacturing Science and Engineering.

[3]  Ehsan Malekipour,et al.  Common defects and contributing parameters in powder bed fusion AM process and their classification for online monitoring and control: a review , 2018 .

[4]  Richard K. Leach,et al.  Assessing the capability of in-situ nondestructive analysis during layer based additive manufacture , 2017 .

[5]  Jean-Pierre Kruth,et al.  Online Quality Control of Selective Laser Melting , 2011 .

[6]  Ohyung Kwon,et al.  A deep neural network for classification of melt-pool images in metal additive manufacturing , 2018, J. Intell. Manuf..

[7]  Ruimin Chen,et al.  Joint Multifractal and Lacunarity Analysis of Image Profiles for Manufacturing Quality Control , 2019, Journal of Manufacturing Science and Engineering.

[8]  E. W. Reutzel,et al.  Optical, layerwise monitoring of powder bed fusion , 2015 .

[9]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[10]  Reza Yavari,et al.  In-Process Monitoring of Material Cross-Contamination Defects in Laser Powder Bed Fusion , 2018, Journal of Manufacturing Science and Engineering.

[11]  Joost Duflou,et al.  On-line monitoring and process control in selective laser melting and laser cutting , 2007 .

[12]  Valéry Valle,et al.  New Development of Digital Volume Correlation for the Study of Fractured Materials , 2018, Experimental Mechanics.

[13]  Alaa Elwany,et al.  Layerwise Anomaly Detection in Laser Powder-Bed Fusion Metal Additive Manufacturing , 2019, Journal of Manufacturing Science and Engineering.

[14]  Hui Yang,et al.  Fractal Pattern Recognition of Image Profiles for Manufacturing Process Monitoring and Control , 2018, Volume 3: Manufacturing Equipment and Systems.

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[16]  Ehsan Malekipour,et al.  Defects, Process Parameters and Signatures for Online Monitoring and Control in Powder-Based Additive Manufacturing , 2018 .

[17]  Sidnei Alves de Araújo,et al.  Artificial intelligence based system to improve the inspection of plastic mould surfaces , 2017, J. Intell. Manuf..

[18]  Justin Whiting,et al.  A Combined Experimental-Numerical Method to Evaluate Powder Thermal Properties in Laser Powder Bed Fusion. , 2018, Journal of manufacturing science and engineering.

[19]  J. Kruth,et al.  Feedback control of selective laser melting , 2007 .

[20]  Yu. Chivel,et al.  On-line temperature monitoring in selective laser sintering/melting , 2010 .

[21]  Sundar V. Atre,et al.  In Situ Measurement of Thermal Strain Development in 420 Stainless Steel Additive Manufactured Metals , 2019, Experimental Mechanics.

[22]  Hui Yang,et al.  Multifractal Analysis of Image Profiles for the Characterization and Detection of Defects in Additive Manufacturing , 2018 .

[23]  Jack Beuth,et al.  Prediction of lack-of-fusion porosity for powder bed fusion , 2017 .

[24]  Edward William Reutzel,et al.  A brief survey of sensing for metal-based powder bed fusion additive manufacturing , 2015, Sensing Technologies + Applications.

[25]  Shaw C. Feng,et al.  A review on measurement science needs for real-time control of additive manufacturing metal powder bed fusion processes , 2017, Int. J. Prod. Res..

[26]  Hui Yang,et al.  From Design Complexity to Build Quality in Additive Manufacturing—A Sensor-Based Perspective , 2019, IEEE Sensors Letters.

[27]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[28]  R. Leach Optical measurement of surface topography , 2011 .

[29]  G. Tapia,et al.  A Review on Process Monitoring and Control in Metal-Based Additive Manufacturing , 2014 .

[30]  A. Nassar,et al.  Flaw detection in powder bed fusion using optical imaging , 2017 .

[31]  Seyyed Hadi Seifi,et al.  Layer-Wise Modeling and Anomaly Detection for Laser-Based Additive Manufacturing , 2019, Journal of Manufacturing Science and Engineering.

[32]  Nisheeth Shrivastava,et al.  Target tracking with binary proximity sensors , 2009, TOSN.

[33]  Jack Beuth,et al.  A multi-scale convolutional neural network for autonomous anomaly detection and classification in a laser powder bed fusion additive manufacturing process , 2018, Additive Manufacturing.

[34]  Hui Yang,et al.  Markov Decision Process for Image-Guided Additive Manufacturing , 2018, IEEE Robotics and Automation Letters.

[35]  David L. Bourell,et al.  Perspectives on Additive Manufacturing , 2016 .

[36]  Prahalada K. Rao,et al.  Layerwise In-Process Quality Monitoring in Laser Powder Bed Fusion , 2018, Volume 1: Additive Manufacturing; Bio and Sustainable Manufacturing.

[37]  Geok Soon Hong,et al.  Extraction and evaluation of melt pool, plume and spatter information for powder-bed fusion AM process monitoring , 2018, Materials & Design.

[38]  M. Doubenskaia,et al.  Selective laser melting process monitoring with high speed infra-red camera and pyrometer , 2008, Fundamentals of Laser Assisted Micro- and Nanotechnologies.

[39]  J. Rudlin,et al.  Inspection of additive-manufactured layered components. , 2015, Ultrasonics.

[40]  Richard Leach,et al.  Review of in-situ process monitoring and in-situ metrology for metal additive manufacturing , 2016 .

[41]  Hui Yang,et al.  Image-guided Quality Control of Biomanufacturing Process , 2017 .

[42]  Jean-Pierre Kruth,et al.  Feedback control of Layerwise Laser Melting using optical sensors , 2010 .

[43]  Brandon M. Lane,et al.  Measurement of the Melt Pool Length During Single Scan Tracks in a Commercial Laser Powder Bed Fusion Process , 2017 .

[44]  Liangpei Zhang,et al.  Pre-Trained AlexNet Architecture with Pyramid Pooling and Supervision for High Spatial Resolution Remote Sensing Image Scene Classification , 2017, Remote. Sens..

[45]  S. N. Musa,et al.  Fuzzy-based sustainability evaluation method for manufacturing SMEs using balanced scorecard framework , 2018, J. Intell. Manuf..

[46]  Jean-Pierre Kruth,et al.  In situ quality control of the selective laser melting process using a high-speed, real-time melt pool monitoring system , 2014 .

[47]  B. Colosimo,et al.  Process defects and in situ monitoring methods in metal powder bed fusion: a review , 2017 .

[48]  Prahalada Rao,et al.  Thermal Modeling in Metal Additive Manufacturing Using Graph Theory , 2019, Journal of Manufacturing Science and Engineering.

[49]  R. Webster,et al.  Kriging: a method of interpolation for geographical information systems , 1990, Int. J. Geogr. Inf. Sci..

[50]  Te-Hsiu Sun,et al.  Automated thermal fuse inspection using machine vision and artificial neural networks , 2016, J. Intell. Manuf..