Automated fault detection for additive manufacturing using vibration sensors

ABSTRACT Online process control is a crucial task in modern production systems that use digital twin technology. The data acquisition from machines must provide reliable and on-the-fly data, reflecting the exact status of the ongoing process. This work presents an architecture to acquire data for an Additive Manufacturing (3D printer) process, using a set of consolidated Internet of Things (IoT) technologies to collect, verify and store these data in a trustful and secure way. The need for online monitoring and fault detection is addressed by the development of a classifier using Convolutional Neural Networks. This deep learning approach, using temporally aligned vibration data provided by the underlying architecture, allows raw data processing to detect patterns without signal pre-processing and without domain-specific knowledge for model building.

[1]  Krzysztof Okarma,et al.  Objective 3D Printed Surface Quality Assessment Based on Entropy of Depth Maps , 2019, Entropy.

[2]  Geok Soon Hong,et al.  Extraction and evaluation of melt pool, plume and spatter information for powder-bed fusion AM process monitoring , 2018, Materials & Design.

[3]  Sara McMains,et al.  Machine‐Learning‐Based Monitoring of Laser Powder Bed Fusion , 2018, Advanced Materials Technologies.

[4]  Zhizhou Zhang,et al.  Automated Real‐Time Detection and Prediction of Interlayer Imperfections in Additive Manufacturing Processes Using Artificial Intelligence , 2019, Adv. Intell. Syst..

[5]  Zhicheng Zhang.  Detection of the Additive Manufacturing In-Process Failures via Deep Learning , 2019 .

[6]  G. Kino.  Nondestructive Evaluation , 1979, Science.

[7]  Ismail Fidan,et al.  Detection of Material Extrusion In-Process Failures via Deep Learning , 2020, Inventions.

[8]  K. Fayazbakhsh,et al.  A closed-loop in-process warping detection system for fused filament fabrication using convolutional neural networks , 2020 .

[9]  Dieter Roller,et al.  Concept Development of a Sensor Array for 3D Printer , 2016 .

[10]  Antônio Augusto Fröhlich,et al.  A decentralized location system for sensor networks using cooperative calibration and heuristics , 2006, MSWiM '06.

[11]  Xuefeng Chen,et al.  Dislocated Time Series Convolutional Neural Architecture: An Intelligent Fault Diagnosis Approach for Electric Machine , 2017, IEEE Transactions on Industrial Informatics.

[12]  Linkan Bian,et al.  Dual process monitoring of metal-based additive manufacturing using tensor decomposition of thermal image streams , 2018, Additive Manufacturing.

[13]  Moncef Gabbouj,et al.  Real-Time Motor Fault Detection by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Industrial Electronics.

[14]  G. D. Goh,et al.  A review on machine learning in 3D printing: applications, potential, and challenges , 2020, Artificial Intelligence Review.

[15]  Vir V. Phoha,et al.  Detecting Malicious Defects in 3D Printing Process Using Machine Learning and Image Classification , 2016 .

[16]  Antônio Augusto Fröhlich,et al.  Speculative Precision Time Protocol: Submicrosecond clock synchronization for the IoT , 2016, 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA).

[17]  Edward H. Glaessgen,et al.  The Digital Twin Paradigm for Future NASA and U.S. Air Force Vehicles , 2012 .

[18]  Onur Avci,et al.  Structural Damage Detection in Real Time: Implementation of 1D Convolutional Neural Networks for SHM Applications , 2017 .

[19]  Shashi Phoha,et al.  Application of supervised machine learning for defect detection during metallic powder bed fusion additive manufacturing using high resolution imaging. , 2018 .

[20]  S. Shevchik,et al.  Acoustic emission for in situ quality monitoring in additive manufacturing using spectral convolutional neural networks , 2017 .

[21]  D. Adams,et al.  Nondestructive Evaluation and Detection of Defects in 3D Printed Materials Using the Optical Properties of Gold Nanoparticles , 2018 .

[22]  Zhixiong Li,et al.  Prediction of surface roughness in extrusion-based additive manufacturing with machine learning , 2019, Robotics and Computer-Integrated Manufacturing.

[23]  Jack Beuth,et al.  A multi-scale convolutional neural network for autonomous anomaly detection and classification in a laser powder bed fusion additive manufacturing process , 2018, Additive Manufacturing.

[24]  Krzysztof Okarma,et al.  Quality Assessment of Photographed 3D Printed Flat Surfaces Using Hough Transform and Histogram Equalization , 2019, J. Univers. Comput. Sci..

[25]  Mohammad Saad Alam,et al.  Real-time defect detection in 3D printing using machine learning , 2021 .

[26]  François Chollet,et al.  Keras: The Python Deep Learning library , 2018 .

[27]  Antônio Augusto Fröhlich,et al.  SmartData: an IoT-ready API for sensor networks , 2018, Int. J. Sens. Networks.

[28]  Yang Gao,et al.  Watching and Safeguarding Your 3D Printer , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[29]  Fei Tao,et al.  Digital twin-driven product design, manufacturing and service with big data , 2017, The International Journal of Advanced Manufacturing Technology.

[30]  Yan Wang,et al.  An improved fault diagnosis approach for FDM process with acoustic emission , 2018, Journal of Manufacturing Processes.

[31]  Radek Fujdiak,et al.  Implementation of Elliptic Curve Diffie Hellman in ultra-low power microcontroller , 2015, 2015 38th International Conference on Telecommunications and Signal Processing (TSP).

[32]  Meng Zhang,et al.  Adversarial adaptive 1-D convolutional neural networks for bearing fault diagnosis under varying working condition , 2018, ArXiv.

[33]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[34]  Zhijun Yang,et al.  Intelligent Fault Diagnosis of Delta 3D Printers Using Attitude Sensors Based on Support Vector Machines , 2018, Sensors.

[35]  Antônio Augusto Fröhlich,et al.  DATA-CENTRIC CYBER-PHYSICAL SYSTEMS DESIGN WITH SMARTDATA , 2018, 2018 Winter Simulation Conference (WSC).

[36]  Kilian Wasmer,et al.  Deep Learning for In Situ and Real-Time Quality Monitoring in Additive Manufacturing Using Acoustic Emission , 2019, IEEE Transactions on Industrial Informatics.

[37]  Wei Zhao,et al.  In-Situ Monitoring and Diagnosing for Fused Filament Fabrication Process Based on Vibration Sensors , 2019, Sensors.

[38]  Liang Chen,et al.  Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis , 2016 .

[39]  Jia Liu,et al.  Online Real-Time Quality Monitoring in Additive Manufacturing Processes Using Heterogeneous Sensors , 2015 .

[40]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[41]  Geok Soon Hong,et al.  In situ monitoring of selective laser melting using plume and spatter signatures by deep belief networks. , 2018, ISA transactions.

[42]  Antônio Augusto Fröhlich,et al.  FT-TSTP: A Multi-Gateway Fully Reactive Geographical Routing Protocol to Improve WSN Reliability , 2018, 2018 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS).

[43]  Daniel J. Bernstein,et al.  The Poly1305-AES Message-Authentication Code , 2005, FSE.

[44]  Moncef Gabbouj,et al.  Real-Time Patient-Specific ECG Classification by 1-D Convolutional Neural Networks , 2016, IEEE Transactions on Biomedical Engineering.

[45]  Jack Beuth,et al.  Using machine learning to identify in-situ melt pool signatures indicative of flaw formation in a laser powder bed fusion additive manufacturing process , 2019, Additive Manufacturing.

[46]  Yan Wang,et al.  A New Approach for Online Monitoring of Additive Manufacturing Based on Acoustic Emission , 2016 .

[47]  Fei Tao,et al.  Digital Twin and Big Data Towards Smart Manufacturing and Industry 4.0: 360 Degree Comparison , 2018, IEEE Access.

[48]  Antônio Augusto Fröhlich,et al.  WSN Data Confidence Attribution Using Predictors , 2018, 2018 Eighth Latin-American Symposium on Dependable Computing (LADC).

[49]  Antônio Augusto Fröhlich,et al.  Byzantine Resilient Protocol for the IoT , 2019, IEEE Internet of Things Journal.

[50]  David He,et al.  A PHM Approach to Additive Manufacturing Equipment Health Monitoring, Fault Diagnosis, and Quality Control , 2014, Annual Conference of the PHM Society.

[51]  Seungjin Choi,et al.  Convolutional neural networks for human activity recognition using multiple accelerometer and gyroscope sensors , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[52]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[53]  Boualem Boashash,et al.  1-D CNNs for structural damage detection: Verification on a structural health monitoring benchmark data , 2018, Neurocomputing.