An Encoder-Decoder Based Approach for Anomaly Detection with Application in Additive Manufacturing

We present a novel unsupervised deep learning approach that utilizes an encoder-decoder architecture for detecting anomalies in sequential sensor data collected during industrial manufacturing. Our approach is designed to not only detect whether there exists an anomaly at a given time step, but also to predict what will happen next in the (sequential) process. We demonstrate our approach on a dataset collected from a real-world Additive Manufacturing (AM) testbed. The dataset contains infrared (IR) images collected under both normal conditions and synthetic anomalies. We show that our encoder-decoder model is able to identify the injected anomalies in a modern AM manufacturing process in an unsupervised fashion. In addition, our approach also gives hints about the temperature non-uniformity of the testbed during manufacturing, which was not previously known prior to the experiment.

[1]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[2]  Salvatore J. Stolfo,et al.  One Class Support Vector Machines for Detecting Anomalous Windows Registry Accesses , 2003 .

[3]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[4]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[5]  Ross W. Gayler,et al.  A Comprehensive Survey of Data Mining-based Fraud Detection Research , 2010, ArXiv.

[6]  D. Yen,et al.  Identifying the signs of fraudulent accounts using data mining techniques , 2010, Comput. Hum. Behav..

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[9]  R. Nagaraj,et al.  Anomaly Detection via Online Oversampling Principal Component Analysis , 2014 .

[10]  Takehisa Yairi,et al.  Anomaly Detection Using Autoencoders with Nonlinear Dimensionality Reduction , 2014, MLSDA'14.

[11]  Yong Huang,et al.  Additive Manufacturing: Current State, Future Potential, Gaps and Needs, and Recommendations , 2015 .

[12]  Jia Liu,et al.  Online Real-Time Quality Monitoring in Additive Manufacturing Processes Using Heterogeneous Sensors , 2015 .

[13]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[14]  Nitish Srivastava,et al.  Unsupervised Learning of Video Representations using LSTMs , 2015, ICML.

[15]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[16]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[17]  Guoqiang Hu,et al.  Fault detection and diagnosis for building cooling system with a tree-structured learning method , 2016 .

[18]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[19]  Andreas E. Savakis,et al.  Anomaly Detection in Video Using Predictive Convolutional Long Short-Term Memory Networks , 2016, ArXiv.

[20]  Guoqiang Hu,et al.  A data-driven strategy for detection and diagnosis of building chiller faults using linear discriminant analysis , 2016 .

[21]  T. Phillips.  In-situ laser control method for polymer selective laser sintering (SLS) , 2016 .

[22]  Lovekesh Vig,et al.  LSTM-based Encoder-Decoder for Multi-sensor Anomaly Detection , 2016, ArXiv.

[23]  A. Bandyopadhyay,et al.  Additive manufacturing: scientific and technological challenges, market uptake and opportunities , 2017 .

[24]  Yisong Yue,et al.  Telemetry Anomaly Detection System Using Machine Learning to Streamline Mission Operations , 2017, 2017 6th International Conference on Space Mission Challenges for Information Technology (SMC-IT).

[25]  J. Petrich,et al.  MACHINE LEARNING FOR DEFECT DETECTION FOR PBFAMUSING HIGH RESOLUTION LAYERWISE IMAGINGCOUPLED WITH POST-BUILD CT SCANS , 2017 .

[26]  Alberto L. Sangiovanni-Vincentelli,et al.  A One-Class Support Vector Machine Calibration Method for Time Series Change Point Detection , 2019, 2019 IEEE International Conference on Prognostics and Health Management (ICPHM).

[27]  Alberto L. Sangiovanni-Vincentelli,et al.  Detecting and Diagnosing Incipient Building Faults Using Uncertainty Information from Deep Neural Networks , 2019, 2019 IEEE International Conference on Prognostics and Health Management (ICPHM).