DeepNAP: Deep neural anomaly pre-detection in a semiconductor fab

Abstract Anomaly detection in an industrial process is crucial for preventing unexpected economic loss. Among various signals, multivariate time series signals are one of the most difficult signals to analyze for detecting anomalies. Moreover, labels for anomalous signals are often unavailable in many fields. To tackle this problem, we present DeepNAP which is an anomaly pre-detection model based on recurrent neural networks. Without any annotated data, DeepNAP successfully learns to detect anomalies using partial reconstruction. Furthermore, detecting anomalies in advance is essential for preventing catastrophic events. While previous studies focused mainly on capturing anomalies after they have occurred, DeepNAP is able to pre-detect anomalies. We evaluate DeepNAP and other baseline models on a real multivariate dataset generated from a semiconductor manufacturing fab. Compared with other baseline models, DeepNAP achieves the best performance on both the detection and pre-detection of anomalies.

[1]  Pang-Ning Tan,et al.  Detection and Characterization of Anomalies in Multivariate Time Series , 2009, SDM.

[2]  Chenglin Wen,et al.  Fault Detection Using Random Projections and k-Nearest Neighbor Rule for Semiconductor Manufacturing Processes , 2015, IEEE Transactions on Semiconductor Manufacturing.

[3]  ZhiWu Li,et al.  Anomaly detection based on a dynamic Markov model , 2017, Information Sciences.

[4]  Lovekesh Vig,et al.  Long Short Term Memory Networks for Anomaly Detection in Time Series , 2015, ESANN.

[5]  Jin Wang,et al.  Fault Detection Using the k-Nearest Neighbor Rule for Semiconductor Manufacturing Processes , 2007, IEEE Transactions on Semiconductor Manufacturing.

[6]  Junshui Ma,et al.  Online novelty detection on temporal sequences , 2003, KDD '03.

[7]  Hongxing He,et al.  Outlier Detection Using Replicator Neural Networks , 2002, DaWaK.

[8]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[9]  Ana Bianco,et al.  Outlier Detection in Regression Models with ARIMA Errors Using Robust Estimates , 2001 .

[10]  Cyrus Shahabi,et al.  TSA-tree: a wavelet-based approach to improve the efficiency of multi-level surprise and trend queries on time-series data , 2000, Proceedings. 12th International Conference on Scientific and Statistica Database Management.

[11]  Xiangliang Zhang,et al.  Abstracting massive data for lightweight intrusion detection in computer networks , 2016, Inf. Sci..

[12]  Jugal K. Kalita,et al.  A multi-step outlier-based anomaly detection approach to network-wide traffic , 2016, Inf. Sci..

[13]  Lantao Yu,et al.  SeqGAN: Sequence Generative Adversarial Nets with Policy Gradient , 2016, AAAI.

[14]  Lance Sherry,et al.  Anomaly detection in aircraft data using Recurrent Neural Networks (RNN) , 2016, 2016 Integrated Communications Navigation and Surveillance (ICNS).

[15]  Yada Zhu,et al.  Co-Clustering Structural Temporal Data with Applications to Semiconductor Manufacturing , 2014, 2014 IEEE International Conference on Data Mining.

[16]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[17]  Seiichi Uchida,et al.  A Comparative Evaluation of Unsupervised Anomaly Detection Algorithms for Multivariate Data , 2016, PloS one.

[18]  Eamonn J. Keogh,et al.  HOT SAX: efficiently finding the most unusual time series subsequence , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[19]  Esther-Lydia Silva-Ramírez,et al.  Missing value imputation on missing completely at random data using multilayer perceptrons , 2011, Neural Networks.

[20]  Clara Pizzuti,et al.  Outlier mining in large high-dimensional data sets , 2005, IEEE Transactions on Knowledge and Data Engineering.

[21]  Sang Jeen Hong,et al.  Fault Detection in the Semiconductor Etch Process Using the Seasonal Autoregressive Integrated Moving Average Modeling , 2014, J. Inf. Process. Syst..

[22]  Jia Wu,et al.  Hierarchical Temporal Memory Method for Time-Series-Based Anomaly Detection , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[23]  J. Ma,et al.  Time-series novelty detection using one-class support vector machines , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[24]  Haifeng Chen,et al.  Exploiting Local and Global Invariants for the Management of Large Scale Information Systems , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[25]  Hava T. Siegelmann,et al.  On the Computational Power of Neural Nets , 1995, J. Comput. Syst. Sci..

[26]  Philip K. Chan,et al.  Trajectory boundary modeling of time series for anomaly detection , 2005 .

[27]  Darko Stanisavljevic,et al.  A Review of Related Work on Machine Learning in Semiconductor Manufacturing and Assembly Lines , 2016, SAMI@iKNOW.