Outlier Detection in Temporal Spatial Log Data Using Autoencoder for Industry 4.0

Industry is changing rapidly under industry 4.0. The manufacturing process and its cyber-physical systems (CPSs) produce large amounts of data with many relationships and dependencies in the data. Outlier detection and problem solving is difficult in such an environment. We present an unsupervised outlier detection method to find outliers in temporal spatial log data without domain-specific knowledge. Our method is evaluated with real-world unlabeled CPS log data extracted from a quality glass inspection machine used in production. As a measurement metric for success, we set reasonable outlier areas in cooperation with a domain expert. Using our proposed method, we were able to find all known outlier areas. In addition, we found outliers that were not previously known and have been verified as outliers by a domain expert ex post.

[1]  Yong Yu,et al.  Product-Based Neural Networks for User Response Prediction over Multi-Field Categorical Data , 2018, ACM Trans. Inf. Syst..

[2]  Gheorghe Sebestyen,et al.  Anomaly detection techniques in cyber-physical systems , 2017 .

[3]  Yang Liu,et al.  Collaborative Security , 2015, ACM Comput. Surv..

[4]  Sergio Escalera,et al.  Beyond One-hot Encoding: lower dimensional target embedding , 2018, Image Vis. Comput..

[5]  Max Mühlhäuser,et al.  Unsupervised Anomaly Detection in Noisy Business Process Event Logs Using Denoising Autoencoders , 2016, DS.

[6]  Dirk Fahland,et al.  Discovering Interacting Artifacts from ERP Systems , 2015, IEEE Transactions on Services Computing.

[7]  Zirije Hasani,et al.  Robust anomaly detection algorithms for real-time big data: Comparison of algorithms , 2017, 2017 6th Mediterranean Conference on Embedded Computing (MECO).

[8]  Kishan G. Mehrotra,et al.  Anomaly Detection Principles and Algorithms , 2017, Terrorism, Security, and Computation.

[9]  Yu Cheng,et al.  Unsupervised Sequential Outlier Detection With Deep Architectures , 2017, IEEE Transactions on Image Processing.

[10]  Nikolaos Doulamis,et al.  Stacked Autoencoders for Outlier Detection in Over-the-Horizon Radar Signals , 2017, Comput. Intell. Neurosci..

[11]  Hoang Nguyen,et al.  Automatic classification of traffic incident's severity using machine learning approaches , 2017 .

[12]  Osamu Mizuno,et al.  Log-Based Anomaly Detection of CPS Using a Statistical Method , 2017, 2017 8th International Workshop on Empirical Software Engineering in Practice (IWESEP).

[13]  Thomas F. La Porta,et al.  Trustworthiness analysis of sensor data in cyber-physical systems , 2013, J. Comput. Syst. Sci..

[14]  Yiqun Liu,et al.  Temporal Relational Ranking for Stock Prediction , 2018, ACM Trans. Inf. Syst..

[15]  Sheng Gao,et al.  CPS Information Security Risk Evaluation System Based on Petri Net , 2017, 2017 IEEE Second International Conference on Data Science in Cyberspace (DSC).

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  VARUN CHANDOLA,et al.  Anomaly detection: A survey , 2009, CSUR.

[18]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[19]  Erik Elmroth,et al.  Performance Anomaly Detection and Bottleneck Identification , 2015, ACM Comput. Surv..

[20]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[21]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[22]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[23]  Charu C. Aggarwal,et al.  Outlier Detection with Autoencoder Ensembles , 2017, SDM.

[24]  Renguang Zuo,et al.  Recognition of geochemical anomalies using a deep autoencoder network , 2016, Comput. Geosci..

[25]  Charu C. Aggarwal,et al.  Outlier Analysis , 2013, Springer New York.