A Time Convolutional Network Based Outlier Detection for Multidimensional Time Series in Cyber-Physical-Social Systems

With the development of the Cyber-Physical-Social Systems(CPSS), a large number of multidimensional time series have been generated in today’s world, such as: sensor data for industrial equipment operation, vehicle driving data, and cloud server operation and maintenance data and so on. The key task of Cloud–Fog–Edge Computing in managing these systems is how to detect anomalous data in a specific time series to facilitate operator action to solve potential system problems. So multidimensional time series outlier detection become an important direction of CPSS data mining and Cloud–Fog–Edge Computing research, and it has a wide range of applications in industry, finance, medicine and other fields. This paper proposes a framework called Multidimensional time series Outlier detection based on a Time Convolutional Network AutoEncoder (MOTCN-AE), which can detect outliers in time series data, such as identifying equipment failures, dangerous driving behaviors of cars, etc. Specifically, this paper first uses a feature extraction method to transform the original time series into a feature-rich time series. Second, the proposed TCN-AE is used to reconstruct the feature-rich time series data, and the reconstruction error is used to calculate outlier scores. Finally, the MOTCN-AE framework is validated by multiple time series datasets to demonstrate its effectiveness in detecting time series outliers.

[1]  Yu Lin,et al.  Fault detection of feed water treatment process using PCA-WD with parameter optimization. , 2017, ISA transactions.

[2]  Christian S. Jensen,et al.  Risk-aware path selection with time-varying, uncertain travel costs: a time series approach , 2018, The VLDB Journal.

[3]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[4]  Christian S. Jensen,et al.  Outlier Detection for Multidimensional Time Series Using Deep Neural Networks , 2018, 2018 19th IEEE International Conference on Mobile Data Management (MDM).

[5]  Xiaokang Wang,et al.  NQA , 2019, ACM Trans. Embed. Comput. Syst..

[6]  Subutai Ahmad,et al.  Evaluating Real-Time Anomaly Detection Algorithms -- The Numenta Anomaly Benchmark , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[7]  Jie Wu,et al.  Big Data Reduction for a Smart City’s Critical Infrastructural Health Monitoring , 2018, IEEE Communications Magazine.

[8]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[9]  Geoffrey E. Hinton,et al.  Phoneme recognition using time-delay neural networks , 1989, IEEE Trans. Acoust. Speech Signal Process..

[10]  Belle R Upadhyaya,et al.  A hybrid fault diagnosis methodology with support vector machine and improved particle swarm optimization for nuclear power plants. , 2019, ISA transactions.

[11]  Laurence T. Yang,et al.  A Distributed Tensor-Train Decomposition Method for Cyber-Physical-Social Services , 2019, ACM Trans. Cyber Phys. Syst..

[12]  Fang Liu,et al.  Outlier detection for process control data based on a non-linear Auto-Regression Hidden Markov Model method , 2012 .

[13]  Mohamed Nadif,et al.  Denoising Autoencoder as an Effective Dimensionality Reduction and Clustering of Text Data , 2017, PAKDD.

[14]  Mario Munoz-Organero,et al.  Outlier Detection in Wearable Sensor Data for Human Activity Recognition (HAR) Based on DRNNs , 2019, IEEE Access.

[15]  Sinan Q. Salih,et al.  TrustData: Trustworthy and Secured Data Collection for Event Detection in Industrial Cyber-Physical System , 2020, IEEE Transactions on Industrial Informatics.

[16]  Zhiqiang Ge,et al.  Semisupervised JITL Framework for Nonlinear Industrial Soft Sensing Based on Locally Semisupervised Weighted PCR , 2017, IEEE Transactions on Industrial Informatics.

[17]  Yue Zhao,et al.  XGBOD: Improving Supervised Outlier Detection with Unsupervised Representation Learning , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[18]  Zhang Rong,et al.  Feedforward Neural Network for Time Series Anomaly Detection , 2018, ArXiv.

[19]  Bo-Suk Yang,et al.  Random forests classifier for machine fault diagnosis , 2008 .

[20]  Bo Zong,et al.  A Deep Neural Network for Unsupervised Anomaly Detection and Diagnosis in Multivariate Time Series Data , 2018, AAAI.

[21]  Sven Behnke,et al.  Evaluation of Pooling Operations in Convolutional Architectures for Object Recognition , 2010, ICANN.

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Laurence T. Yang,et al.  ADTT: A Highly Efficient Distributed Tensor-Train Decomposition Method for IIoT Big Data , 2021, IEEE Transactions on Industrial Informatics.

[24]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[27]  Changsheng Li,et al.  Autoencoder Regularized Network For Driving Style Representation Learning , 2017, IJCAI.

[28]  P. Rousseeuw,et al.  Unmasking Multivariate Outliers and Leverage Points , 1990 .

[29]  Laurence T. Yang,et al.  A Cloud-Edge Computing Framework for Cyber-Physical-Social Services , 2017, IEEE Communications Magazine.

[30]  Biao Huang,et al.  Performance-Driven Distributed PCA Process Monitoring Based on Fault-Relevant Variable Selection and Bayesian Inference , 2016, IEEE Transactions on Industrial Electronics.

[31]  Jiong Li,et al.  A statistical training data cleaning strategy for the PCA-based chiller sensor fault detection, diagnosis and data reconstruction method , 2016 .

[32]  H. K. Khanuja,et al.  A Survey on Outlier Detection in Financial Transactions , 2014 .

[33]  Wei Jiang,et al.  Fault diagnosis of rolling bearings with recurrent neural network-based autoencoders. , 2018, ISA transactions.

[34]  Zongming Fei,et al.  An Outlier Detection Algorithm Based on Cross-Correlation Analysis for Time Series Dataset , 2018, IEEE Access.

[35]  Malik Yousef,et al.  One-Class SVMs for Document Classification , 2002, J. Mach. Learn. Res..

[36]  Bin Jiang,et al.  Adaptive PCA based fault diagnosis scheme in imperial smelting process. , 2014, ISA transactions.

[37]  Jos van Hillegersberg,et al.  Outlier detection in healthcare fraud: A case study in the Medicaid dental domain , 2016, Int. J. Account. Inf. Syst..

[38]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[39]  Lei Shi,et al.  MAD-GAN: Multivariate Anomaly Detection for Time Series Data with Generative Adversarial Networks , 2019, ICANN.

[40]  Luis Miguel Bergasa,et al.  Need data for driver behaviour analysis? Presenting the public UAH-DriveSet , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[41]  Tim Salimans,et al.  Weight Normalization: A Simple Reparameterization to Accelerate Training of Deep Neural Networks , 2016, NIPS.

[42]  Jerry Chun-Wei Lin,et al.  FRIOD: A Deeply Integrated Feature-Rich Interactive System for Effective and Efficient Outlier Detection , 2017, IEEE Access.