Anomaly detection via adaptive greedy model

Abstract Anomaly detection is one of the fundamental problems within diverse research areas and application domains. In comparison with most sparse representation based anomaly detection methods adopting a relaxation term of sparsity via l1 norm, we propose an unsupervised anomaly detection method optimized via an adaptive greedy model based on l0 norm constraint, which is more accurate, robust and sparse in theory. Firstly for feature representation, a concise feature space is learned in an unsupervised way via stacked autoencoder network. We propose a dictionary selection model based on l2, 0 norm constraint to select an optimal small subset of the training data to construct a condense dictionary, which can improve accuracy and reduce computational burden simultaneously. Finally, each testing sample is reconstructed by l0 norm constraint based sparse representation, and anomalies are determined depending on the sparse reconstruction scores accordingly. For model optimization, an adaptive forward-backward greedy model is utilized to optimize this nonconvex problem with the theoretical guarantee. Our proposed method is evaluated with our real industrial dataset and benchmark datasets, and various experimental results demonstrate that our proposed method is comparable with conventional supervised methods and performs better than most comparative unsupervised methods.

[1]  Alfred O. Hero,et al.  Multicriteria Similarity-Based Anomaly Detection Using Pareto Depth Analysis , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[2]  Qi Wang,et al.  Fast Hyperspectral Anomaly Detection via High-Order 2-D Crossing Filter , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[3]  Manel Guerrero Zapata,et al.  A hybrid multiobjective RBF-PSO method for mitigating DoS attacks in Named Data Networking , 2015, Neurocomputing.

[4]  Yuan Yuan,et al.  Hyperspectral Anomaly Detection by Graph Pixel Selection , 2016, IEEE Transactions on Cybernetics.

[5]  Nuno Vasconcelos,et al.  Anomaly Detection and Localization in Crowded Scenes , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Andreas Krause,et al.  Greedy Dictionary Selection for Sparse Representation , 2011, IEEE Journal of Selected Topics in Signal Processing.

[7]  Yasushi Makihara,et al.  Object recognition supported by user interaction for service robots , 2002, Object recognition supported by user interaction for service robots.

[8]  Christopher Leckie,et al.  R1SVM: A Randomised Nonlinear Approach to Large-Scale Anomaly Detection , 2015, AAAI.

[9]  Daniel P. Robinson,et al.  Provable Self-Representation Based Outlier Detection in a Union of Subspaces , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Shiguang Shan,et al.  Coarse-to-Fine Auto-Encoder Networks (CFAN) for Real-Time Face Alignment , 2014, ECCV.

[11]  Gan Sun,et al.  Active Lifelong Learning With "Watchdog" , 2018, AAAI.

[12]  Zhaohui Wu,et al.  Robust feature learning by stacked autoencoder with maximum correntropy criterion , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Ling Chen,et al.  Outlier Detection in Complex Categorical Data by Modeling the Feature Value Couplings , 2016, IJCAI.

[14]  Tong Zhang,et al.  Adaptive Forward-Backward Greedy Algorithm for Learning Sparse Representations , 2011, IEEE Transactions on Information Theory.

[15]  Victoria J. Hodge,et al.  A Survey of Outlier Detection Methodologies , 2004, Artificial Intelligence Review.

[16]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD '00.

[17]  Changsheng Li,et al.  Sparse representation for robust abnormality detection in crowded scenes , 2014, Pattern Recognit..

[18]  Manel Guerrero Zapata,et al.  A fuzzy anomaly detection system based on hybrid PSO-Kmeans algorithm in content-centric networks , 2015, Neurocomputing.

[19]  L. Kratz,et al.  Anomaly detection in extremely crowded scenes using spatio-temporal motion pattern models , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Michael Elad,et al.  Sparse Coding with Anomaly Detection , 2013, Journal of Signal Processing Systems.

[21]  Xiaoli Li,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. 1 Classification of Energy Consumption in Buildings with Outlier Detection , 2022 .

[22]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[23]  Alexandros Nanopoulos,et al.  Reverse Nearest Neighbors in Unsupervised Distance-Based Outlier Detection , 2015, IEEE Transactions on Knowledge and Data Engineering.

[24]  Zhang Yi,et al.  An Efficient Representation-Based Method for Boundary Point and Outlier Detection , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[25]  Vipin Kumar,et al.  Feature bagging for outlier detection , 2005, KDD '05.

[26]  Jing Wang,et al.  Crowd anomaly detection for automated video surveillance , 2015, ICDP.

[27]  Bianca Zadrozny,et al.  Outlier detection by active learning , 2006, KDD '06.

[28]  Nannan Li,et al.  Video anomaly detection based on a hierarchical activity discovery within spatio-temporal contexts , 2014, Neurocomputing.

[29]  Qing Wu,et al.  AnRAD: A Neuromorphic Anomaly Detection Framework for Massive Concurrent Data Streams , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[30]  Dit-Yan Yeung,et al.  Parzen-window network intrusion detectors , 2002, Object recognition supported by user interaction for service robots.

[31]  Mubarak Shah,et al.  Chaotic invariants of Lagrangian particle trajectories for anomaly detection in crowded scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Michael P. Howarth,et al.  A Survey of MANET Intrusion Detection & Prevention Approaches for Network Layer Attacks , 2013, IEEE Communications Surveys & Tutorials.

[33]  Prabin Kumar Panigrahi,et al.  A Review of Financial Accounting Fraud Detection based on Data Mining Techniques , 2012, ArXiv.

[34]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[36]  Zhang Yi,et al.  A hierarchical intrusion detection model based on the PCA neural networks , 2007, Neurocomputing.

[37]  Yi Du,et al.  Anomaly detection in traffic using L1-norm minimization extreme learning machine , 2015, Neurocomputing.

[38]  Yu Cheng,et al.  Deep Structured Energy Based Models for Anomaly Detection , 2016, ICML.

[39]  Junsong Yuan,et al.  Sparse reconstruction cost for abnormal event detection , 2011, CVPR 2011.

[40]  Jieping Ye,et al.  Forward-Backward Greedy Algorithms for General Convex Smooth Functions over A Cardinality Constraint , 2013, ICML.

[41]  Alfredo De Santis,et al.  Network anomaly detection with the restricted Boltzmann machine , 2013, Neurocomputing.

[42]  Qingshan Liu,et al.  Abnormal detection using interaction energy potentials , 2011, CVPR 2011.

[43]  Franck Dufrenois,et al.  A One-Class Kernel Fisher Criterion for Outlier Detection , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[44]  Qi Wang,et al.  A sparse dictionary learning method for hyperspectral anomaly detection with capped norm , 2017, 2017 IEEE International Geoscience and Remote Sensing Symposium (IGARSS).

[45]  Ruggero G. Pensa,et al.  A Semisupervised Approach to the Detection and Characterization of Outliers in Categorical Data , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[46]  Martial Hebert,et al.  A Discriminative Framework for Anomaly Detection in Large Videos , 2016, ECCV.

[47]  Oscar Ernesto Rojas,et al.  Abnormal Crowd Behavior Detection Based on Gaussian Mixture Model , 2016, ECCV Workshops.

[48]  Jiebo Luo,et al.  Self-Supervised Online Metric Learning With Low Rank Constraint for Scene Categorization , 2013, IEEE Transactions on Image Processing.

[49]  Simon J. Doran,et al.  Stacked Autoencoders for Unsupervised Feature Learning and Multiple Organ Detection in a Pilot Study Using 4D Patient Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Jeff G. Schneider,et al.  Anomaly pattern detection in categorical datasets , 2008, KDD.

[51]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[52]  Levent Ertoz,et al.  A New Shared Nearest Neighbor Clustering Algorithm and its Applications , 2002 .

[53]  Naoki Abe,et al.  Grouped Orthogonal Matching Pursuit for Variable Selection and Prediction , 2009, NIPS.