A Low Inertia Guided Auto-Encoder for Anomaly Detection in Networks

In the case of One-class classification, the low variance directions tend to be more informative to build a model on target class. This paper introduces a low Inertia Autoencoder for anomaly detection. The proposed model emphasizes the low Inertia when training the network with gradient descent algorithm. The low Inertia Auto-encoder model is able to improve upon the classical Auto-encoder by incorporating a regularization term into the loss function, which is the Inertia of low dimensional data embedded in the Auto-encoder hidden layer. Experimental results, on KDDCup99 network traffic connections and Aegean WiFi Intrusion Dataset, have demonstrated clearly that our method has provided significantly better detection performance than the classical Auto-encoder. In fact, low inertia Auto-encoder allows better separation between reconstruction error distributions of normal data and anomalies.

[1]  Yaxin Bi,et al.  Applying One-Class Classification Techniques to IP Flow Records for Intrusion Detection , 2017, Balt. J. Mod. Comput..

[2]  Corrado Loglisci,et al.  Exploiting the Auto-Encoder Residual Error for Intrusion Detection , 2019, 2019 IEEE European Symposium on Security and Privacy Workshops (EuroS&PW).

[3]  Bernhard Schölkopf,et al.  Support Vector Novelty Detection Applied to Jet Engine Vibration Spectra , 2000, NIPS.

[4]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[5]  Yevgeniy Vorobeychik,et al.  Optimal Thresholds for Anomaly-Based Intrusion Detection in Dynamical Environments , 2016, GameSec.

[6]  Rui Zhang,et al.  Intrusion Detection of Industrial Control System Based on Stacked Auto-Encoder , 2019, 2019 Chinese Automation Congress (CAC).

[7]  Hongxing He,et al.  Outlier Detection Using Replicator Neural Networks , 2002, DaWaK.

[8]  Naixue Xiong,et al.  Learning Sparse Representation With Variational Auto-Encoder for Anomaly Detection , 2018, IEEE Access.

[9]  Ali Gökhan Yavuz,et al.  Network Anomaly Detection with Stochastically Improved Autoencoder Based Models , 2017, 2017 IEEE 4th International Conference on Cyber Security and Cloud Computing (CSCloud).

[10]  Riadh Ksantini,et al.  Anomaly-based Intrusion Detection Using Auto-encoder , 2019, 2019 International Conference on Software, Telecommunications and Computer Networks (SoftCOM).

[11]  A. Madansky Identification of Outliers , 1988 .

[12]  Randy C. Paffenroth,et al.  Anomaly Detection with Robust Deep Autoencoders , 2017, KDD.

[13]  Klaus-Robert Müller,et al.  Feature Extraction for One-Class Classification , 2003, ICANN.

[14]  Guizhi Xu,et al.  Tumor Detection in MR Images Using One-Class Immune Feature Weighted SVMs , 2011, IEEE Transactions on Magnetics.

[15]  Takehisa Yairi,et al.  Anomaly Detection Using Autoencoders with Nonlinear Dimensionality Reduction , 2014, MLSDA'14.