RKDOS: A Relative Kernel Density-based Outlier Score

This article proposes a novel outlier detection algorithm called Relative Kernel Density-based Outlier Score (RKDOS) to detect local outliers. The proposed algorithm uses a weighted kernel density estimation (WKDE) method with an adaptive kernel width for density estimation at the location of an object based on its extended nearest neighbors. For density estimation, we consider both Reverse Nearest Neighbors (RNN) and k-Nearest Neighbors (kNN) of an object. To achieve smoothness in the measure, the Gaussian kernel function is adopted. Further, to improve discriminating power between normal and abnormal samples, we use an adaptive kernel width concept. Extensive experiments on both synthetic and real data sets have shown that our proposed algorithm has better detection performance over some popular existing outlier detection approaches.

[1]  Hans-Peter Kriegel,et al.  LOF: identifying density-based local outliers , 2000, SIGMOD 2000.

[2]  Anthony K. H. Tung,et al.  Ranking Outliers Using Symmetric Neighborhood Relationship , 2006, PAKDD.

[3]  Douglas M. Hawkins.  Identification of Outliers , 1980, Monographs on Applied Probability and Statistics.

[4]  Bahari Belaton,et al.  ICMPv6-Based DoS and DDoS Attacks and Defense Mechanisms: Review , 2017 .

[5]  Haibo He,et al.  A local density-based approach for outlier detection , 2017, Neurocomputing.

[6]  Rajeev Rastogi,et al.  Efficient algorithms for mining outliers from large data sets , 2000, SIGMOD 2000.

[7]  Selvakumar Manickam,et al.  A Survey of Intrusion Alert Correlation and Its Design Considerations , 2014 .

[8]  Arthur Zimek,et al.  On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study , 2016, Data Mining and Knowledge Discovery.

[9]  Amin Hosseinian Far,et al.  Crime data mining, threat analysis and prediction , 2018 .

[10]  V. A. Epanechnikov.  Non-Parametric Estimation of a Multivariate Probability Density , 1969 .

[11]  Esraa Alomari,et al.  An Intelligent ICMPv6 DDoS Flooding-Attack Detection Framework (v6IIDS) using Back-Propagation Neural Network , 2016 .

[12]  Hans-Peter Kriegel,et al.  Local outlier detection reconsidered: a generalized view on locality with applications to spatial, video, and network outlier detection , 2012, Data Mining and Knowledge Discovery.

[13]  Qingsheng Zhu,et al.  A novel outlier cluster detection algorithm without top-n parameter , 2017, Knowl. Based Syst..

[14]  Jian Tang,et al.  Enhancing Effectiveness of Outlier Detections for Low Density Patterns , 2002, PAKDD.

[15]  M. Friedman.  The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance , 1937 .

[16]  Hans-Peter Kriegel,et al.  LoOP: local outlier probabilities , 2009, CIKM.

[17]  Jing Lin,et al.  Adaptive kernel density-based anomaly detection for nonlinear systems , 2018, Knowl. Based Syst..

[18]  Chenfei Sun,et al.  Abnormal Group-Based Joint Medical Fraud Detection , 2019, IEEE Access.

[19]  Bernard W. Silverman,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[20]  Ji Feng,et al.  Natural neighbor: A self-adaptive neighborhood method without parameter K , 2016, Pattern Recognit. Lett..