COPOD: Copula-Based Outlier Detection

Outlier detection refers to the identification of rare items that are deviant from the general data distribution. Existing approaches suffer from high computational complexity, low predictive capability, and limited interpretability. As a remedy, we present a novel outlier detection algorithm called COPOD, which is inspired by copulas for modeling multivariate data distribution. COPOD first constructs an empirical copula, and then uses it to predict tail probabilities of each given data point to determine its level of "extremeness". Intuitively, we think of this as calculating an anomalous p-value. This makes COPOD both parameter-free, highly interpretable, and computationally efficient. In this work, we make three key contributions, 1) propose a novel, parameter-free outlier detection algorithm with both great performance and interpretability, 2) perform extensive experiments on 30 benchmark datasets to show that COPOD outperforms in most cases and is also one of the fastest algorithms, and 3) release an easy-to-use Python implementation for reproducibility.

[1]  Margo I. Seltzer,et al.  Optimal Sparse Decision Trees , 2019, NeurIPS.

[2]  Yue Zhao,et al.  XGBOD: Improving Supervised Outlier Detection with Unsupervised Representation Learning , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).

[3]  Katrien van Driessen,et al.  A Fast Algorithm for the Minimum Covariance Determinant Estimator , 1999, Technometrics.

[4]  M. Sklar Fonctions de repartition a n dimensions et leurs marges , 1959 .

[5]  Meng Wang,et al.  Generative Adversarial Active Learning for Unsupervised Outlier Detection , 2018, IEEE Transactions on Knowledge and Data Engineering.

[6]  Bernhard Schölkopf,et al.  Estimating the Support of a High-Dimensional Distribution , 2001, Neural Computation.

[7]  Bill Ravens,et al.  An Introduction to Copulas , 2000, Technometrics.

[8]  Jimeng Sun,et al.  SUOD: A Scalable Unsupervised Outlier Detection Framework , 2020, ArXiv.

[9]  Yue Zhao,et al.  PyOD: A Python Toolbox for Scalable Outlier Detection , 2019, J. Mach. Learn. Res..

[10]  Arthur Zimek,et al.  On the evaluation of unsupervised outlier detection: measures, datasets, and an empirical study , 2016, Data Mining and Knowledge Discovery.

[11]  Sridhar Ramaswamy,et al.  Efficient algorithms for mining outliers from large data sets , 2000, SIGMOD '00.

[12]  Haifeng Chen,et al.  AutoOD: Automated Outlier Detection via Curiosity-guided Search and Self-imitation Learning , 2020, ArXiv.

[13]  Yue Zhao,et al.  SynC: A Unified Framework for Generating Synthetic Population with Gaussian Copula , 2019, ArXiv.

[14]  Yue Zhao,et al.  LSCP: Locally Selective Combination in Parallel Outlier Ensembles , 2018, SDM.

[15]  Jimeng Sun,et al.  SUOD: Accelerating Large-scare Unsupervised Heterogeneous Outlier Detection , 2020 .