A Survey of Recent Trends in One Class Classification

The One Class Classification (OCC) problem is different from the conventional binary/multi-class classification problem in the sense that in OCC, the negative class is either not present or not properly sampled. The problem of classifying positive (or target) cases in the absence of appropriately-characterized negative cases (or outliers) has gained increasing attention in recent years. Researchers have addressed the task of OCC by using different methodologies in a variety of application domains. In this paper we formulate a taxonomy with three main categories based on the way OCC has been envisaged, implemented and applied by various researchers in different application domains. We also present a survey of current state-of-the-art OCC algorithms, their importance, applications and limitations.

[1]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[2]  Brian Litt,et al.  One-Class Novelty Detection for Seizure Analysis from Intracranial EEG , 2006, J. Mach. Learn. Res..

[3]  Safaai Deris,et al.  One-Class Support Vector Machines for Protein- Protein Interactions Prediction , 2007 .

[4]  Guofei Gu,et al.  Using an Ensemble of One-Class SVM Classifiers to Harden Payload-based Anomaly Detection Systems , 2006, Sixth International Conference on Data Mining (ICDM'06).

[5]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[6]  Stephen Muggleton,et al.  Learning from Positive Data , 1996, Inductive Logic Programming Workshop.

[7]  Rémi Gilleron,et al.  Text Classification from Positive and Unlabeled Examples , 2002 .

[8]  Michael G. Madden,et al.  Multi-Class and Single-Class Classification Approaches to Vehicle Model Recognition from Images , 2005 .

[9]  Christopher M. Bishop,et al.  Novelty detection and neural network validation , 1994 .

[10]  Yuxiao Hu,et al.  One-class classification for spontaneous facial expression analysis , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[11]  Luís Seabra Lopes,et al.  Visual Object Recognition Through One-Class Learning , 2004, ICIAR.

[12]  Philip S. Yu,et al.  Partially Supervised Classification of Text Documents , 2002, ICML.

[13]  Robert P. W. Duin,et al.  Data domain description using support vectors , 1999, ESANN.

[14]  Gunter Ritter,et al.  Outliers in statistical pattern recognition and an application to automatic chromosome classification , 1997, Pattern Recognit. Lett..

[15]  Wei Xu,et al.  Improving one-class SVM for anomaly detection , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[16]  Andrew Skabar.  Single-class classifier learning using neural networks: an application to the prediction of mineral deposits , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[17]  J. J. Rocchio,et al.  Relevance feedback in information retrieval , 1971 .

[18]  Malik Yousef,et al.  Document classification on neural networks using only positive examples (poster session) , 2000, SIGIR '00.

[19]  Hwanjo Yu,et al.  Single-Class Classification with Mapping Convergence , 2005, Machine Learning.

[20]  Jiawei Han,et al.  PEBL: Web page classification without negative examples , 2004, IEEE Transactions on Knowledge and Data Engineering.

[21]  Malik Yousef,et al.  One-Class SVMs for Document Classification , 2002, J. Mach. Learn. Res..

[22]  Wanli Zuo,et al.  Text Classification from Positive and Unlabeled Documents Based on GA , 2006 .

[23]  Ken Lang,et al.  NewsWeeder: Learning to Filter Netnews , 1995, ICML.

[24]  Moshe Koppel,et al.  Authorship verification as a one-class classification problem , 2004, ICML.

[25]  Hyun Joon Shin,et al.  One-class support vector machines - an application in machine fault detection and classification , 2005, Comput. Ind. Eng..

[26]  Bing Liu,et al.  Learning with Positive and Unlabeled Examples Using Weighted Logistic Regression , 2003, ICML.

[27]  Bernhard Schölkopf,et al.  Support Vector Method for Novelty Detection , 1999, NIPS.

[28]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  SVMs for novel class detection in Bioinformatics , 2004, WOB.

[29]  M. M. Moya,et al.  One-class classifier networks for target recognition applications , 1993 .

[30]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[31]  Wanli Zuo,et al.  SVM based adaptive learning method for text classification from positive and unlabeled documents , 2008, Knowledge and Information Systems.

[32]  Salvatore J. Stolfo,et al.  One-Class Training for Masquerade Detection , 2003 .

[33]  Kevin Chen-Chuan Chang,et al.  PEBL: positive example based learning for Web page classification using SVM , 2002, KDD.

[34]  Marc Toussaint,et al.  Extracting Motion Primitives from Natural Handwriting Data , 2006, ICANN.

[35]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[36]  Avrim Blum,et al.  The Bottleneck , 2021, Monopsony Capitalism.

[37]  David M. J. Tax,et al.  One-class classification , 2001 .

[38]  Rémi Gilleron,et al.  Learning from positive and unlabeled examples , 2000, Theor. Comput. Sci..

[39]  Rémi Gilleron,et al.  Positive and Unlabeled Examples Help Learning , 1999, ALT.

[40]  Robert P. W. Duin,et al.  Uniform Object Generation for Optimizing One-class Classifiers , 2002, J. Mach. Learn. Res..

[41]  Xiaoli Li,et al.  Learning to Classify Texts Using Positive and Unlabeled Data , 2003, IJCAI.

[42]  Nathalie Japkowicz,et al.  Concept learning in the absence of counterexamples: an autoassociation-based approach to classification , 1999 .

[43]  Alberto Maria Segre,et al.  Programs for Machine Learning , 1994 .

[44]  Philip S. Yu,et al.  Building text classifiers using positive and unlabeled examples , 2003, Third IEEE International Conference on Data Mining.

[45]  Jon Atli Benediktsson,et al.  Consensus theoretic classification methods , 1992, IEEE Trans. Syst. Man Cybern..

[46]  Michael G. Madden,et al.  An Evolutionary Approach to Automatic Kernel Construction , 2006, ICANN.