One-Class Support Vector Ensembles for Image Segmentation and Classification

This paper presents an extension of the one-class support vector machines (OC-SVM) into an ensemble of soft OC-SVM classifiers. The idea consists in prior clustering of the input data with a kernel version of the deterministically annealed fuzzy c-means. This way partitioned data is trained with a number of soft OC-SVM classifiers which allow weight assignment to each of the training data. Weights are obtained from the cluster membership values, computed in the kernel fuzzy c-means. The method was designed and tested mostly in the tasks of image classification and segmentation, although it can be used for other one-class problems.

[1]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .

[2]  Mário A. T. Figueiredo,et al.  Soft clustering using weighted one-class support vector machines , 2009, Pattern Recognit..

[3]  Christopher J. Merz,et al.  UCI Repository of Machine Learning Databases , 1996 .

[4]  Dimitri P. Bertsekas,et al.  Constrained Optimization and Lagrange Multiplier Methods , 1982 .

[5]  Isabelle Guyon,et al.  A Stability Based Method for Discovering Structure in Clustered Data , 2001, Pacific Symposium on Biocomputing.

[6]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[7]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[8]  R. Polikar,et al.  Ensemble based systems in decision making , 2006, IEEE Circuits and Systems Magazine.

[9]  Dao-Qiang Zhang,et al.  Clustering Incomplete Data Using Kernel-Based Fuzzy C-means Algorithm , 2003, Neural Processing Letters.

[10]  Hichem Frigui,et al.  Clustering by competitive agglomeration , 1997, Pattern Recognit..

[11]  Manuel Graña,et al.  Real-time optical markerless tracking for augmented reality applications , 2010, Journal of Real-Time Image Processing.

[12]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[13]  R. Fletcher.  Practical Methods of Optimization , 1988 .

[14]  David M. J. Tax,et al.  One-class classification , 2001 .

[15]  Hichem Frigui,et al.  Simultaneous Clustering and Feature Discrimination with Applications , 2007 .

[16]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[17]  Michal Wozniak,et al.  Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas , 2009, Pattern Analysis and Applications.

[18]  Francesco Masulli,et al.  A survey of kernel and spectral methods for clustering , 2008, Pattern Recognit..

[19]  Robert P. W. Duin,et al.  Support vector domain description , 1999, Pattern Recognit. Lett..

[20]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[21]  Boguslaw Cyganek,et al.  Framework for Object Tracking with Support Vector Machines, Structural Tensor and the Mean Shift Method , 2009, ICONIP.

[22]  Robert P. W. Duin,et al.  Support Vector Data Description , 2004, Machine Learning.

[23]  Francesca Odone,et al.  Image Kernels , 2002, SVM.

[24]  Francesca Odone,et al.  Building kernels from binary strings for image matching , 2005, IEEE Transactions on Image Processing.

[25]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[27]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[28]  David G. Stork,et al.  Pattern Classification , 1973 .

[29]  William H. Press,et al.  Numerical recipes in C , 2002 .

[30]  M. M. Moya,et al.  One-class classifier networks for target recognition applications , 1993 .

[31]  William H. Press,et al.  Numerical recipes in C. The art of scientific computing , 1987 .

[32]  Zhongdong Wu,et al.  Fuzzy C-means clustering algorithm based on kernel method , 2003, Proceedings Fifth International Conference on Computational Intelligence and Multimedia Applications. ICCIMA 2003.

[33]  Christian Döring,et al.  Fundamentals of Fuzzy Clustering , 2007 .

[34]  L. Chambers.  Practical methods of optimization (2nd edn) , by R. Fletcher. Pp. 436. £34.95. 2000. ISBN 0 471 49463 1 (Wiley). , 2001, The Mathematical Gazette.

[35]  Johan A. K. Suykens,et al.  Benchmarking Least Squares Support Vector Machine Classifiers , 2004, Machine Learning.

[36]  Gunter Ritter,et al.  Outliers in statistical pattern recognition and an application to automatic chromosome classification , 1997, Pattern Recognit. Lett..

[37]  Francesco Camastra,et al.  A Novel Kernel Method for Clustering , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Shigeo Abe DrEng.  Pattern Classification , 2001, Springer London.

[39]  B. Cyganek.  An Introduction to 3D Computer Vision Techniques and Algorithms , 2009 .

[40]  Ludmila I. Kuncheva,et al.  Clustering-and-selection model for classifier combination , 2000, KES'2000. Fourth International Conference on Knowledge-Based Intelligent Engineering Systems and Allied Technologies. Proceedings (Cat. No.00TH8516).

[41]  Boguslaw Cyganek.  Image Segmentation with a Hybrid Ensemble of One-Class Support Vector Machines , 2010, HAIS.

[42]  Miin-Shen Yang,et al.  Alternative c-means clustering algorithms , 2002, Pattern Recognit..

[43]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[44]  Hava T. Siegelmann,et al.  Support Vector Clustering , 2002, J. Mach. Learn. Res..

[45]  Alexander J. Smola,et al.  Learning with kernels , 1998 .