Some Properties of Consensus-Based Classification

The objective of this paper is to consider some properties of decisions produced by classifiers that are in consensus. Consensus allows strong classifiers to obtain very reliable classification on the objects on which consensus has been reached. For those ones where consensus is not reached the reclassification procedure should be applied based on other classification algorithms. Properties of different consensuses are described using algebraic approach and performance evaluation routine.

[1]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[2]  B. P. Rusyn,et al.  Upper-bound estimates for classifiers based on a dissimilarity function , 2012 .

[3]  Luc Devroye,et al.  Lectures on the Nearest Neighbor Method , 2015 .

[4]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[5]  Henri Maître,et al.  A Method of Clustering Combination Applied to Satellite Image Analysis , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[6]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[7]  T. Ho,et al.  Data Complexity in Pattern Recognition , 2006 .

[8]  Tin Kam Ho,et al.  Complexity Measures of Supervised Classification Problems , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[10]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[11]  K. Vorontsov.  Combinatorial probability and the tightness of generalization bounds , 2008, Pattern Recognition and Image Analysis.

[12]  Rauf Izmailov,et al.  Statistical Inference Problems and Their Rigorous Solutions - In memory of Alexey Chervonenkis , 2015, SLDS.

[13]  K. Vorontsov.  Splitting and similarity phenomena in the sets of classifiers and their effect on the probability of overfitting , 2009, Pattern Recognition and Image Analysis.

[14]  Michal Wozniak,et al.  Hybrid Classifiers - Methods of Data, Knowledge, and Classifier Combination , 2013, Studies in Computational Intelligence.

[15]  Lior Rokach,et al.  Pattern Classification Using Ensemble Methods , 2009, Series in Machine Perception and Artificial Intelligence.

[16]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[17]  Catherine Blake,et al.  UCI Repository of machine learning databases , 1998 .