Transductive Confidence Machines for Pattern Recognition

We propose a new algorithm for pattern recognition that outputs some measures of "reliability" for every prediction made, in contrast to the current algorithms that output "bare" predictions only. Our method uses a rule similar to that of nearest neighbours to infer predictions; thus its predictive performance is close to that of nearest neighbours, while the measures of confidence it outputs provide practically useful information for individual predictions.

[1]  Nello Cristianini,et al.  An introduction to Support Vector Machines , 2000 .

[2]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[3]  Vladimir Vovk,et al.  The typicalness framework: a comparison with the Bayesian approach , 2004 .

[4]  Vladimir Vovk,et al.  Ridge Regression Confidence Machine , 2001, International Conference on Machine Learning.

[5]  Ming Li,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 2019, Texts in Computer Science.

[6]  Cao Feng,et al.  STATLOG: COMPARISON OF CLASSIFICATION ALGORITHMS ON LARGE REAL-WORLD PROBLEMS , 1995 .

[7]  D. A. S. Fraser,et al.  Non-Parametric Methods in Statistics. , 1958 .

[8]  Ilia Nouretdinov,et al.  Algorithmic theory of randomness and its applications , 2003 .

[9]  Harris Papadopoulos,et al.  Inductive Confidence Machines for Regression , 2002, ECML.

[10]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[11]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[12]  Alexander Gammerman,et al.  Pattern Recognition and Density Estimation under the General i.i.d. Assumption , 2001, COLT/EuroCOLT.

[13]  Paul M. B. Vitányi,et al.  An Introduction to Kolmogorov Complexity and Its Applications , 1997, Graduate Texts in Computer Science.

[14]  Ilia Nouretdinov,et al.  Ridge Regression Con dence , 2001 .

[15]  Vladimir Vovk,et al.  Comparing the Bayes and Typicalness Frameworks , 2001, ECML.