Biomedical Images Classification by Universal Nearest Neighbours Classifier Using Posterior Probability

Universal Nearest Neighbours (unn) is a classifier recently proposed, which can also effectively estimates the posterior probability of each classification act. This algorithm, intrinsically binary, requires the use of a decomposition method to cope with multiclass problems, thus reducing their complexity in less complex binary subtasks. Then, a reconstruction rule provides the final classification. In this paper we show that the application of unn algorithm in conjunction with a reconstruction rule based on the posterior probabilities provides a classification scheme robust among different biomedical image datasets. To this aim, we compare unn performance with those achieved by Support Vector Machine with two different kernels and by a k Nearest Neighbours classifier, and applying two different reconstruction rules for each of the aforementioned classification paradigms. The results on one private and five public biomedical datasets show satisfactory performance.

[1]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[2]  Michael I. Jordan,et al.  Convexity, Classification, and Risk Bounds , 2006 .

[3]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[4]  Frank Nielsen,et al.  Leveraging Κ-nn for generic classification boosting , 2010, 2010 IEEE International Workshop on Machine Learning for Signal Processing.

[5]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..

[6]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[7]  Frank Nielsen,et al.  Bregman Divergences and Surrogates for Learning , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Gennaro Percannella,et al.  On the use of classification reliability for improving performance of the one-per-class decomposition method , 2009, Data Knowl. Eng..

[9]  Michel Barlaud,et al.  A Bio-inspired Learning and Classification Method for Subcellular Localization of a Plasma Membrane Protein , 2012, VISAPP.

[10]  Mario Vento,et al.  Reliability Parameters to Improve Combination Strategies in Multi-Expert Systems , 1999, Pattern Analysis & Applications.

[11]  Giulio Iannello,et al.  Indirect immunofluorescence in autoimmune diseases: Assessment of digital images for diagnostic purpose , 2007, Cytometry. Part B, Clinical cytometry.

[12]  Frank Nielsen,et al.  Boosting Nearest Neighbors for the Efficient Estimation of Posteriors , 2012, ECML/PKDD.

[13]  Frank Nielsen,et al.  On the Efficient Minimization of Classification Calibrated Surrogates , 2008, NIPS.