On the Application of Ensembles of Classifiers to the Diagnosis of Pathologies of the Vertebral Column: A Comparative Analysis

This paper reports results from a comprehensive performance comparison among standalone machine learning algorithms (SVM, MLP and GRNN) and their combinations in ensembles of classifiers when applied to a medical diagnosis problem in the field of orthopedics. All the aforementioned learning strategies, which currently comprises the classification module of the SINPATCO platform, are evaluated according to their ability in discriminating patients as belonging to one out of three categories: normal, disk hernia and spondylolisthesis. Confusion matrices of all learning algorithms are also reported, as well as a study of the effect of diversity in the design of the ensembles. The obtained results clearly indicate that the ensembles of classifiers have better generalization performance than standalone classifiers.

[1]  Oleksandr Makeyev,et al.  Neural network with ensembles , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[2]  J. Wade Davis,et al.  Statistical Pattern Recognition , 2003, Technometrics.

[3]  James A. Reggia,et al.  Neural computation in medicine , 1993, Artif. Intell. Medicine.

[4]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[5]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[6]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[7]  R. Claude,et al.  Bibliometric overview of the utilization of artificial neural networks in medicine and biology , 2004 .

[8]  W I Schöllhorn,et al.  Applications of artificial neural nets in clinical biomechanics. , 2004, Clinical biomechanics.

[9]  Ludmila I. Kuncheva,et al.  A Theoretical Study on Six Classifier Fusion Strategies , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Rüdiger W. Brause,et al.  Revolutionieren Neuronale Netze unsere Vorhersagefähigkeiten , 1999 .

[11]  H. Labelle,et al.  Analysis of the Sagittal Balance of the Spine and Pelvis Using Shape and Orientation Parameters , 2005, Journal of spinal disorders & techniques.

[12]  Donald F. Specht,et al.  A general regression neural network , 1991, IEEE Trans. Neural Networks.

[13]  Claude Robert,et al.  Bibliometric overview of the utilization of artificial neural networks in medicine and biology , 2004, Scientometrics.

[14]  Stephan Dreiseitl,et al.  Do physicians value decision support? A look at the effect of decision support systems on physician opinion , 2005, Artif. Intell. Medicine.

[15]  L. Kuncheva,et al.  Fuzzy diagnosis , 1999, Artif. Intell. Medicine.

[16]  Ching Y. Suen,et al.  KMOD - a two-parameter SVM kernel for pattern recognition , 2002, Object recognition supported by user interaction for service robots.

[17]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Rocha Neto,et al.  SINPATCO - Sistema Inteligente para Diagnóstico de Patologias da Coluna Vertebral , 2006 .

[19]  L. Ohno-Machado,et al.  Neural network applications in physical medicine and rehabilitation. , 1999, American journal of physical medicine & rehabilitation.

[20]  Rüdiger W. Brause,et al.  Medical Analysis and Diagnosis by Neural Networks , 2001, ISMDA.

[21]  Krzysztof J Cios,et al.  Epileptic seizure detection. , 2007, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[22]  Berkman Sahiner,et al.  Dual system approach to computer-aided detection of breast masses on mammograms. , 2006, Medical physics.

[23]  Martti Juhola,et al.  Neural network classification of otoneurological data and its visualization , 2008, Comput. Biol. Medicine.

[24]  Adam Krzyżak,et al.  Methods of combining multiple classifiers and their applications to handwriting recognition , 1992, IEEE Trans. Syst. Man Cybern..

[25]  Naira Hovakimyan,et al.  Neural Network Adaptive Output Feedback Control for Intensive Care Unit Sedation and Intraoperative Anesthesia , 2007, IEEE Transactions on Neural Networks.

[26]  D. G. Bounds,et al.  A multilayer perceptron network for the diagnosis of low back pain , 1988, IEEE 1988 International Conference on Neural Networks.

[27]  Friedrich Steimann,et al.  On the use and usefulness of fuzzy sets in medical AI , 2001, Artif. Intell. Medicine.

[28]  J Grigsby,et al.  Simulated neural networks to predict outcomes, costs, and length of stay among orthopedic rehabilitation patients. , 1994, Archives of physical medicine and rehabilitation.

[29]  Georgios Dounias,et al.  Evolving rule-based systems in two medical domains using genetic programming , 2004, Artif. Intell. Medicine.

[30]  Zsolt Tulassay,et al.  Application of neural networks in medicine - a review , 1998 .

[31]  Nello Cristianini,et al.  The Kernel-Adatron Algorithm: A Fast and Simple Learning Procedure for Support Vector Machines , 1998, ICML.