A combined MRI and MRSI based multiclass system for brain tumour recognition using LS-SVMs with class probabilities and feature selection

OBJECTIVE This study investigates the use of automated pattern recognition methods on magnetic resonance data with the ultimate goal to assist clinicians in the diagnosis of brain tumours. Recently, the combined use of magnetic resonance imaging (MRI) and magnetic resonance spectroscopic imaging (MRSI) has demonstrated to improve the accuracy of classifiers. In this paper we extend previous work that only uses binary classifiers to assess the type and grade of a tumour to a multiclass classification system obtaining class probabilities. The important problem of input feature selection is also addressed. METHODS AND MATERIAL Least squares support vector machines (LS-SVMs) with radial basis function kernel are applied and compared with linear discriminant analysis (LDA). Both a Bayesian framework and cross-validation are used to infer the parameters of the LS-SVM classifiers. Four different techniques to obtain multiclass probabilities as a measure of accuracy are compared. Four variable selection methods are explored. MRI and MRSI data are selected from the INTERPRET project database. RESULTS The results illustrate the significantly better performance of automatic relevance determination (ARD), in combination with LS-SVMs in a Bayesian framework and coupling of class probabilities, compared to classical LDA. CONCLUSION It is demonstrated that binary LS-SVMs can be extended to a multiclass classifier system obtaining class probabilities by Bayesian techniques and pairwise coupling. Feature selection based on ARD further improves the results. This classifier system can be of great help in the diagnosis of brain tumours.

[1]  Risto A. Kauppinen,et al.  Diagnostic assessment of brain tumours and non-neoplastic brain disorders in vivo using proton nuclear magnetic resonance spectroscopy and artificial neural networks , 1999, Journal of Cancer Research and Clinical Oncology.

[2]  J. Suykens,et al.  Classification of brain tumours using short echo time 1H MR spectra. , 2004, Journal of magnetic resonance.

[3]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machine Classifiers , 1999, Neural Processing Letters.

[4]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[5]  Iain Murray Introduction To Gaussian Processes , 2008 .

[6]  D. Louis Collins,et al.  Accurate, noninvasive diagnosis of human brain tumors by using proton magnetic resonance spectroscopy , 1996, Nature Medicine.

[7]  U. Klose In vivo proton spectroscopy in presence of eddy currents , 1990, Magnetic resonance in medicine.

[8]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[9]  Arend Heerschap,et al.  Combination of feature‐reduced MR spectroscopic and MR imaging data for improved brain tumor classification , 2005, NMR in biomedicine.

[10]  Johan A. K. Suykens,et al.  Bayesian Framework for Least-Squares Support Vector Machine Classifiers, Gaussian Processes, and Kernel Fisher Discriminant Analysis , 2002, Neural Computation.

[11]  Robert Tibshirani,et al.  Classification by Pairwise Coupling , 1997, NIPS.

[12]  Brian D. Ross,et al.  Magnetic Resonance Spectroscopy Diagnosis of Neurological Diseases , 1999 .

[14]  Sylvie Grand,et al.  A new approach for analyzing proton magnetic resonance spectroscopic images of brain tumors: nosologic images , 2000, Nature Medicine.

[15]  Larry A. Rendell,et al.  A Practical Approach to Feature Selection , 1992, ML.

[16]  Lutgarde M. C. Buydens,et al.  Published online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/cem.721 Mixture modelling of medical magnetic resonance data , 2002 .

[17]  R. Shah,et al.  Least Squares Support Vector Machines , 2022 .

[18]  C. -Z. Ye,et al.  Fuzzy rules to predict degree of malignancy in brain glioma , 2002, Medical and Biological Engineering and Computing.

[19]  Kiyohiro Houkin,et al.  In vivo quantification of the metabolites in normal brain and brain tumors by proton MR spectroscopy using water as an internal standard. , 2004, Magnetic resonance imaging.

[20]  Gérard Dreyfus,et al.  Pairwise Neural Network Classifiers with Probabilistic Outputs , 1994, NIPS.

[21]  Thomas G. Dietterich,et al.  Learning with Many Irrelevant Features , 1991, AAAI.

[22]  John C. Lindon,et al.  Pattern recognition methods and applications in biomedical magnetic resonance , 2001 .

[23]  David W. Aha,et al.  A Review and Empirical Evaluation of Feature Weighting Methods for a Class of Lazy Learning Algorithms , 1997, Artificial Intelligence Review.

[24]  A. Tamhane,et al.  Multiple Comparison Procedures , 1989 .

[25]  A. W. Simonetti,et al.  The use of multivariate MR imaging intensities versus metabolic data from MR spectroscopic imaging for brain tumour classification. , 2005, Journal of magnetic resonance.

[26]  Marko Robnik-Sikonja,et al.  Theoretical and Empirical Analysis of ReliefF and RReliefF , 2003, Machine Learning.

[27]  Matthew L. Ginsberg,et al.  Essentials of Artificial Intelligence , 2012 .

[28]  Johan A. K. Suykens,et al.  Multiclass least squares support vector machines , 1999, IJCNN'99. International Joint Conference on Neural Networks. Proceedings (Cat. No.99CH36339).

[29]  C R Bird,et al.  Gliomas: classification with MR imaging. , 1990, Radiology.

[30]  A. W. Simonetti,et al.  Development of a decision support system for diagnosis and grading of brain tumours using in vivo magnetic resonance single voxel spectra , 2006, NMR in biomedicine.

[31]  Arend Heerschap,et al.  A chemometric approach for brain tumor classification using magnetic resonance imaging and spectroscopy. , 2003, Analytical chemistry.

[32]  G. Brier VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[33]  Thomas G. Dietterich Machine-Learning Research Four Current Directions , 1997 .

[34]  R L Ehman,et al.  Cerebral astrocytomas: histopathologic correlation of MR and CT contrast enhancement with stereotactic biopsy. , 1988, Radiology.

[35]  D. van Ormondt,et al.  SVD-based quantification of magnetic resonance signals , 1992 .

[36]  Johan A. K. Suykens,et al.  Automatic relevance determination for Least Squares Support Vector Machines classifiers , 2001, ESANN.

[37]  Ron Kohavi,et al.  Irrelevant Features and the Subset Selection Problem , 1994, ICML.

[38]  D. Arnold,et al.  Using pattern analysis of in vivo proton MRSI data to improve the diagnosis and surgical management of patients with brain tumors , 1998, NMR in biomedicine.

[39]  Temple F. Smith Occam's razor , 1980, Nature.

[40]  A W Simonetti,et al.  Automated correction of unwanted phase jumps in reference signals which corrupt MRSI spectra after eddy current correction. , 2002, Journal of magnetic resonance.

[41]  Michael H. Kutner Applied Linear Statistical Models , 1974 .

[42]  A. Tamhane,et al.  Multiple Comparison Procedures , 2009 .

[43]  A. W. Simonetti,et al.  Investigation of brain tumor classification and its reliability using chemometrics on MR spectroscopy and MR imaging data , 2004 .

[44]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[45]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[46]  Eric R. Ziegel,et al.  Engineering Statistics , 2004, Technometrics.

[47]  Philippe Refregier,et al.  PROBABILISTIC APPROACH FOR MULTICLASS CLASSIFICATION WITH NEURAL NETWORKS , 1991 .

[48]  G. McLachlan Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[49]  Shigeo Abe,et al.  Support Vector Machines for Pattern Classification (Advances in Pattern Recognition) , 2005 .

[50]  Chih-Jen Lin,et al.  Probability Estimates for Multi-class Classification by Pairwise Coupling , 2003, J. Mach. Learn. Res..

[51]  Carles Arús,et al.  Automated classification of short echo time in in vivo 1H brain tumor spectra: A multicenter study , 2003, Magnetic resonance in medicine.

[52]  Yoram Singer,et al.  Reducing Multiclass to Binary: A Unifying Approach for Margin Classifiers , 2000, J. Mach. Learn. Res..

[53]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[54]  Ulrich H.-G. Kreßel,et al.  Pairwise classification and support vector machines , 1999 .

[55]  V. Govindaraju,et al.  Proton NMR chemical shifts and coupling constants for brain metabolites , 2000, NMR in biomedicine.

[56]  Douglas A. Wolfe,et al.  Nonparametric Statistical Methods , 1973 .