Mimicking the human expert: Pattern recognition for an automated assessment of data quality in MR spectroscopic images

Besides the diagnostic evaluation of a spectrum, the assessment of its quality and a check for plausibility of its information remains a highly interactive and thus time‐consuming process in MR spectroscopic imaging (MRSI) data analysis. In the automation of this quality control, a score is proposed that is obtained by training a machine learning classifier on a representative set of spectra that have previously been classified by experts into evaluable data and nonevaluable data. In the first quantitative evaluation of different quality measures on a test set of 45,312 long echo time spectra in the diagnosis of brain tumor, the proposed pattern recognition (using the random forest classifier) separated high‐ and low‐quality spectra comparable to the human operator (area‐under‐the‐curve of the receiver‐operator‐characteristic, AUC >0.993), and performed better than decision rules based on the signal‐to‐noise‐ratio (AUC <0.934) or the estimated Cramér‐Rao‐bound on the errors of a spectral fitting (AUC <0.952). This probabilistic assessment of the data quality provides comprehensible confidence images and allows filtering the input of any subsequent data processing, i.e., quantitation or pattern recognition, in an automated fashion. It thus can increase robustness and reliability of the final diagnostic evaluation and allows for the automation of a tedious part of MRSI data analysis. Magn Reson Med, 2008. © 2008 Wiley‐Liss, Inc.

[1]  Filippo Neri,et al.  Learning in the “Real World” , 1998, Machine Learning.

[2]  Klaas Nicolay,et al.  1H MR spectroscopy of the brain: absolute quantification of metabolites. , 2006, Radiology.

[3]  D. Graveron-Demilly,et al.  Java-based graphical user interface for the MRUI quantitation package , 2001, Magnetic Resonance Materials in Physics, Biology and Medicine.

[4]  Sabine Van Huffel,et al.  Tissue segmentation and classification of MRSI data using canonical correlation analysis , 2005, Magnetic resonance in medicine.

[5]  S. Provencher Estimation of metabolite concentrations from localized in vivo proton NMR spectra , 1993, Magnetic resonance in medicine.

[6]  A. W. Simonetti,et al.  Development of a decision support system for diagnosis and grading of brain tumours using in vivo magnetic resonance single voxel spectra , 2006, NMR in biomedicine.

[7]  Carles Arús,et al.  Automated classification of short echo time in in vivo 1H brain tumor spectra: A multicenter study , 2003, Magnetic resonance in medicine.

[8]  S Van Huffel,et al.  Comments on “Confidence Images for MR Spectroscopic Imaging” by Karl Young, Dennis Khetselius, Brian J. Soher, and Andrew A. Maudsley (Magn Reson Med 2000;44:537–545) , 2001, Magnetic resonance in medicine.

[9]  B Michael Kelm,et al.  Automated estimation of tumor probability in prostate magnetic resonance spectroscopic imaging: Pattern recognition vs quantification , 2007, Magnetic resonance in medicine.

[10]  D van Ormondt,et al.  Cramér–Rao bounds: an evaluation tool for quantitation , 2001, NMR in biomedicine.

[11]  Sabine Van Huffel,et al.  Brain tumor classification based on long echo proton MRS signals , 2004, Artif. Intell. Medicine.

[12]  Thomas Lengauer,et al.  ROCR: visualizing classifier performance in R , 2005, Bioinform..

[13]  Vanhamme,et al.  Improved method for accurate and efficient quantification of MRS data with use of prior knowledge , 1997, Journal of magnetic resonance.

[14]  B J Soher,et al.  Confidence images for MR spectroscopic imaging , 2000, Magnetic resonance in medicine.

[15]  M. Sdika,et al.  Time‐domain semi‐parametric estimation based on a metabolite basis set , 2005, NMR in biomedicine.

[16]  Andrew A Maudsley,et al.  Can MR spectroscopy ever be simple and effective? , 2005, AJNR. American journal of neuroradiology.

[17]  L O Hall,et al.  Comprehensive processing, display and analysis for in vivo MR spectroscopic imaging , 2006, NMR in biomedicine.

[18]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[19]  Ross Ihaka,et al.  Gentleman R: R: A language for data analysis and graphics , 1996 .

[20]  U. Klose,et al.  Error images for spectroscopic imaging by LCModel using Cramer–Rao bounds , 2006, Magnetic Resonance Materials in Physics, Biology and Medicine.

[21]  Bjoern H. Menze,et al.  Machine-Based Rejection of Low-Quality Spectra and Estimation of Brain Tumor Probabilities from Magnetic Resonance Spectroscopic Images , 2006, Bildverarbeitung für die Medizin.

[22]  G. Hagberg,et al.  From magnetic resonance spectroscopy to classification of tumors. A review of pattern recognition methods , 1998, NMR in biomedicine.

[23]  V. Govindaraju,et al.  Automated spectral analysis III: Application to in Vivo proton MR Spectroscopy and spectroscopic imaging , 1998, Magnetic resonance in medicine.

[24]  Bjoern H Menze,et al.  Optimal classification of long echo time in vivo magnetic resonance spectra in the detection of recurrent brain tumors , 2006, NMR in biomedicine.

[25]  A Ebel,et al.  Assessment of 3D proton MR echo‐planar spectroscopic imaging using automated spectral analysis , 2001, Magnetic resonance in medicine.

[26]  Rajarshi Guha,et al.  Determining the Validity of a QSAR Model - A Classification Approach , 2005, J. Chem. Inf. Model..

[27]  G. Seber,et al.  Nonlinear Regression: Seber/Nonlinear Regression , 2005 .

[28]  C. Elster,et al.  Quantitative magnetic resonance spectroscopy: Semi‐parametric modeling and determination of uncertainties , 2005, Magnetic resonance in medicine.

[29]  P Bachert,et al.  Proton MR spectroscopic evaluation of suspicious brain lesions after stereotactic radiotherapy. , 2001, AJNR. American journal of neuroradiology.

[30]  R. Kreis Issues of spectral quality in clinical 1H‐magnetic resonance spectroscopy and a gallery of artifacts , 2004, NMR in biomedicine.

[31]  J. Suykens,et al.  Classification of brain tumours using short echo time 1H MR spectra. , 2004, Journal of magnetic resonance.