Computerized assessment of breast lesion malignancy using DCE-MRI robustness study on two independent clinical datasets from two manufacturers.

RATIONALE AND OBJECTIVES To conduct a preclinical evaluation of the robustness of our computerized system for breast lesion characterization on two breast magnetic resonance imaging (MRI) databases that were acquired using scanners from two different manufacturers. MATERIALS AND METHODS Two clinical breast MRI databases were acquired from a Siemens scanner and a GE scanner, which shared similar imaging protocols and retrospectively collected under an institutional review board-approved protocol. In our computerized analysis system, after a breast lesion is identified by the radiologist, the computer performs automatic lesion segmentation and feature extraction and outputs an estimated probability of malignancy. We used a Bayesian neural network with automatic relevance determination for joint feature selection and classification. To evaluate the robustness of our classification system, we first used Database 1 for feature selection and classifier training, and Database 2 to test the trained classifier. Then, we exchanged the two datasets and repeated the process. Area under the receiver operating characteristic curve (AUC) was used as a performance figure of merit in the task of distinguishing between malignant and benign lesions. RESULTS We obtained an AUC of 0.85 (approximate 95% confidence interval [CI] 0.79-0.91) for (a) feature selection and classifier training using Database 1 and testing on Database 2; and an AUC of 0.90 (approximate 95% CI 0.84-0.96) for (b) feature selection and classifier training using Database 2 and testing on Database 1. We failed to observe statistical significance for the difference AUC of 0.05 between the two database conditions (P = .24; 95% confidence interval -0.03, 0.1). CONCLUSION These results demonstrate the robustness of our computerized classification system in the task of distinguishing between malignant and benign breast lesions on dynamic contrast-enhanced (DCE) MRI images from two manufacturers. Our study showed the feasibility of developing a computerized classification system that is robust across different scanners.

[1]  M. Giger,et al.  Breast cancer: effectiveness of computer-aided diagnosis observer study with independent database of mammograms. , 2002, Radiology.

[2]  Dirk Husmeier.  Automatic Relevance Determination (ARD) , 1999 .

[3]  Scott F. Thompson,et al.  Morphologic blooming in breast MRI as a characterization of margin for discriminating benign from malignant lesions. , 2006, Academic radiology.

[4]  M D Schnall,et al.  Discrimination of MR images of breast masses with fractal-interpolation function models. , 1999, Academic radiology.

[5]  N. Hylton,et al.  Diagnostic architectural and dynamic features at breast MR imaging: multicenter study. , 2006, Radiology.

[6]  L. Turnbull,et al.  Textural analysis of contrast‐enhanced MR images of the breast , 2003, Magnetic resonance in medicine.

[7]  D. Mackay,et al.  Bayesian methods for adaptive models , 1992 .

[8]  Hon J. Yu,et al.  Quantitative analysis of lesion morphology and texture features for diagnostic prediction in breast MRI. , 2008, Academic radiology.

[9]  M. Giger,et al.  Automatic identification and classification of characteristic kinetic curves of breast lesions on DCE-MRI. , 2006, Medical physics.

[10]  C K Kuhl,et al.  Dynamic image interpretation of MRI of the breast , 2000, Journal of magnetic resonance imaging : JMRI.

[11]  Kenneth G A Gilhuijs,et al.  Clinically and mammographically occult breast lesions on MR images: potential effect of computerized assessment on clinical reading. , 2005, Radiology.

[12]  Geoffrey E. Hinton,et al.  Bayesian Learning for Neural Networks , 1995 .

[13]  W. Kaiser,et al.  MR imaging of the breast: fast imaging sequences with and without Gd-DTPA. Preliminary observations. , 1989, Radiology.

[14]  Guang-Zhong Yang,et al.  Bayesian Methods for Pharmacokinetic Models in Dynamic Contrast-Enhanced Magnetic Resonance Imaging , 2006, IEEE Transactions on Medical Imaging.

[15]  Ian T. Nabney,et al.  Netlab: Algorithms for Pattern Recognition , 2002 .

[16]  Lina Arbash Meinel,et al.  Breast MRI lesion classification: Improved performance of human readers with a backpropagation neural network computer‐aided diagnosis (CAD) system , 2007, Journal of magnetic resonance imaging : JMRI.

[17]  Tahsin Kurc,et al.  Malignant‐lesion segmentation using 4D co‐occurrence texture analysis applied to dynamic contrast‐enhanced magnetic resonance breast image data , 2007, Journal of magnetic resonance imaging : JMRI.

[18]  Erez Eyal,et al.  Model‐based and model‐free parametric analysis of breast dynamic‐contrast‐enhanced MRI , 2009, NMR in biomedicine.

[19]  C E Metz,et al.  Quantification of failure to demonstrate statistical significance. The usefulness of confidence intervals. , 1993, Investigative radiology.

[20]  Maryellen L. Giger,et al.  Joint feature selection and classification using a Bayesian neural network with automatic relevance determination priors: potential use in CAD of medical imaging , 2007, SPIE Medical Imaging.

[21]  M L Giger,et al.  Computerized analysis of breast lesions in three dimensions using dynamic magnetic-resonance imaging. , 1998, Medical physics.

[22]  C. Metz,et al.  Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. , 1998, Statistics in medicine.

[23]  C. Kuhl.  Current status of breast MR imaging. Part 2. Clinical applications. , 2007, Radiology.

[24]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[25]  Peter Aspelin,et al.  Application of artificial neural networks to the analysis of dynamic MR imaging features of the breast , 2004, European Radiology.

[26]  Anne L. Martel,et al.  Classification of Dynamic Contrast-Enhanced Magnetic Resonance Breast Lesions by Support Vector Machines , 2008, IEEE Transactions on Medical Imaging.

[27]  W. Kaiser,et al.  Development, standardization, and testing of a lexicon for reporting contrast‐enhanced breast magnetic resonance imaging studies , 2001, Journal of magnetic resonance imaging : JMRI.

[28]  M. Giger,et al.  Computerized interpretation of breast MRI: investigation of enhancement-variance dynamics. , 2004, Medical physics.

[29]  G Brix,et al.  Classification of signal-time curves from dynamic MR mammography by neural networks. , 2001, Magnetic resonance imaging.

[30]  Wendy B DeMartini,et al.  Breast MR imaging: computer-aided evaluation program for discriminating benign from malignant lesions. , 2007, Radiology.

[31]  M. Giger,et al.  Volumetric texture analysis of breast lesions on contrast‐enhanced magnetic resonance images , 2007, Magnetic resonance in medicine.

[32]  Maryellen L. Giger,et al.  A Fuzzy C-Means (FCM)-Based Approach for Computerized Segmentation of Breast Lesions in Dynamic Contrast-Enhanced MR Images1 , 2006 .

[33]  N. Petrick,et al.  Improvement of radiologists' characterization of mammographic masses by using computer-aided diagnosis: an ROC study. , 1999, Radiology.

[34]  Maryellen L. Giger,et al.  Ideal observer approximation using Bayesian classification neural networks , 2001, IEEE Transactions on Medical Imaging.

[35]  M. Giger,et al.  Improving breast cancer diagnosis with computer-aided diagnosis. , 1999, Academic radiology.

[36]  M L Giger,et al.  Feature selection with limited datasets. , 1999, Medical physics.

[37]  K. Doi,et al.  Potential of computer-aided diagnosis to reduce variability in radiologists' interpretations of mammograms depicting microcalcifications. , 2001, Radiology.

[38]  Wendy B DeMartini,et al.  Breast MRI for cancer detection and characterization: a review of evidence-based clinical applications. , 2008, Academic radiology.

[39]  Maryellen L Giger,et al.  Prevalence scaling: applications to an intelligent workstation for the diagnosis of breast cancer. , 2008, Academic radiology.

[40]  Michael Brady,et al.  Analysis of dynamic MR breast images using a model of contrast enhancement , 1997, Medical Image Anal..

[41]  C. Gatsonis,et al.  MRI evaluation of the contralateral breast in women with recently diagnosed breast cancer. , 2007, The New England journal of medicine.

[42]  C. Kuhl.  The current status of breast MR imaging. Part I. Choice of technique, image interpretation, diagnostic accuracy, and transfer to clinical practice. , 2007, Radiology.

[43]  Min-Ying Su,et al.  Prediction of malignant breast lesions from MRI features: a comparison of artificial neural network and logistic regression techniques. , 2009, Academic radiology.

[44]  Xiaobing Fan,et al.  Kinetic curves of malignant lesions are not consistent across MRI systems: need for improved standardization of breast dynamic contrast-enhanced MRI acquisition. , 2009, AJR. American journal of roentgenology.

[45]  Nancy R. Cook,et al.  Use and Misuse of the Receiver Operating Characteristic Curve in Risk Prediction , 2007, Circulation.

[46]  M. Yaffe,et al.  American Cancer Society Guidelines for Breast Screening with MRI as an Adjunct to Mammography , 2007 .

[47]  Tim W. Nattkemper,et al.  An Adaptive Tissue Characterisation Network for Model-Free Visualisation of Dynamic Contrast-Enhanced Magnetic Resonance Image Data , 2005 .

[48]  Harrison H. Barrett,et al.  Foundations of Image Science , 2003, J. Electronic Imaging.