Accuracy and interpretation time of computer-aided detection among novice and experienced breast MRI readers.

OBJECTIVE The purpose of this study was to compare the diagnostic accuracy and interpretation times of breast MRI with and without use of a computer-aided detection (CAD) system by novice and experienced readers. SUBJECTS AND METHODS A reader study was undertaken with 20 radiologists, nine experienced and 11 novice. Each radiologist participated in two reading sessions spaced 6 months apart that consisted of 70 cases (27 benign, 43 malignant), read with and without CAD assistance. Sensitivity, specificity, negative predictive value, positive predictive value, and overall accuracy as measured by the area under the receiver operating characteristic curve (AUC) were reported for each radiologist. Accuracy comparisons across use of CAD and experience level were examined. Time to interpret and report on each case was recorded. RESULTS CAD improved sensitivity for both experienced (AUC, 0.91 vs 0.84; 95% CI on the difference, 0.04, 0.11) and novice readers (AUC, 0.83 vs 0.77; 95% CI on the difference, 0.01, 0.10). The increase in sensitivity was statistically higher for experienced readers (p = 0.01). Diagnostic accuracy, measured by AUC, for novices without CAD was 0.77, for novices with CAD was 0.79, for experienced readers without CAD was 0.80, and for experienced readers with CAD was 0.83. An upward trend was noticed, but the differences were not statistically significant. There were no significant differences in interpretation times. CONCLUSION MRI sensitivity improved with CAD for both experienced readers and novices with no overall increase in time to evaluate cases. However, overall accuracy was not significantly improved. As the use of breast MRI with CAD increases, more attention to the potential contributions of CAD to the diagnostic accuracy of MRI is needed.

[1]  M. Pepe,et al.  Comparisons of Predictive Values of Binary Medical Diagnostic Tests for Paired Designs , 2000, Biometrics.

[2]  J. Blume.  Bounding Sample Size Projections for the Area Under a ROC Curve. , 2009, Journal of statistical planning and inference.

[3]  Constantine Gatsonis,et al.  Screening women at high risk for breast cancer with mammography and magnetic resonance imaging , 2005, Cancer.

[4]  Wendy B DeMartini,et al.  Breast MR imaging: computer-aided evaluation program for discriminating benign from malignant lesions. , 2007, Radiology.

[5]  S. Edge,et al.  Indications for breast MRI in the patient with newly diagnosed breast cancer. , 2009, Journal of the National Comprehensive Cancer Network : JNCCN.

[6]  N. Hylton,et al.  Diagnostic architectural and dynamic features at breast MR imaging: multicenter study. , 2006, Radiology.

[7]  Willem P. Th. M. Mali,et al.  Computer-aided detection (CAD) for breast MRI: evaluation of efficacy at 3.0 T , 2009, European Radiology.

[8]  Jennifer B Kaplan,et al.  MR imaging findings in the contralateral breast of women with recently diagnosed breast cancer. , 2003, AJR. American journal of roentgenology.

[9]  Wendy B DeMartini,et al.  MRI-detected suspicious breast lesions: predictive values of kinetic features measured by computer-aided evaluation. , 2009, AJR. American journal of roentgenology.

[10]  Elizabeth A Morris,et al.  MR imaging of the ipsilateral breast in women with percutaneously proven breast cancer. , 2003, AJR. American journal of roentgenology.

[11]  N A Obuchowski,et al.  Sample size determination for diagnostic accuracy studies involving binormal ROC curve indices. , 1997, Statistics in medicine.

[12]  N A Obuchowski,et al.  Computing Sample Size for Receiver Operating Characteristic Studies , 1994, Investigative radiology.

[13]  P. Diggle,et al.  Analysis of Longitudinal Data , 2003 .

[14]  Wendy B DeMartini,et al.  A new automated software system to evaluate breast MR examinations: improved specificity without decreased sensitivity. , 2006, AJR. American journal of roentgenology.

[15]  C. Gatsonis,et al.  MRI evaluation of the contralateral breast in women with recently diagnosed breast cancer. , 2007, The New England journal of medicine.

[16]  Maciej A Mazurowski,et al.  Radiogenomic analysis of breast cancer: luminal B molecular subtype is associated with enhancement dynamics at MR imaging. , 2014, Radiology.

[17]  N A Obuchowski,et al.  Sample size calculations in studies of test accuracy , 1998, Statistical methods in medical research.

[18]  Xiao-Hua Zhou,et al.  Statistical Methods in Diagnostic Medicine , 2002 .

[19]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[20]  N A Obuchowski,et al.  Multireader, multimodality receiver operating characteristic curve studies: hypothesis testing and sample size estimation using an analysis of variance approach with dependent observations. , 1995, Academic radiology.

[21]  Maryellen L. Giger,et al.  Evaluation of clinical breast MR imaging performed with prototype computer-aided diagnosis breast MR imaging workstation: reader study. , 2011, Radiology.

[22]  Roberta A. Jong,et al.  Can breast MRI computer-aided detection (CAD) improve radiologist accuracy for lesions detected at MRI screening and recommended for biopsy in a high-risk population? , 2009, Clinical radiology.

[23]  C A Roe,et al.  Statistical Comparison of Two ROC-curve Estimates Obtained from Partially-paired Datasets , 1998, Medical decision making : an international journal of the Society for Medical Decision Making.

[24]  Petrina Causer,et al.  MRI detection of distinct incidental cancer in women with primary breast cancer studied in IBMC 6883 , 2005, Journal of surgical oncology.

[25]  C. Lehman,et al.  The role of MRI in breast cancer screening. , 2009, Journal of the National Comprehensive Cancer Network : JNCCN.

[26]  Mitchell D Schnall,et al.  MR imaging screening of the contralateral breast in patients with newly diagnosed breast cancer: preliminary results. , 2003, Radiology.

[27]  N. Obuchowski,et al.  Hypothesis testing of diagnostic accuracy for multiple readers and multiple tests: An anova approach with dependent observations , 1995 .

[28]  M. Yaffe,et al.  American Cancer Society Guidelines for Breast Screening with MRI as an Adjunct to Mammography , 2007 .

[29]  W. Moon,et al.  Computer-aided evaluation as an adjunct to revised BI-RADS Atlas: improvement in positive predictive value at screening breast MRI , 2014, European Radiology.

[30]  C. Metz,et al.  Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. , 1998, Statistics in medicine.

[31]  A. Schauer,et al.  Prognostic value of contrast-enhanced MR mammography in patients with breast cancer , 1997, European Radiology.