Impact of computer-aided detection systems on radiologist accuracy with digital mammography.

OBJECTIVE The purpose of this study was to assess the impact of computer-aided detection (CAD) systems on the performance of radiologists with digital mammograms acquired during the Digital Mammographic Imaging Screening Trial (DMIST). MATERIALS AND METHODS Only those DMIST cases with proven cancer status by biopsy or 1-year follow-up that had available digital images were included in this multireader, multicase ROC study. Two commercially available CAD systems for digital mammography were used: iCAD SecondLook, version 1.4; and R2 ImageChecker Cenova, version 1.0. Fourteen radiologists interpreted, without and with CAD, a set of 300 cases (150 cancer, 150 benign or normal) on the iCAD SecondLook system, and 15 radiologists interpreted a different set of 300 cases (150 cancer, 150 benign or normal) on the R2 ImageChecker Cenova system. RESULTS The average AUC was 0.71 (95% CI, 0.66-0.76) without and 0.72 (95% CI, 0.67-0.77) with the iCAD system (p = 0.07). Similarly, the average AUC was 0.71 (95% CI, 0.66-0.76) without and 0.72 (95% CI 0.67-0.77) with the R2 system (p = 0.08). Sensitivity and specificity differences without and with CAD for both systems also were not significant. CONCLUSION Radiologists in our studies rarely changed their diagnostic decisions after the addition of CAD. The application of CAD had no statistically significant effect on radiologist AUC, sensitivity, or specificity performance with digital mammograms from DMIST.

[1]  Clinically Missed Cancer: How Effectively Can Radiologists Use Computer-Aided Detection?: Nishikawa RM, Schmidt RA, Linver MN, et al (Univ of Chicago, IL; X-Ray Associates of New Mexico, Albuquerque; et al) AJR Am J Roentgenol 198:708-716, 2012§ , 2013 .

[2]  Laurie L Fajardo,et al.  Assessing the stand-alone sensitivity of computer-aided detection with cancer cases from the Digital Mammographic Imaging Screening Trial. , 2012, AJR. American journal of roentgenology.

[3]  John Papaioannou,et al.  Clinically missed cancer: how effectively can radiologists use computer-aided detection? , 2012, AJR. American journal of roentgenology.

[4]  C. D'Orsi,et al.  Effectiveness of computer-aided detection in community mammography practice. , 2011, Journal of the National Cancer Institute.

[5]  Mary C. Mahoney,et al.  False Positive Marks on Unsuspicious Screening Mammography with Computer-Aided Detection , 2011, Journal of Digital Imaging.

[6]  Thomas Helbich,et al.  Performance of computer-aided detection applied to full-field digital mammography in detection of breast cancers. , 2011, European journal of radiology.

[7]  J. Hoffmeister,et al.  Computer-aided detection system applied to full-field digital mammograms , 2010, Acta radiologica.

[8]  Jonathan H Sunshine,et al.  How widely is computer-aided detection used in screening and diagnostic mammography? , 2010, Journal of the American College of Radiology : JACR.

[9]  S. Astley,et al.  Mammographic features of breast cancers at single reading with computer-aided detection and at double reading in a large multicenter prospective trial of computer-aided detection: CADET II. , 2010, Radiology.

[10]  W. Barlow,et al.  Time trends in radiologists' interpretive performance at screening mammography from the community-based Breast Cancer Surveillance Consortium, 1996-2004. , 2010, Radiology.

[11]  Anabel M Scaranelo,et al.  Sensitivity of a Direct Computer-aided Detection System in Full-field Digital Mammography for Detection of Microcalcifications Not Associated with Mass or Architectural Distortion , 2010, Canadian Association of Radiologists journal = Journal l'Association canadienne des radiologistes.

[12]  Frank J. H. M. van den Biggelaar,et al.  Computer-aided detection in full-field digital mammography in a clinical population: performance of radiologist and technologists , 2010, Breast Cancer Research and Treatment.

[13]  Laurie L Fajardo,et al.  Cancer cases from ACRIN digital mammographic imaging screening trial: radiologist analysis with use of a logistic regression model. , 2009, Radiology.

[14]  Constantine Gatsonis,et al.  Comparison of soft-copy and hard-copy reading for full-field digital mammography. , 2009, Radiology.

[15]  Constantine Gatsonis,et al.  Accuracy of soft-copy digital mammography versus that of screen-film mammography according to digital manufacturer: ACRIN DMIST retrospective multireader study. , 2008, Radiology.

[16]  Susan M Astley,et al.  Single reading with computer-aided detection and double reading of screening mammograms in the United Kingdom National Breast Screening Program. , 2006, Radiology.

[17]  C. D'Orsi,et al.  Diagnostic Performance of Digital Versus Film Mammography for Breast-Cancer Screening , 2005, The New England journal of medicine.

[18]  Wei Qian,et al.  CAD-Aided Mammogram Training1 , 2005 .

[19]  Constantine A Gatsonis,et al.  American College of Radiology Imaging Network digital mammographic imaging screening trial: objectives and methodology. , 2005, Radiology.

[20]  M. Pamilo,et al.  Does computer‐aided detection assist in the early detection of breast cancer? , 2005, Acta radiologica.

[21]  K. Kinkel,et al.  Computer-aided detection (CAD) in mammography: does it help the junior or the senior radiologist? , 2005, European journal of radiology.

[22]  K. Kerlikowske,et al.  Breast Cancer Surveillance Consortium: a national mammography screening and outcomes database. , 1997, AJR. American journal of roentgenology.

[23]  C Beam,et al.  Variability in mammogram interpretation. , 1996, Administrative radiology journal : AR.

[24]  N A Obuchowski,et al.  Multireader receiver operating characteristic studies: a comparison of study designs. , 1995, Academic radiology.

[25]  N A Obuchowski,et al.  Multireader, multimodality receiver operating characteristic curve studies: hypothesis testing and sample size estimation using an analysis of variance approach with dependent observations. , 1995, Academic radiology.

[26]  N. Breslow,et al.  Approximate inference in generalized linear mixed models , 1993 .