Blinded comparison of computer-aided detection with human second reading in screening mammography.

OBJECTIVE The purpose of this study was to compare a human second reader with computer-aided detection (CAD) for the reduction of false-negative cases by a primary radiologist. We retrospectively reviewed our clinical practice. MATERIALS AND METHODS We found that 6,381 consecutive screening mammograms were interpreted by a primary reader. This radiologist then reinterpreted the studies using CAD ("CAD reader"). A second human reader who was blinded to the CAD results but knowledgeable of the primary reader's findings reviewed the studies, looking for abnormalities not seen by the first reader. RESULTS Two cancers were called back by the second human reader that were not called back by the CAD reader; however, the CAD system had marked the findings, but they were dismissed by the primary reader. Because of the small numbers, the difference between the CAD and second human reader was not statistically significant. The CAD and human second readers increased the recall rates 6.4% and 7.2% (p = 0.70), respectively, and the biopsy rates 10% and 14.7%. The positive predictive value was 0% (0/3) for the CAD reader and was 40% (2/5) for the human second reader. The relative increases in the cancer detection rate compared with the primary reader's detection rate were 0% for the CAD reader and 15.4% (2/13) for the human second reader (p = 0.50). CONCLUSION A human second reader or the use of a CAD system can increase the cancer detection rate, but we found no statistical difference between the two because of the small sample size. A possible benefit from a human second reader is that CAD systems can only point to possible abnormalities, whereas a human must determine the significance of the finding. Having two humans review a study may increase detection rates due to interpreter--hence, perceptual--variability and not just increased detection.

[1]  Physicians' opinions on the delivery of mammographic screening services: immediate interpretation versus double reading. , 1996, AJR. American journal of roentgenology.

[2]  D. Ikeda,et al.  Mammographic characteristics of 115 missed cancers later detected with screening mammography and the potential utility of computer-aided detection. , 2001, Radiology.

[3]  E A Sickles,et al.  Medical audit of a rapid-throughput mammography screening practice: methodology and results of 27,114 examinations. , 1990, Radiology.

[4]  Rachel F Brem,et al.  Blinded comparison of computer-aided detection with human second reading in screening mammography: the importance of the question and the critical numbers game. , 2007, AJR. American journal of roentgenology.

[5]  E. Thurfjell,et al.  Benefit of independent double reading in a population-based mammography screening program. , 1994, Radiology.

[6]  M Moskowitz Retrospective reviews of breast cancer screening: what do we really learn from them? , 1996, Radiology.

[7]  S Ciatto,et al.  Comparison of standard and double reading and computer-aided detection (CAD) of interval cancers at prior negative screening mammograms: blind review , 2003, British Journal of Cancer.

[8]  J. Baker,et al.  Computer-aided detection (CAD) in screening mammography: sensitivity of commercial CAD systems for detecting architectural distortion. , 2003, AJR. American journal of roentgenology.

[9]  S. Astley Computer-based detection and prompting of mammographic abnormalities. , 2004, The British journal of radiology.

[10]  J. Elmore,et al.  Accuracy of screening mammography using single versus independent double interpretation. , 2000, AJR. American journal of roentgenology.

[11]  M Moskowitz,et al.  Occult breast cancer: prevalence and radiographic detectability. , 1987, Radiology.

[12]  Debra M Ikeda,et al.  Computer-aided detection with screening mammography in a university hospital setting. , 2005, Radiology.

[13]  L. Tabár,et al.  Update of the Swedish two-county program of mammographic screening for breast cancer. , 1992, Radiologic clinics of North America.

[14]  Margarita L Zuley,et al.  Can computer-aided detection with double reading of screening mammograms help decrease the false-negative rate? Initial experience. , 2004, Radiology.

[15]  R. Bird Professional quality assurance for mammography screening programs. , 1990, Radiology.

[16]  S. Astley,et al.  Single reading with computer-aided detection for screening mammography. , 2008, The New England journal of medicine.

[17]  Nico Karssemeijer,et al.  Computer-aided detection versus independent double reading of masses on mammograms. , 2003, Radiology.

[18]  Mary Scott Soo,et al.  Computer-aided detection of amorphous calcifications. , 2005, AJR. American journal of roentgenology.

[19]  KathleenR. Brandt,et al.  Screening mammograms: interpretation with computer-aided detection--prospective evaluation. , 2006, Radiology.

[20]  C. D'Orsi,et al.  Influence of computer-aided detection on performance of screening mammography. , 2007, The New England journal of medicine.

[21]  Blinded Comparison of Computer-Aided Detection with Human Second Reading in Screening Mammography , 2008 .

[22]  Paul Taylor,et al.  Computer aids and human second reading as interventions in screening mammography: two systematic reviews to compare effects on cancer detection and recall rate. , 2008, European journal of cancer.

[23]  T. Freer,et al.  Screening mammography with computer-aided detection: prospective study of 12,860 patients in a community breast center. , 2001, Radiology.

[24]  Debra M Ikeda,et al.  Computer-aided detection output on 172 subtle findings on normal mammograms previously obtained in women with breast cancer detected at follow-up screening mammography. , 2004, Radiology.