Improving computer‐aided detection assistance in breast cancer screening by removal of obviously false‐positive findings

Purpose Computer‐aided detection (CADe) systems for mammography screening still mark many false positives. This can cause radiologists to lose confidence in CADe, especially when many false positives are obviously not suspicious to them. In this study, we focus on obvious false positives generated by microcalcification detection algorithms. Methods We aim at reducing the number of obvious false‐positive findings by adding an additional step in the detection method. In this step, a multiclass machine learning method is implemented in which dedicated classifiers learn to recognize the patterns of obvious false‐positive subtypes that occur most frequently. The method is compared to a conventional two‐class approach, where all false‐positive subtypes are grouped together in one class, and to the baseline CADe system without the new false‐positive removal step. The methods are evaluated on an independent dataset containing 1,542 screening examinations of which 80 examinations contain malignant microcalcifications. Results Analysis showed that the multiclass approach yielded a significantly higher sensitivity compared to the other two methods (P < 0.0002). At one obvious false positive per 100 images, the baseline CADe system detected 61% of the malignant examinations, while the systems with the two‐class and multiclass false‐positive reduction step detected 73% and 83%, respectively. Conclusions Our study showed that by adding the proposed method to a CADe system, the number of obvious false positives can decrease significantly (P < 0.0002).

[1]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[2]  Nico Karssemeijer,et al.  Improved method for detection of microcalcification clusters in digital mammograms , 1999, Medical Imaging.

[3]  R. Warren,et al.  Mammography screening: an incremental cost effectiveness analysis of double versus single reading of mammograms , 1996, BMJ.

[4]  Jack Sklansky,et al.  Finding the convex hull of a simple polygon , 1982, Pattern Recognit. Lett..

[5]  N Karssemeijer,et al.  Automated classification of clustered microcalcifications into malignant and benign types. , 2000, Medical physics.

[6]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[7]  Tomaso A. Poggio,et al.  A general framework for object detection , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  L. Tabár,et al.  Swedish two-county trial: impact of mammographic screening on breast cancer mortality during 3 decades. , 2011, Radiology.

[9]  Antonio Torralba,et al.  Sharing Visual Features for Multiclass and Multiview Object Detection , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  L. Tabár,et al.  Potential contribution of computer-aided detection to the sensitivity of screening mammography. , 2000, Radiology.

[11]  C. D'Orsi,et al.  Influence of computer-aided detection on performance of screening mammography. , 2007, The New England journal of medicine.

[12]  Frank W. Samuelson,et al.  Comparing image detection algorithms using resampling , 2006, 3rd IEEE International Symposium on Biomedical Imaging: Nano to Macro, 2006..

[13]  L. Philpotts,et al.  Can computer-aided detection be detrimental to mammographic interpretation? , 2009, Radiology.

[14]  Robert M. Nishikawa,et al.  Current status and future directions of computer-aided diagnosis in mammography , 2007, Comput. Medical Imaging Graph..

[15]  N. Karssemeijer,et al.  Reducing false positives of microcalcification detection systems by removal of breast arterial calcifications. , 2016, Medical physics.

[16]  Yulei Jiang,et al.  A scaling transformation for classifier output based on likelihood ratio: applications to a CAD workstation for diagnosis of breast cancer. , 2012, Medical physics.

[17]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[18]  Frank W. Samuelson,et al.  The equivalence of a human observer and an ideal observer in binary diagnostic tasks , 2013, Medical Imaging.

[19]  C. Lehman,et al.  Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection. , 2015, JAMA internal medicine.

[20]  J. Reynolds,et al.  Impact of computer-aided detection in a regional screening mammography program. , 2005, AJR. American journal of roentgenology.

[21]  P. Taylor,et al.  A systematic review of computer-assisted diagnosis in diagnostic cancer imaging. , 2012, European journal of radiology.

[22]  Nico Karssemeijer,et al.  Learning from unbalanced data: A cascade-based approach for detecting clustered microcalcifications , 2014, Medical Image Anal..

[23]  L. Tabár,et al.  REDUCTION IN MORTALITY FROM BREAST CANCER AFTER MASS SCREENING WITH MAMMOGRAPHY Randomised Trial from the Breast Cancer Screening Working Group of the Swedish National Board of Health and Welfare , 1985, The Lancet.

[24]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[25]  Robert M. Nishikawa,et al.  A study on several Machine-learning methods for classification of Malignant and benign clustered microcalcifications , 2005, IEEE Transactions on Medical Imaging.

[26]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[27]  Nico Karssemeijer,et al.  Breast cancer screening results 5 years after introduction of digital mammography in a population-based screening program. , 2009, Radiology.

[28]  Laurie L Fajardo,et al.  Assessing the stand-alone sensitivity of computer-aided detection with cancer cases from the Digital Mammographic Imaging Screening Trial. , 2012, AJR. American journal of roentgenology.

[29]  Eveline A M Heijnsdijk,et al.  Nation-wide data on screening performance during the transition to digital mammography: observations in 6 million screens. , 2013, European journal of cancer.

[30]  Anna Bornefalk Hermansson,et al.  On the comparison of FROC curves in mammography CAD systems. , 2005, Medical physics.

[31]  R. Tibshirani,et al.  Additive Logistic Regression : a Statistical View ofBoostingJerome , 1998 .