Application of computer-aided diagnosis in breast ultrasound interpretation: improvements in diagnostic performance according to reader experience

Purpose The purpose of this study was to evaluate the usefulness of applying computer-aided diagnosis (CAD) to breast ultrasound (US), depending on the reader's experience with breast imaging. Methods Between October 2015 and January 2016, two experienced readers obtained and analyzed the grayscale US images of 200 cases according to the Breast Imaging Reporting and Data System (BI-RADS) lexicon and categories. They additionally applied CAD (S-Detect) to analyze the lesions and made a diagnostic decision subjectively, based on grayscale US with CAD. For the same cases, two inexperienced readers analyzed the grayscale US images using the BI-RADS lexicon and categories, added CAD, and came to a subjective diagnostic conclusion. We then compared the diagnostic performance depending on the reader's experience with breast imaging. Results The sensitivity values for the experienced readers, inexperienced readers, and CAD (for experienced and inexperienced readers) were 91.7%, 75.0%, 75.0%, and 66.7%, respectively. The specificity values for the experienced readers, inexperienced readers, and CAD (for experienced and inexperienced readers) were 76.6%, 71.8%, 78.2%, and 76.1%, respectively. When diagnoses were made subjectively in combination with CAD, the specificity significantly improved (76.6% to 80.3%) without a change in the sensitivity (91.7%) in the experienced readers. After subjective combination with CAD, both of the sensitivity and specificity improved in the inexperienced readers (75.0% to 83.3% and 71.8% to 77.1%). In addition, the area under the curve improved for both the experienced and inexperienced readers (0.84 to 0.86 and 0.73 to 0.80) after the addition of CAD. Conclusion CAD is more useful for less experienced readers. Combining CAD with breast US led to improved specificity for both experienced and inexperienced readers.

[1]  Isabelle Borget,et al.  Evaluation of the accuracy of a computer-aided diagnosis (CAD) system in breast ultrasound according to the radiologist's experience. , 2012, Academic radiology.

[2]  Xin Wang,et al.  Automatic detection of regions of interest in breast ultrasound images based on local phase information. , 2015, Bio-medical materials and engineering.

[3]  Si Eun Lee,et al.  Which supplementary imaging modality should be used for breast ultrasonography? Comparison of the diagnostic performance of elastography and computer-aided diagnosis , 2016, Ultrasonography.

[4]  Lubomir M. Hadjiiski,et al.  Malignant and benign breast masses on 3D US volumetric images: effect of computer-aided diagnosis on radiologist accuracy. , 2007, Radiology.

[5]  Yan Hui Guo,et al.  CAD algorithms for solid breast masses discrimination: evaluation of the accuracy and interobserver variability. , 2010, Ultrasound in medicine & biology.

[6]  Nico Karssemeijer,et al.  Computer-Aided Detection of Cancer in Automated 3-D Breast Ultrasound , 2013, IEEE Transactions on Medical Imaging.

[7]  Hong Wang,et al.  Novel Computer-Aided Diagnosis Algorithms on Ultrasound Image: Effects on Solid Breast Masses Discrimination , 2010, Journal of Digital Imaging.

[8]  Susan M. Schultz,et al.  Computer‐Based Margin Analysis of Breast Sonography for Differentiating Malignant and Benign Masses , 2004, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[9]  Eun-Kyung Kim,et al.  Clinical application of S-Detect to breast masses on ultrasonography: a study evaluating the diagnostic performance and agreement with a dedicated breast radiologist , 2016, Ultrasonography.

[10]  Eun-Kyung Kim,et al.  Application of Computer‐Aided Diagnosis on Breast Ultrasonography: Evaluation of Diagnostic Performances and Agreement of Radiologists According to Different Levels of Experience , 2018, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[11]  C. Balleyguier,et al.  Computed-aided diagnosis (CAD) in the detection of breast cancer. , 2013, European journal of radiology.

[12]  Ruey-Feng Chang,et al.  Automatic ultrasound segmentation and morphology based diagnosis of solid breast tumors , 2004, Breast Cancer Research and Treatment.

[13]  Maryellen L Giger,et al.  Performance of computer-aided diagnosis in the interpretation of lesions on breast sonography. , 2004, Academic radiology.

[14]  K. Han,et al.  Breast lesions on sonograms: computer-aided diagnosis with nearly setting-independent features and artificial neural networks. , 2003, Radiology.

[15]  A. Ben Hamida,et al.  Breast Cancer Ultrasound Images' Sequence Exploration Using BI-RADS Features' Extraction: Towards an Advanced Clinical Aided Tool for Precise Lesion Characterization , 2015, IEEE Transactions on NanoBioscience.

[16]  Jong Hyo Kim,et al.  Computerized scheme for assessing ultrasonographic features of breast masses. , 2005, Academic radiology.

[17]  R. Ma,et al.  Qualitative, quantitative and combination score systems in differential diagnosis of breast lesions by contrast-enhanced ultrasound. , 2016, European journal of radiology.

[18]  S. Duffy,et al.  Critical research gaps and translational priorities for the successful prevention and treatment of breast cancer , 2013, Breast Cancer Research.

[19]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[20]  Li Lan,et al.  Classification of breast lesions with multimodality computer-aided diagnosis: observer study results on an independent clinical data set. , 2006, Radiology.

[21]  M. Giger,et al.  Computerized detection and classification of cancer on breast ultrasound. , 2004, Academic radiology.