A deep learning framework for supporting the classification of breast lesions in ultrasound images

In this research, we exploited the deep learning framework to differentiate the distinctive types of lesions and nodules in breast acquired with ultrasound imaging. A biopsy-proven benchmarking dataset was built from 5151 patients cases containing a total of 7408 ultrasound breast images, representative of semi-automatically segmented lesions associated with masses. The dataset comprised 4254 benign and 3154 malignant lesions. The developed method includes histogram equalization, image cropping and margin augmentation. The GoogLeNet convolutionary neural network was trained to the database to differentiate benign and malignant tumors. The networks were trained on the data with augmentation and the data without augmentation. Both of them showed an area under the curve of over 0.9. The networks showed an accuracy of about 0.9 (90%), a sensitivity of 0.86 and a specificity of 0.96. Although target regions of interest (ROIs) were selected by radiologists, meaning that radiologists still have to point out the location of the ROI, the classification of malignant lesions showed promising results. If this method is used by radiologists in clinical situations it can classify malignant lesions in a short time and support the diagnosis of radiologists in discriminating malignant lesions. Therefore, the proposed method can work in tandem with human radiologists to improve performance, which is a fundamental purpose of computer-aided diagnosis.

[1]  Susan M. Astley,et al.  Automation in mammography: computer vision and human perception , 1993, Electronic Imaging.

[2]  G. Tourassi.  Journey toward computer-aided diagnosis: role of image texture analysis. , 1999, Radiology.

[3]  L. Tabár,et al.  Potential contribution of computer-aided detection to the sensitivity of screening mammography. , 2000, Radiology.

[4]  M K Markey,et al.  Application of the mutual information criterion for feature selection in computer-aided diagnosis. , 2001, Medical physics.

[5]  Berkman Sahiner,et al.  Computer-aided characterization of mammographic masses: accuracy of mass segmentation and its effects on characterization , 2001, IEEE Transactions on Medical Imaging.

[6]  K. Han,et al.  Breast lesions on sonograms: computer-aided diagnosis with nearly setting-independent features and artificial neural networks. , 2003, Radiology.

[7]  B. van Ginneken,et al.  Computer-aided diagnosis in high resolution CT of the lungs. , 2003, Medical physics.

[8]  C. D'Orsi,et al.  Accuracy of screening mammography interpretation by characteristics of radiologists. , 2004, Journal of the National Cancer Institute.

[9]  Hee Chan Kim,et al.  Computer-aided diagnosis of solid breast nodules: use of an artificial neural network based on multiple sonographic features , 2004, IEEE Transactions on Medical Imaging.

[10]  S. Armato,et al.  Automated lung segmentation for thoracic CT impact on computer-aided diagnosis. , 2004, Academic radiology.

[11]  Ingrid Schreer,et al.  Breast Cancer Early Detection , 2020, Definitions.

[12]  A. Malich,et al.  CAD for mammography: the technique, results, current role and further developments , 2006, European Radiology.

[13]  R. Schmidt,et al.  Comparison of independent double readings and computer-aided diagnosis (CAD) for the diagnosis of breast calcifications. , 2006, Academic radiology.

[14]  Lubomir M. Hadjiiski,et al.  Computer-aided diagnosis of pulmonary nodules on CT scans: segmentation and classification using 3D active contours. , 2006, Medical physics.

[15]  Chin-Shang Li,et al.  Distinguishing benign from malignant pulmonary nodules with helical chest CT in children with malignant solid tumors. , 2006, Radiology.

[16]  Takeshi Nakaura,et al.  Pulmonary nodules: estimation of malignancy at thin-section helical CT--effect of computer-aided diagnosis on performance of radiologists. , 2006, Radiology.

[17]  Kunio Doi,et al.  Computer-aided diagnosis in medical imaging: Historical review, current status and future potential , 2007, Comput. Medical Imaging Graph..

[18]  David S. Wishart,et al.  Applications of Machine Learning in Cancer Prediction and Prognosis , 2006, Cancer informatics.

[19]  Kemal Polat,et al.  A new hybrid method based on fuzzy-artificial immune system and k-nn algorithm for breast cancer diagnosis , 2007, Comput. Biol. Medicine.

[20]  M. Giger,et al.  Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM. , 2008, Medical physics.

[21]  Defeng Wang,et al.  Automatic detection of breast cancers in mammograms using structured support vector machines , 2009, Neurocomputing.

[22]  Berkman Sahiner,et al.  Computer-aided diagnosis of pulmonary nodules on CT scans: improvement of classification performance with nodule surface features. , 2009, Medical physics.

[23]  Hon J. Yu,et al.  Selection of diagnostic features on breast MRI to differentiate between malignant and benign lesions using computer-aided diagnosis: differences in lesions presenting as mass and non-mass-like enhancement , 2009, European Radiology.

[24]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[25]  Maryellen L. Giger,et al.  Automated Method for Improving System Performance of Computer-Aided Diagnosis in Breast Ultrasound , 2009, IEEE Transactions on Medical Imaging.

[26]  Mehmet Fatih Akay,et al.  Support vector machines combined with feature selection for breast cancer diagnosis , 2009, Expert Syst. Appl..

[27]  E. Burnside,et al.  Computer-aided diagnostic models in breast cancer screening. , 2010, Imaging in medicine.

[28]  Heng-Da Cheng,et al.  Detection and classification of masses in breast ultrasound images , 2010, Digit. Signal Process..

[29]  Jie-Zhi Cheng,et al.  Computer-aided US diagnosis of breast lesions by using cell-based contour grouping. , 2010, Radiology.

[30]  Chandan Chakraborty,et al.  Statistical analysis of mammographic features and its classification using support vector machine , 2010, Expert Syst. Appl..

[31]  Lauge Sørensen,et al.  Quantitative Analysis of Pulmonary Emphysema Using Local Binary Patterns , 2010, IEEE Transactions on Medical Imaging.

[32]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  L. Tabár,et al.  Swedish two-county trial: impact of mammographic screening on breast cancer mortality during 3 decades. , 2011, Radiology.

[34]  B. van Ginneken,et al.  Computer-aided diagnosis: how to move from the laboratory to the clinic. , 2011, Radiology.

[35]  Anat Kornecki,et al.  Current Status of Breast Ultrasound , 2011, Canadian Association of Radiologists journal = Journal l'Association canadienne des radiologistes.

[36]  Wagner Coelho A. Pereira,et al.  Analysis of Co-Occurrence Texture Statistics as a Function of Gray-Level Quantization for Classifying Breast Ultrasound , 2012, IEEE Transactions on Medical Imaging.

[37]  Pascal Getreuer,et al.  Chan-Vese Segmentation , 2012, Image Process. Line.

[38]  Seong-Whan Lee,et al.  Latent feature representation with stacked auto-encoder for AD/MCI diagnosis , 2013, Brain Structure and Function.

[39]  Xiuhua Guo,et al.  Computer-Aided Diagnosis for Early-Stage Lung Cancer Based on Longitudinal and Balanced Data , 2013, PloS one.

[40]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Dinggang Shen,et al.  Deep Learning-Based Feature Representation for AD/MCI Classification , 2013, MICCAI.

[42]  Simon J. Doran,et al.  Stacked Autoencoders for Unsupervised Feature Learning and Multiple Organ Detection in a Pilot Study Using 4D Patient Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Fabio A. González,et al.  A Deep Learning Architecture for Image Representation, Visual Interpretability and Automated Basal-Cell Carcinoma Cancer Detection , 2013, MICCAI.

[44]  M. Giger,et al.  Breast image analysis for risk assessment, detection, diagnosis, and treatment of cancer. , 2013, Annual review of biomedical engineering.

[45]  A. Ramli,et al.  Computer-aided detection/diagnosis of breast cancer in mammography and ultrasound: a review. , 2013, Clinical imaging.

[46]  Angel Cruz-Roa,et al.  Hybrid image representation learning model with invariant features for basal cell carcinoma detection , 2013, Other Conferences.

[47]  Christian Igel,et al.  Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network , 2013, MICCAI.

[48]  Jeon-Hor Chen,et al.  Robust Texture Analysis Using Multi-Resolution Gray-Scale Invariant Features for Breast Sonographic Tumor Diagnosis , 2013, IEEE Transactions on Medical Imaging.

[49]  Miguel Ángel Guevara-López,et al.  Improving breast cancer classification with mammography, supported on an appropriate variable selection analysis , 2013, Medical Imaging.

[50]  M. Ravishankar,et al.  Early Detection and Classification of Breast Cancer , 2014, FICTA.

[51]  Flávio Sanson Fogliatto,et al.  Método de mineração de dados para identificação de câncer de mama baseado na seleção de variáveis , 2014 .

[52]  Seong-Whan Lee,et al.  Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis , 2014, NeuroImage.

[53]  Dinggang Shen,et al.  Robust Deep Learning for Improved Classification of AD/MCI Patients , 2014, MLMI.

[54]  Flávio Sanson Fogliatto,et al.  [A data mining method for breast cancer identification based on a selection of variables]. , 2014, Ciencia & saude coletiva.

[55]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[56]  Miguel Ángel Guevara-López,et al.  Improving the performance of machine learning classifiers for Breast Cancer diagnosis based on feature selection , 2014, 2014 Federated Conference on Computer Science and Information Systems.

[57]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[58]  Dinggang Shen,et al.  A Robust Deep Model for Improved Classification of AD/MCI Patients , 2015, IEEE Journal of Biomedical and Health Informatics.

[59]  Sungbin Choi.  X-ray Image Body Part Clustering using Deep Convolutional Neural Network: SNUMedinfo at ImageCLEF 2015 Medical Clustering Task , 2015, CLEF.

[60]  Ronald M. Summers,et al.  Leveraging Mid-Level Semantic Boundary Cues for Automated Lymph Node Detection , 2015, MICCAI.

[61]  Nima Tajbakhsh,et al.  Computer-Aided Pulmonary Embolism Detection Using a Novel Vessel-Aligned Multi-planar Image Representation and Convolutional Neural Networks , 2015, MICCAI.

[62]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[63]  Hao Chen,et al.  Automatic Fetal Ultrasound Standard Plane Detection Using Knowledge Transferred Recurrent Neural Networks , 2015, MICCAI.

[64]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[65]  Daniel Lévy,et al.  Breast Mass Classification from Mammograms using Deep Convolutional Neural Networks , 2016, ArXiv.

[66]  Hongmin Cai,et al.  Discrimination of Breast Cancer with Microcalcifications on Mammography by Deep Learning , 2016, Scientific Reports.

[67]  Yang Li,et al.  Gland Instance Segmentation by Deep Multichannel Side Supervision , 2016, MICCAI.

[68]  D. Shen,et al.  Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans , 2016, Scientific Reports.

[69]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[70]  Hao Chen,et al.  Mitosis Detection in Breast Cancer Histology Images via Deep Cascaded Networks , 2016, AAAI.

[71]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[72]  Luc Van Gool,et al.  Deep Retinal Image Understanding , 2016, MICCAI.

[73]  Zhang Yi,et al.  Automated retinopathy of prematurity screening using deep neural networks , 2018, EBioMedicine.