Convolutional neural network for automated mass segmentation in mammography

Background Automatic segmentation and localization of lesions in mammogram (MG) images are challenging even with employing advanced methods such as deep learning (DL) methods. We developed a new model based on the architecture of the semantic segmentation U-Net model to precisely segment mass lesions in MG images. The proposed end-to-end convolutional neural network (CNN) based model extracts contextual information by combining low-level and high-level features. We trained the proposed model using huge publicly available databases, (CBIS-DDSM, BCDR-01, and INbreast), and a private database from the University of Connecticut Health Center (UCHC). Results We compared the performance of the proposed model with those of the state-of-the-art DL models including the fully convolutional network (FCN), SegNet, Dilated-Net, original U-Net, and Faster R-CNN models and the conventional region growing (RG) method. The proposed Vanilla U-Net model outperforms the Faster R-CNN model significantly in terms of the runtime and the Intersection over Union metric (IOU). Training with digitized film-based and fully digitized MG images, the proposed Vanilla U-Net model achieves a mean test accuracy of 92.6%. The proposed model achieves a mean Dice coefficient index (DI) of 0.951 and a mean IOU of 0.909 that show how close the output segments are to the corresponding lesions in the ground truth maps. Data augmentation has been very effective in our experiments resulting in an increase in the mean DI and the mean IOU from 0.922 to 0.951 and 0.856 to 0.909, respectively. Conclusions The proposed Vanilla U-Net based model can be used for precise segmentation of masses in MG images. This is because the segmentation process incorporates more multi-scale spatial context, and captures more local and global context to predict a precise pixel-wise segmentation map of an input full MG image. These detected maps can help radiologists in differentiating benign and malignant lesions depend on the lesion shapes. We show that using transfer learning, introducing augmentation, and modifying the architecture of the original model results in better performance in terms of the mean accuracy, the mean DI, and the mean IOU in detecting mass lesion compared to the other DL and the conventional models.

[1]  Xiaoming Liu,et al.  Mass Classification in Mammograms Using Selected Geometry and Texture Features, and a New SVM-Based Feature Selection Method , 2014, IEEE Systems Journal.

[2]  Jinbo Bi,et al.  Convolutional neural network for automated mass segmentation in mammography , 2018, BMC Bioinformatics.

[3]  Rafik Goubran,et al.  Abnormality Detection in Mammography using Deep Convolutional Neural Networks , 2018, 2018 IEEE International Symposium on Medical Measurements and Applications (MeMeA).

[4]  István Csabai,et al.  Detecting and classifying lesions in mammograms with Deep Learning , 2017, Scientific Reports.

[5]  Gabriela Csurka,et al.  What is a good evaluation measure for semantic segmentation? , 2013, BMVC.

[6]  Gregory D. Hager,et al.  Adversarial deep structured nets for mass segmentation from mammograms , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[7]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[8]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Jaewoo Kang,et al.  Detection of masses in mammograms using a one-stage object detector based on a deep convolutional neural network , 2018, PloS one.

[10]  Sheida Nabavi,et al.  Deep convolutional neural networks for mammography: advances, challenges and applications , 2019, BMC Bioinformatics.

[11]  Yang Liu,et al.  Maternal DCAF13 Regulates Chromatin Tightness to Contribute to Embryonic Development , 2019, Scientific Reports.

[12]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[13]  Ing Ren Tsang,et al.  Multiclass Weighted Loss for Instance Segmentation of Cluttered Cells , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[14]  Albert Gubern-Mérida,et al.  Soft tissue lesion detection in mammography using deep neural networks for object detection , 2018 .

[15]  Xiaoming Liu,et al.  Mass segmentation using a combined method for cancer detection , 2011, BMC Systems Biology.

[16]  Nico Karssemeijer,et al.  Large scale deep learning for computer aided detection of mammographic lesions , 2017, Medical Image Anal..

[17]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[18]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Reda Ammar,et al.  Survey on deep convolutional neural networks in mammography , 2017, ICCABS.

[20]  Wenqing Sun,et al.  A Preliminary Study on Breast Cancer Risk Analysis Using Deep Neural Network , 2016, Digital Mammography / IWDM.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[23]  Kyunghyun Cho,et al.  High-Resolution Breast Cancer Screening with Multi-View Deep Convolutional Neural Networks , 2017, ArXiv.

[24]  Kisung Lee,et al.  Automated Breast Cancer Diagnosis Using Deep Learning and Region of Interest Detection (BC-DROID) , 2017, BCB.

[25]  Matthew B. Blaschko,et al.  Optimizing the Dice Score and Jaccard Index for Medical Image Segmentation: Theory and Practice , 2019, MICCAI.

[26]  Tae-Seong Kim,et al.  A fully integrated computer-aided diagnosis system for digital X-ray mammograms via deep learning detection, segmentation, and classification , 2018, Int. J. Medical Informatics.

[27]  Suresh Kumar,et al.  Systems biological approach on neurological disorders: a novel molecular connectivity to aging and psychiatric diseases , 2011, BMC Systems Biology.

[28]  Karel J. Zuiderveld,et al.  Contrast Limited Adaptive Histogram Equalization , 1994, Graphics Gems.

[29]  M. A. Al-masni,et al.  Detection and classification of the breast abnormalities in digital mammograms via regional Convolutional Neural Network , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  Gustavo Carneiro,et al.  A deep learning approach for the analysis of masses in mammograms with minimal user intervention , 2017, Medical Image Anal..

[32]  Aldenor G. Santos,et al.  Occurrence of the potent mutagens 2- nitrobenzanthrone and 3-nitrobenzanthrone in fine airborne particles , 2019, Scientific Reports.

[33]  José García Rodríguez,et al.  A Review on Deep Learning Techniques Applied to Semantic Segmentation , 2017, ArXiv.

[34]  Li Shen,et al.  Deep Learning to Improve Breast Cancer Detection on Screening Mammography , 2017, Scientific Reports.

[35]  A. Jemal,et al.  Cancer statistics, 2017 , 2017, CA: a cancer journal for clinicians.

[36]  Ahlem Melouah.  Comparison of Automatic Seed Generation Methods for Breast Tumor Detection Using Region Growing Technique , 2015, CIIA.

[37]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  N. Suthanthira Vanitha,et al.  The Pre-Processing Techniques for Breast Cancer Detection in Mammography Images , 2013 .

[39]  Yongyi Yang,et al.  Computer-Aided Detection and Diagnosis of Breast Cancer With Mammography: Recent Advances , 2009, IEEE Transactions on Information Technology in Biomedicine.

[40]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[42]  Yufeng Zheng,et al.  Breast cancer screening using convolutional neural network and follow-up digital mammography , 2018, Commercial + Scientific Sensing and Imaging.

[43]  Edwin Valarezo,et al.  Simultaneous Detection and Classification of Breast Masses in Digital Mammograms via a Deep Learning YOLO-based CAD System , 2018, Comput. Methods Programs Biomed..

[44]  Gustavo Carneiro,et al.  The Automated Learning of Deep Features for Breast Mass Classification from Mammograms , 2016, MICCAI.

[45]  Sang-Woong Lee,et al.  Semantic image segmentation using fully convolutional neural networks with multi-scale images and multi-scale dilated convolutions , 2018, Multimedia Tools and Applications.

[46]  Yufeng Zheng,et al.  Early breast cancer detection with digital mammograms using Haar-like features and AdaBoost algorithm , 2016, Commercial + Scientific Sensing and Imaging.

[47]  M. Jayesh George,et al.  Efficient preprocessing filters and mass segmentation techniques for mammogram images , 2017, 2017 IEEE International Conference on Circuits and Systems (ICCS).

[48]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[49]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[50]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[51]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[52]  C. Polanczyk,et al.  Is full-field digital mammography more accurate than screen-film mammography in overall population screening? A systematic review and meta-analysis. , 2013, Breast.

[53]  Tim Leiner,et al.  Dilated Convolutional Neural Networks for Cardiovascular MR Segmentation in Congenital Heart Disease , 2016, RAMBO+HVSMR@MICCAI.

[54]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Leonid Karlinsky,et al.  A Region Based Convolutional Network for Tumor Detection and Classification in Breast Mammography , 2016, LABELS/DLMIA@MICCAI.

[56]  Jaime S. Cardoso,et al.  INbreast: toward a full-field digital mammographic database. , 2012, Academic radiology.

[57]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[58]  Gustavo Carneiro,et al.  Deep Learning and Structured Prediction for the Segmentation of Mass in Mammograms , 2015, MICCAI.

[59]  C. Mathers,et al.  Cancer incidence and mortality worldwide: Sources, methods and major patterns in GLOBOCAN 2012 , 2015, International journal of cancer.

[60]  Gustavo Carneiro,et al.  Unregistered Multiview Mammogram Analysis with Pre-trained Deep Learning Models , 2015, MICCAI.

[61]  Andrew P. Bradley,et al.  Automated Analysis of Unregistered Multi-View Mammograms With Deep Learning , 2017, IEEE Transactions on Medical Imaging.

[62]  Thomas A. Funkhouser,et al.  Dilated Residual Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[63]  Yinan Kong,et al.  Involvement of Machine Learning for Breast Cancer Image Classification: A Survey , 2017, Comput. Math. Methods Medicine.

[64]  Leonid Karlinsky,et al.  Deep Learning for Automatic Detection of Abnormal Findings in Breast Mammography , 2017, DLMIA/ML-CDS@MICCAI.

[65]  Yoni Choukroun,et al.  Mammogram Classification and Abnormality Detection from Nonlocal Labels using Deep Multiple Instance Neural Network , 2017, VCBM.

[66]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[67]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[68]  José García Rodríguez,et al.  A survey on deep learning techniques for image and video semantic segmentation , 2018, Appl. Soft Comput..

[69]  Kai Zhang,et al.  Deep learning for image-based cancer detection and diagnosis - A survey , 2018, Pattern Recognit..

[70]  Gustavo Carneiro,et al.  Deep structured learning for mass segmentation from mammograms , 2014, 2015 IEEE International Conference on Image Processing (ICIP).

[71]  Jelmer M. Wolterink,et al.  Automatic segmentation of thoracic aorta segments in low-dose chest CT , 2018, Medical Imaging.

[72]  Qiang Li,et al.  Breast mass segmentation in mammography using plane fitting and dynamic programming. , 2009, Academic radiology.