Multi-View Mammographic Density Classification by Dilated and Attention-Guided Residual Learning

Breast density is widely adopted to reflect the likelihood of early breast cancer development. Existing methods of mammographic density classification either require steps of manual operations or achieve only moderate classification accuracy due to the limited model capacity. In this study, we present a radiomics approach based on dilated and attention-guided residual learning for the task of mammographic density classification. The proposed method was instantiated with two datasets, one clinical dataset and one publicly available dataset, and classification accuracies of 88.7% and 70.0% were obtained, respectively. Although the classification accuracy of the public dataset was lower than the clinical dataset, which was very likely related to the dataset size, our proposed model still achieved a better performance than the naive residual networks and several recently published deep learning-based approaches. Furthermore, we designed a multi-stream network architecture specifically targeting at analyzing the multi-view mammograms. Utilizing the clinical dataset, we validated that multi-view inputs were beneficial to the breast density classification task with an increase of at least 2.0% in accuracy and the different views lead to different model classification capacities. Our method has a great potential to be further developed and applied in computer-aided diagnosis systems.

[1]  P. Langenberg,et al.  Breast Imaging Reporting and Data System: inter- and intraobserver variability in feature analysis and final assessment. , 2000, AJR. American journal of roentgenology.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Nico Karssemeijer,et al.  Unsupervised Deep Learning Applied to Breast Density Segmentation and Mammographic Risk Scoring , 2016, IEEE Transactions on Medical Imaging.

[4]  Andrew P. Bradley,et al.  Automated Analysis of Unregistered Multi-View Mammograms With Deep Learning , 2017, IEEE Transactions on Medical Imaging.

[5]  Frank Hutter,et al.  Neural Architecture Search: A Survey , 2018, J. Mach. Learn. Res..

[6]  J. Wolfe Risk for breast cancer development determined by mammographic parenchymal pattern , 1976, Cancer.

[7]  Jaime S. Cardoso,et al.  INbreast: toward a full-field digital mammographic database. , 2012, Academic radiology.

[8]  Reyer Zwiggelaar,et al.  Fuzzy-rough approaches for mammographic risk analysis , 2010, Intell. Data Anal..

[9]  Robert Marti,et al.  A Novel Breast Tissue Density Classification Methodology , 2008, IEEE Transactions on Information Technology in Biomedicine.

[10]  Reyer Zwiggelaar,et al.  Local feature based mammographic tissue pattern modelling and breast density classification , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[11]  Jitendra Virmani,et al.  Wavelet Packet Texture Descriptors Based Four-class BIRADS Breast Tissue Density Classification , 2015 .

[12]  E A Sickles,et al.  Breast cancer screening outcomes in women ages 40-49: clinical experience with service screening using modern mammography. , 1997, Journal of the National Cancer Institute. Monographs.

[13]  Dayong Wang,et al.  Deep Learning for Identifying Metastatic Breast Cancer , 2016, ArXiv.

[14]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Jong Hyo Kim,et al.  A novel deep learning-based approach to high accuracy breast density estimation in digital mammography , 2017, Medical Imaging.

[16]  Paul Kinahan,et al.  Radiomics: Images Are More than Pictures, They Are Data , 2015, Radiology.

[17]  Ronald M. Summers,et al.  Convolutional Invasion and Expansion Networks for Tumor Growth Prediction , 2018, IEEE Transactions on Medical Imaging.

[18]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Hui Sun,et al.  AUNet: attention-guided dense-upsampling networks for breast mass segmentation in whole mammograms , 2018, Physics in medicine and biology.

[21]  A. Jemal,et al.  Cancer statistics, 2017 , 2017, CA: a cancer journal for clinicians.

[22]  J. Hopper,et al.  Mammographic density—a review on the current understanding of its association with breast cancer , 2014, Breast Cancer Research and Treatment.

[23]  Lubomir M. Hadjiiski,et al.  Computerized image analysis: estimation of breast density on mammograms. , 2001, Medical physics.

[24]  A. Miller,et al.  Quantitative classification of mammographic densities and breast cancer risk: results from the Canadian National Breast Screening Study. , 1995, Journal of the National Cancer Institute.

[25]  Brian W. Pogue,et al.  Direct Regularization From Co-Registered Contrast MRI Improves Image Quality of MRI-Guided Near-Infrared Spectral Tomography of Breast Lesions , 2018, IEEE Transactions on Medical Imaging.

[26]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[27]  Lizhuang Ma,et al.  Not All Areas Are Equal: Transfer Learning for Semantic Segmentation via Hierarchical Region Selection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[29]  Mihaela van der Schaar,et al.  MAMMO: A Deep Learning Solution for Facilitating Radiologist-Machine Collaboration in Breast Cancer Diagnosis , 2018, ArXiv.

[30]  Xavier Lladó,et al.  Breast Density Analysis Using an Automatic Density Segmentation Algorithm , 2015, Journal of Digital Imaging.

[31]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[32]  Yahong Luo,et al.  A deep learning method for classifying mammographic breast density categories , 2018, Medical physics.

[33]  Mark F. McEntee,et al.  BI-RADS density categorization using deep neural networks , 2019, Medical Imaging.

[34]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[35]  Hui Wang,et al.  Breast Density Classification Using Local Quinary Patterns with Various Neighbourhood Topologies , 2018, J. Imaging.

[36]  Heang-Ping Chan,et al.  Mammographic density measured with quantitative computer-aided method: comparison with radiologists' estimates and BI-RADS categories. , 2006, Radiology.

[37]  Hongmin Cai,et al.  Discrimination of Breast Cancer with Microcalcifications on Mammography by Deep Learning , 2016, Scientific Reports.

[38]  Thomas A. Funkhouser,et al.  Dilated Residual Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  N Karssemeijer,et al.  Automated classification of parenchymal patterns in mammograms. , 1998, Physics in medicine and biology.

[40]  Cheng Li,et al.  A Radiomics Approach With CNN for Shear-Wave Elastography Breast Tumor Classification , 2018, IEEE Transactions on Biomedical Engineering.

[41]  Makoto Yoshizawa,et al.  Mass detection using deep convolutional neural network for mammographic computer-aided diagnosis , 2016, 2016 55th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE).

[42]  Lubomir M. Hadjiiski,et al.  Computer-aided assessment of breast density: comparison of supervised deep learning and feature-based statistical learning , 2018, Physics in medicine and biology.

[43]  F. Bray,et al.  The changing global patterns of female breast cancer incidence and mortality , 2004, Breast Cancer Research.

[44]  Nan Wu,et al.  Breast Density Classification with Deep Convolutional Neural Networks , 2017, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[45]  Jacques Wainer,et al.  Automatic breast density classification using a convolutional neural network architecture search procedure , 2015, Medical Imaging.

[46]  Patrick Granton,et al.  Radiomics: extracting more information from medical images using advanced feature analysis. , 2012, European journal of cancer.

[47]  Nassir Navab,et al.  Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networks , 2018, MICCAI.

[48]  R. Barzilay,et al.  Mammographic Breast Density Assessment Using Deep Learning: Clinical Implementation. , 2019, Radiology.

[49]  Berkman Sahiner,et al.  Computerized image analysis: estimation of breast density on mammograms , 2000, Medical Imaging: Image Processing.