Mass detection in mammograms by bilateral analysis using convolution neural network

BACKGROUND AND OBJECTIVE Automatic detection of the masses in mammograms is a big challenge and plays a crucial role to assist radiologists for accurate diagnosis. In this paper, a bilateral image analysis method based on Convolution Neural Network (CNN) is developed for mass detection in mammograms. METHODS The proposed bilateral mass detection method consists of two networks: a registration network for registering bilateral mammograms and a Siamese-Faster-RCNN network for mass detection using a pair of registered mammograms. In the first step, self-supervised learning network is built to learn the spatial transformation between bilateral mammograms. This network can directly estimate spatial transformation by maximizing an image-wise similarity metric and corresponding points labeling is not needed. In the second step, an end-to-end network combining the Region Proposal Network (RPN) and a Siamese Fully Connected (Siamese-FC) network is designed. Different from existing methods, the designed network integrates mass detection on single image with registered bilateral images comparison. RESULTS The proposed method is evaluated on three datasets (publicly available dataset INbreast and private dataset BCPKUPH and TXMD). For INbreast dataset, the proposed method achieves 0.88 true positive rate (TPR) with 1.12 false positives per image (FPs/I). For BCPKUPH dataset, the proposed method achieves 0.85 TPR with 1.86 FPs/I. For TXMD dataset, the proposed method achieves 0.85 TPR with 2.70 FPs/I. CONCLUSIONS Registration experimental result shows that the proposed method is suitable for bilateral mass detection. Mass detection experimental results show that the proposed method performs better than unilateral mass detection method, different bilateral connection schemes and image level fusion bilateral schemes.

[1]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[2]  Xinbo Gao,et al.  A parasitic metric learning net for breast mass classification based on mammography , 2018, Pattern Recognit..

[3]  Jaime S. Cardoso,et al.  INbreast: toward a full-field digital mammographic database. , 2012, Academic radiology.

[4]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Leonid Karlinsky,et al.  A CNN based method for automatic mass detection and classification in mammograms , 2019, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[6]  Ezzeddine Zagrouba,et al.  Multi-view score fusion for content-based mammogram retrieval , 2015, International Conference on Machine Vision.

[7]  Gustavo Carneiro,et al.  A deep learning approach for the analysis of masses in mammograms with minimal user intervention , 2017, Medical Image Anal..

[8]  Gustavo Carneiro,et al.  Automated Mass Detection in Mammograms Using Cascaded Deep Learning and Random Forests , 2015, 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[9]  Sameer Singh,et al.  Detection of masses in mammograms using texture features , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[10]  Rahul Sukthankar,et al.  MatchNet: Unifying feature and metric learning for patch-based matching , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Edwin Valarezo,et al.  Simultaneous Detection and Classification of Breast Masses in Digital Mammograms via a Deep Learning YOLO-based CAD System , 2018, Comput. Methods Programs Biomed..

[12]  Berkman Sahiner,et al.  Computer-aided detection of breast masses on mammograms: bilateral analysis for false positive reduction , 2006, SPIE Medical Imaging.

[13]  Yann LeCun,et al.  Learning a similarity metric discriminatively, with application to face verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Junji Morishita,et al.  Usefulness of histogram analysis of spatial frequency components for exploring the similarity and bilateral asymmetry in mammograms , 2015, Medical Imaging.

[15]  Victor Treviño,et al.  Bilateral Image Subtraction and Multivariate Models for the Automated Triaging of Screening Mammograms , 2015, BioMed research international.

[16]  Yang Yang,et al.  Multi-Temporal Remote Sensing Image Registration Using Deep Convolutional Features , 2018, IEEE Access.

[17]  Yongyi Yang,et al.  Pectoral muscle segmentation in mammograms based on homogenous texture and intensity deviation , 2013, Pattern Recognit..

[18]  Houjin Chen,et al.  Mammographic mass detection based on convolution neural network , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[19]  Anselmo Cardoso de Paiva,et al.  Detection of mass regions in mammograms by bilateral analysis adapted to breast density using similarity indexes and convolutional neural networks , 2018, Comput. Methods Programs Biomed..

[20]  Bin Zheng,et al.  A new computer‐aided detection approach based on analysis of local and global mammographic feature asymmetry , 2018, Medical physics.

[21]  J. Manning,et al.  Breast asymmetry and predisposition to breast cancer , 2006, Breast Cancer Research.

[22]  Hui Wang,et al.  A hierarchical pipeline for breast boundary segmentation and calcification detection in mammograms , 2018, Comput. Biol. Medicine.

[23]  Yongyi Yang,et al.  A context-sensitive deep learning approach for microcalcification detection in mammograms , 2018, Pattern Recognit..

[24]  Anselmo Cardoso de Paiva,et al.  Detection of masses based on asymmetric regions of digital bilateral mammograms using spatial description with variogram and cross-variogram functions , 2013, Comput. Biol. Medicine.

[25]  István Csabai,et al.  Detecting and classifying lesions in mammograms with Deep Learning , 2017, Scientific Reports.

[26]  Anselmo Cardoso de Paiva,et al.  Classification of breast regions as mass and non-mass based on digital mammograms using taxonomic indexes and SVM , 2015, Comput. Biol. Medicine.

[27]  Yongyi Yang,et al.  A bilateral analysis scheme for false positive reduction in mammogram mass detection , 2015, Comput. Biol. Medicine.

[28]  Houjin Chen,et al.  Mammographic Mass Detection by Bilateral Analysis Based on Convolution Neural Network , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[29]  Shengzhou Xu,et al.  Bilateral Asymmetry Detection in Mammograms Using Non-rigid Registraion and Pseudo-color Coding , 2010, 2010 International Conference on Electrical and Control Engineering.

[30]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[31]  José M. Celaya-Padilla,et al.  Bilateral image subtraction features for multivariate automated classification of breast cancer risk , 2014, Medical Imaging.

[32]  M. A. Al-masni,et al.  Detection and classification of the breast abnormalities in digital mammograms via regional Convolutional Neural Network , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[33]  Bin Zheng,et al.  Development of a new case based computer-aided detection scheme for screening mammography , 2016, 2016 IEEE EMBS Conference on Biomedical Engineering and Sciences (IECBES).