COIN: Contrastive Identifier Network for Breast Mass Diagnosis in Mammography

Computer-aided breast cancer diagnosis in mammography is a challenging problem, stemming from mammographical data scarcity and data entanglement. In particular, data scarcity is attributed to the privacy and expensive annotation. And data entanglement is due to the high similarity between benign and malignant masses, of which manifolds reside in lower dimensional space with very small margin. To address these two challenges, we propose a deep learning framework, named Contrastive Identifier Network (COIN), which integrates adversarial augmentation and manifold-based contrastive learning. Firstly, we employ adversarial learning to create both onand off-distribution mass contained ROIs. After that, we propose a novel contrastive loss with a built Signed graph. Finally, the neural network is optimized in a contrastive learning manner, with the purpose of improving the deep model’s discriminativity on the extended dataset. In particular, by employing COIN, data samples from the same category are pulled close whereas those with different labels are pushed further in the deep latent space. Moreover, COIN outperforms the state-of-the-art related algorithms for solving breast cancer diagnosis problem by a considerable margin, achieving 93.4% accuracy and 95.0% AUC score. The code will release on ***.

[1]  R. Warren,et al.  Mammography screening: an incremental cost effectiveness analysis of double versus single reading of mammograms , 1996, BMJ.

[2]  R. Blanks,et al.  A comparison of cancer detection rates achieved by breast cancer screening programmes by number of readers, for one and two view mammography: results from the UK National Health Service breast screening programme , 1998, Journal of medical screening.

[3]  A. Jemal,et al.  Breast Cancer Statistics , 2013 .

[4]  H. Sebastian Seung,et al.  The Manifold Ways of Perception , 2000, Science.

[5]  B. Stewart,et al.  World Cancer Report , 2003 .

[6]  A. Malich,et al.  CAD for mammography: the technique, results, current role and further developments , 2006, European Radiology.

[7]  N Karssemeijer,et al.  Use of border information in the classification of mammographic masses , 2006, Physics in medicine and biology.

[8]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[9]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[10]  Arnau Oliver,et al.  A review of automatic mass detection and segmentation in mammographic images , 2010, Medical Image Anal..

[11]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[12]  Jaime S. Cardoso,et al.  INbreast: toward a full-field digital mammographic database. , 2012, Academic radiology.

[13]  A. Ramli,et al.  Computer-aided detection/diagnosis of breast cancer in mammography and ultrasound: a review. , 2013, Clinical imaging.

[14]  Zhang Yi,et al.  A Local Non-Negative Pursuit Method for Intrinsic Manifold Structure Preservation , 2014, AAAI.

[15]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[16]  A. Jemal,et al.  Breast cancer statistics, 2013 , 2014, CA: a cancer journal for clinicians.

[17]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Chuan Li,et al.  Precomputed Real-Time Texture Synthesis with Markovian Generative Adversarial Networks , 2016, ECCV.

[20]  Mark D. McDonnell,et al.  Understanding Data Augmentation for Classification: When to Warp? , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[21]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[22]  Gustavo Carneiro,et al.  The Automated Learning of Deep Features for Breast Mass Classification from Mammograms , 2016, MICCAI.

[23]  Miguel Ángel Guevara-López,et al.  Representation learning for mammography mass lesion classification with convolutional neural networks , 2016, Comput. Methods Programs Biomed..

[24]  Yang Yu,et al.  Derivative-Free Optimization via Classification , 2016, AAAI.

[25]  Nico Karssemeijer,et al.  Large scale deep learning for computer aided detection of mammographic lesions , 2017, Medical Image Anal..

[26]  Yang Yu,et al.  Open Category Classification by Adversarial Sample Generation , 2017, IJCAI.

[27]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  David Cox,et al.  A Multi-scale CNN and Curriculum Learning Strategy for Mammogram Classification , 2017, DLMIA/ML-CDS@MICCAI.

[29]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Xiaohui Xie,et al.  Deep Multi-instance Networks with Sparse Label Assignment for Whole Mammogram Classification , 2016, bioRxiv.

[31]  Andrew P. Bradley,et al.  Automated Analysis of Unregistered Multi-View Mammograms With Deep Learning , 2017, IEEE Transactions on Medical Imaging.

[32]  Jiancheng Lv,et al.  Unsupervised Multi-Manifold Clustering by Learning Deep Representation , 2017, AAAI Workshops.

[33]  Christoph Meinel,et al.  Deep Learning for Medical Image Analysis , 2018, Journal of Pathology Informatics.

[34]  N. Karssemeijer,et al.  Discriminating solitary cysts from soft tissue lesions in mammography using a pretrained deep convolutional neural network , 2017, Medical physics.

[35]  Amos J. Storkey,et al.  Data Augmentation Generative Adversarial Networks , 2017, ICLR 2018.

[36]  Jian Zhang,et al.  Deep Generative Breast Cancer Screening and Diagnosis , 2018, MICCAI.

[37]  Stella X. Yu,et al.  Unsupervised Feature Learning via Non-parametric Instance Discrimination , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[38]  Xinbo Gao,et al.  A parasitic metric learning net for breast mass classification based on mammography , 2018, Pattern Recognit..

[39]  Jiancheng Lv,et al.  Learning Discriminative Representation with Signed Laplacian Restricted Boltzmann Machine , 2018, ArXiv.

[40]  David Cox,et al.  Conditional Infilling GANs for Data Augmentation in Mammogram Classification , 2018, RAMBO+BIA+TIA@MICCAI.

[41]  Mike E. Davies,et al.  Improved Breast Mass Segmentation in Mammograms with Conditional Residual U-net , 2018, RAMBO+BIA+TIA@MICCAI.

[42]  Weilin Huang,et al.  Deep Metric Learning with Hierarchical Triplet Loss , 2018, ECCV.

[43]  Dongdong Chen,et al.  A Deep Dual-path Network for Improved Mammogram Image Processing , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[44]  Dongdong Chen,et al.  Signed Laplacian Deep Learning with Adversarial Augmentation for Improved Mammography Diagnosis , 2019, MICCAI.

[45]  Yoshua Bengio,et al.  Learning deep representations by mutual information estimation and maximization , 2018, ICLR.

[46]  Ali Razavi,et al.  Data-Efficient Image Recognition with Contrastive Predictive Coding , 2019, ICML.

[47]  Quoc V. Le,et al.  Self-Training With Noisy Student Improves ImageNet Classification , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Dongdong Chen,et al.  Compressive MR Fingerprinting reconstruction with Neural Proximal Gradient iterations , 2020, MICCAI.

[49]  Ce Liu,et al.  Supervised Contrastive Learning , 2020, NeurIPS.

[50]  David S. Melnick,et al.  International evaluation of an AI system for breast cancer screening , 2020, Nature.

[51]  Ross B. Girshick,et al.  Momentum Contrast for Unsupervised Visual Representation Learning , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[52]  M. Davies,et al.  Deep Decomposition Learning for Inverse Imaging Problems , 2019, ECCV.