A Novel Multi-Scale Adversarial Networks for Precise Segmentation of X-Ray Breast Mass

With the constant changes of people’s lifestyle and living environment, the morbidity of breast cancer is increasing year by year. It is highly imperative to develop an effective breast mass segmentation method for early breast cancer diagnosis. However, segmenting breast masses in mammograms is still one hot issue with enormous challenges because of masses’ irregular shapes and various sizes. In this study, we propose multi-adversarial learning to capture multi-scale image information for accurate breast mass segmentation. To effectively reinforce higher-order consistency in the segmentation results, the proposed network introduces the idea of adversarial networks, mainly consisting of a segmentation network and a discrimination network. An improved U-Net is introduced as the segmentation network to generate masks of the suspicious regions, while the discrimination network combines three convolutional critic networks that operate at different scales to discriminate the input masks. To weaken the unbalanced class problem and produce fine-grained segmentation results, weighted cross entropy loss and Earth-Mover distance are jointly used as an integrated loss function to guide the optimization process. Furthermore, the spectral normalization is adopted to the critics to alleviate the instability of training. The effectiveness of the proposed method is evaluated on two public datasets (INbreast and CBIS-DDSM). Experimental results empirically demonstrate that our method outperforms FCNs-based methods and the state-of-the-art method with dice of 81.64% for INbreast and 82.16% for CBIS-DDSM.

[1]  Anselmo Cardoso de Paiva,et al.  Classification of breast regions as mass and non-mass based on digital mammograms using taxonomic indexes and SVM , 2015, Comput. Biol. Medicine.

[2]  Sridhar Mahadevan,et al.  Generative Multi-Adversarial Networks , 2016, ICLR.

[3]  Vinod Pankajakshan,et al.  A deep learning architecture for brain tumor segmentation in MRI images , 2017, 2017 IEEE 19th International Workshop on Multimedia Signal Processing (MMSP).

[4]  Yunsong Li,et al.  Breast mass classification in digital mammography based on extreme learning machine , 2016, Neurocomputing.

[5]  Wei-Yen Hsu,et al.  Improved watershed transform for tumor segmentation: Application to mammogram image compression , 2012, Expert Syst. Appl..

[6]  Matthew T. Freedman,et al.  Automatic segmentation of mammographic masses using fuzzy shadow and maximum-likelihood analysis , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[7]  Hui Sun,et al.  AUNet: attention-guided dense-upsampling networks for breast mass segmentation in whole mammograms , 2018, Physics in medicine and biology.

[8]  Mike E. Davies,et al.  Improved Breast Mass Segmentation in Mammograms with Conditional Residual U-net , 2018, RAMBO+BIA+TIA@MICCAI.

[9]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[10]  Qiang Li,et al.  Breast mass segmentation in mammography using plane fitting and dynamic programming. , 2009, Academic radiology.

[11]  A. Jemal,et al.  Breast cancer statistics, 2017, racial disparity in mortality by state , 2017, CA: a cancer journal for clinicians.

[12]  Yide Ma,et al.  Multi-level nested pyramid network for mass segmentation in mammograms , 2019, Neurocomputing.

[13]  Ghassan Hamarneh,et al.  Mammography Segmentation with Maximum Likelihood Active Contours , 2022 .

[14]  Xiaojuan Ban,et al.  A New Method for Retinal Image Semantic Segmentation Based on Fully Convolution Network , 2018 .

[15]  Moustapha Mohamed Saleck,et al.  Semi-Automatic Segmentation of Breast Masses in Mammogram Images , 2018, PRAI 2018.

[16]  Gregory D. Hager,et al.  Adversarial deep structured nets for mass segmentation from mammograms , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[17]  Daniel L Rubin,et al.  A curated mammography data set for use in computer-aided detection and diagnosis research , 2017, Scientific Data.

[18]  A. Jemal,et al.  Cancer statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[19]  Sepp Hochreiter,et al.  GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium , 2017, NIPS.

[20]  Camille Couprie,et al.  Semantic Segmentation using Adversarial Networks , 2016, NIPS 2016.

[21]  Rangaraj M. Rangayyan,et al.  Segmentation of breast tumors in mammograms using fuzzy sets , 2003, J. Electronic Imaging.

[22]  Shuyi Li,et al.  Attention Dense-U-Net for Automatic Breast Mass Segmentation in Digital Mammogram , 2019, IEEE Access.

[23]  Léon Bottou,et al.  Wasserstein GAN , 2017, ArXiv.

[24]  Bin Yan,et al.  Fully Convolutional DenseNet with Multiscale Context for Automated Breast Tumor Segmentation , 2019, Journal of healthcare engineering.

[25]  Fei-Yue Wang,et al.  Global Segmentation-aided Local Masses Detection in X-ray Breast Images , 2018, 2018 Chinese Automation Congress (CAC).

[26]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[27]  Jaime S. Cardoso,et al.  INbreast: toward a full-field digital mammographic database. , 2012, Academic radiology.

[28]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  N. Karssemeijer,et al.  A new 2D segmentation method based on dynamic programming applied to computer aided detection in mammography. , 2004, Medical physics.

[30]  Hao Chen,et al.  HL-FCN: Hybrid loss guided FCN for colorectal cancer segmentation , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[31]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Chaoli Wang,et al.  Automatic Liver and Tumor Segmentation of CT Based on Cascaded U-Net , 2018, Proceedings of 2018 Chinese Intelligent Systems Conference.

[33]  Sheng Liu,et al.  Breast mass segmentation on digital mammograms by a combined deterministic annealing method , 2004, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[34]  Arianna Mencattini,et al.  Breast Mass Segmentation in Mammographic Images by an Effective Region Growing Algorithm , 2008, ACIVS.

[35]  Tae-Seong Kim,et al.  A fully integrated computer-aided diagnosis system for digital X-ray mammograms via deep learning detection, segmentation, and classification , 2018, Int. J. Medical Informatics.

[36]  Yi Chen,et al.  A novel method for breast mass segmentation: from superpixel to subpixel segmentation , 2019, Machine Vision and Applications.

[37]  Yuichi Yoshida,et al.  Spectral Normalization for Generative Adversarial Networks , 2018, ICLR.