Unsupervised domain adaptation for the segmentation of breast tissue in mammography images.

BACKGROUND AND OBJECTIVE Breast density refers to the proportion of glandular and fatty tissue in the breast and is recognized as a useful factor assessing breast cancer risk. Moreover, the segmentation of the high-density glandular tissue from mammograms can assist medical professionals visualizing and localizing areas that may require additional attention. Developing robust methods to segment breast tissues is challenging due to the variations in mammographic acquisition systems and protocols. Deep learning methods are effective in medical image segmentation but they often require large quantities of labelled data. Unsupervised domain adaptation is an area of research that employs unlabelled data to improve model performance on variations of samples derived from different sources. METHODS First, a U-Net architecture was used to perform segmentation of the fatty and glandular tissues with labelled data from a single acquisition device. Then, adversarial-based unsupervised domain adaptation methods were used to incorporate single unlabelled target domains, consisting of images from a different machine, into the training. Finally, the domain adaptation model was extended to include multiple unlabelled target domains by combining a reconstruction task with adversarial training. RESULTS The adversarial training was found to improve the generalization of the initial model on new domain data, demonstrating clearly improved segmentation of the breast tissues. For training with multiple unlabelled domains, combining a reconstruction task with adversarial training improved the stability of the training and yielded adequate segmentation results across all domains with a single model. CONCLUSIONS Results demonstrated the potential for adversarial-based domain adaptation with U-Net architectures for segmentation of breast tissue in mammograms coming from several devices and demonstrated that domain-adapted models could achieve a similar agreement with manual segmentations. It has also been found that combining adversarial and reconstruction-based methods can provide a simple and effective solution for training with multiple unlabelled target domains.

[1]  Rafael Llobet,et al.  A deep learning system to obtain the optimal parameters for a threshold-based breast and dense tissue segmentation , 2020, Comput. Methods Programs Biomed..

[2]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[3]  Jaime S. Cardoso,et al.  INbreast: toward a full-field digital mammographic database. , 2012, Academic radiology.

[4]  Nico Karssemeijer,et al.  Unsupervised Deep Learning Applied to Breast Density Segmentation and Mammographic Risk Scoring , 2016, IEEE Transactions on Medical Imaging.

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  Tolga Tasdizen,et al.  Domain adaptation for biomedical image segmentation using adversarial training , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[7]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[8]  Yvan Saeys,et al.  Domain Adaptive Segmentation In Volume Electron Microscopy Imaging , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[9]  Nico Karssemeijer,et al.  Robust Breast Composition Measurement - VolparaTM , 2010, Digital Mammography / IWDM.

[10]  Konstantinos Kamnitsas,et al.  Unsupervised domain adaptation in brain lesion segmentation with adversarial networks , 2016, IPMI.

[11]  Nikos Dimitropoulos,et al.  A fully automated scheme for mammographic segmentation and classification based on breast density and asymmetry , 2011, Comput. Methods Programs Biomed..

[12]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[13]  Vladimir Pavlovic,et al.  Unsupervised Multi-Target Domain Adaptation: An Information Theoretic Approach , 2018, IEEE Transactions on Image Processing.

[14]  Mengjie Zhang,et al.  Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptation , 2016, ECCV.

[15]  Jefersson A. dos Santos,et al.  Truly Generalizable Radiograph Segmentation With Conditional Domain Adaptation , 2020, IEEE Access.

[16]  Umi Kalthum Ngah,et al.  Segmentation of Breast Regions in Mammogram Based on Density: A Review , 2012, ArXiv.

[17]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[18]  Rami Ben-Ari,et al.  A weakly labeled approach for breast tissue segmentation and breast density estimation in digital mammography , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[19]  Reyer Zwiggelaar,et al.  Mammographic Segmentation and Density Classification: A Fractal Inspired Approach , 2016, Digital Mammography / IWDM.

[20]  Ron Kimmel,et al.  Computational mammography using deep neural networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[21]  C. Vachon,et al.  Evaluation of LIBRA Software for Fully Automated Mammographic Density Assessment in Breast Cancer Risk Prediction. , 2020, Radiology.

[22]  Huanhuan Yu,et al.  Multi-target Unsupervised Domain Adaptation without Exactly Shared Categories , 2018, ArXiv.

[23]  R. Nishikawa,et al.  Automated mammographic breast density estimation using a fully convolutional network , 2018, Medical physics.

[24]  Trevor Darrell,et al.  Adversarial Discriminative Domain Adaptation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  B. Keller,et al.  Estimation of breast percent density in raw and processed full field digital mammography images via adaptive fuzzy c-means clustering and support vector machine segmentation. , 2012, Medical physics.

[26]  Eleni Mangina,et al.  Fully Automated Breast Density Segmentation and Classification Using Deep Learning , 2020, Diagnostics.

[27]  Manish Kumar Bajpai,et al.  Breast Tissue Density Classification in Mammograms Based on Supervised Machine Learning Technique , 2017, Compute '17.