A U-Net Ensemble for breast lesion segmentation in DCE MRI

Dynamic Contrast Enhanced Magnetic Resonance Imaging (DCE-MRI) has been recognized as an effective tool for Breast Cancer (BC) diagnosis. Automatic BC analysis from DCE-MRI depends on features extracted particularly from lesions, hence, lesions need to be accurately segmented as a prior step. Due to the time and experience required to manually segment lesions in 4D DCE-MRI, automating this task is expected to reduce the workload, reduce observer variability and improve diagnostic accuracy. In this paper we propose an automated method for breast lesion segmentation from DCE-MRI based on a U-Net framework. The contributions of this work are the proposal of a modified U-Net architecture and the analysis of the input DCE information. In that sense, we propose the use of an ensemble method combining three U-Net models, each using a different input combination, outperforming all individual methods and other existing approaches. For evaluation, we use a subset of 46 cases from the TCGA-BRCA dataset, a challenging and publicly available dataset not reported to date for this task. Due to the incomplete annotations provided, we complement them with the help of a radiologist in order to include secondary lesions that were not originally segmented. The proposed ensemble method obtains a mean Dice Similarity Coefficient (DSC) of 0.680 (0.802 for main lesions) which outperforms state-of-the art methods using the same dataset, demonstrating the effectiveness of our method considering the complexity of the dataset.

[1]  S Tangaro,et al.  A Gradient-Based Approach for Breast DCE-MRI Analysis , 2018, BioMed research international.

[2]  Deep Learning Based Segmentation of Breast Lesions in DCE-MRI , 2020, ICPR Workshops.

[3]  Erich P Huang,et al.  Using computer‐extracted image phenotypes from tumors on breast magnetic resonance imaging to predict breast cancer pathologic stage , 2016, Cancer.

[4]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[5]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Wolfgang Bogner,et al.  Automatic segmentation and classification of breast lesions through identification of informative multiparametric PET/MRI features , 2019, European Radiology Experimental.

[7]  Stefano Marrone,et al.  DCE-MRI Breast Lesions Segmentation with a 3TP U-Net Deep Convolutional Neural Network , 2019, 2019 IEEE 32nd International Symposium on Computer-Based Medical Systems (CBMS).

[8]  D. Rueckert,et al.  White matter hyperintensity and stroke lesion segmentation and differentiation using convolutional neural networks , 2017, NeuroImage: Clinical.

[9]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[10]  Jie Yang,et al.  A Spatio-Temporal Fully Convolutional Network for Breast Lesion Segmentation in DCE-MRI , 2018, ICONIP.

[11]  Liuquan Cheng,et al.  Breast magnetic resonance imaging: kinetic curve assessment. , 2013, Gland surgery.

[12]  Sudipta Mukhopadhyay,et al.  Mammogram segmentation using multi-atlas deformable registration. , 2019, Computers in biology and medicine.

[13]  Nico Karssemeijer,et al.  Learning from unbalanced data: A cascade-based approach for detecting clustered microcalcifications , 2014, Medical Image Anal..

[14]  Krzysztof J. Geras,et al.  Machine learning in breast MRI , 2019, Journal of magnetic resonance imaging : JMRI.

[15]  Yaozong Gao,et al.  Structured Learning for 3-D Perivascular Space Segmentation Using Vascular Features , 2017, IEEE Transactions on Biomedical Engineering.

[16]  Shandong Wu,et al.  Deep-learning method for tumor segmentation in breast DCE-MRI , 2019, Medical Imaging.

[17]  A. Jemal,et al.  Cancer statistics, 2020 , 2020, CA: a cancer journal for clinicians.

[18]  Dong Wei,et al.  Three-Dimensional Whole Breast Segmentation in Sagittal and Axial Breast MRI With Dense Depth Field Modeling and Localized Self-Adaptation for Chest-Wall Line Detection , 2019, IEEE Transactions on Biomedical Engineering.

[19]  Christine E. Edmonds,et al.  Management of Unilateral Axillary Lymphadenopathy Detected on Breast MRI in the Era of Coronavirus Disease (COVID-19) Vaccination. , 2021, AJR. American journal of roentgenology.

[20]  P. DiPiro,et al.  Applications of Advanced Breast Imaging Modalities , 2018, Current Oncology Reports.

[21]  Hui Wang,et al.  Segmentation of breast MR images using a generalised 2D mathematical model with inflation and deflation forces of active contours , 2019, Artif. Intell. Medicine.

[22]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[23]  A. Bert,et al.  Performance of a fully automatic lesion detection system for breast DCE‐MRI , 2011, Journal of magnetic resonance imaging : JMRI.

[24]  Dinggang Shen,et al.  Segmentation and Classification of Breast Tumor Using Dynamic Contrast-Enhanced MR Images , 2007, MICCAI.

[25]  Nico Karssemeijer,et al.  Automated localization of breast cancer in DCE-MRI , 2015, Medical Image Anal..

[26]  Sidi Ahmed Mahmoudi,et al.  MRI Breast Tumor Segmentation Using Different Encoder and Decoder CNN Architectures , 2019, Comput..

[27]  Maryellen L. Giger,et al.  A Fuzzy C-Means (FCM)-Based Approach for Computerized Segmentation of Breast Lesions in Dynamic Contrast-Enhanced MR Images1 , 2006 .

[28]  Scott Fields,et al.  Mapping pathophysiological features of breast tumors by MRI at high spatial resolution , 1997, Nature Medicine.

[29]  Jun Zhang,et al.  Hierarchical Convolutional Neural Networks for Segmentation of Breast Tumors in MRI With Application to Radiogenomics , 2019, IEEE Transactions on Medical Imaging.

[30]  Liang Hu,et al.  Image manifold revealing for breast lesion segmentation in DCE-MRI. , 2015, Bio-medical materials and engineering.

[31]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[32]  S. V. Sree,et al.  Breast imaging: A survey. , 2011, World journal of clinical oncology.

[33]  Arnau Oliver,et al.  Acute ischemic stroke lesion core segmentation in CT perfusion images using fully convolutional neural networks , 2019, Comput. Biol. Medicine.

[34]  Mark Rosen,et al.  A Multichannel Markov Random Field Framework for Tumor Segmentation With an Application to Classification of Gene Expression-Based Breast Cancer Recurrence Risk , 2013, IEEE Transactions on Medical Imaging.