Semantic segmentation of breast ultrasound image with fuzzy deep learning network and breast anatomy constraints

Abstract Breast cancer is one of the most serious disease affecting women’s health. Due to low cost, portable, no radiation, and high efficiency, breast ultrasound (BUS) imaging is the most popular approach for diagnosing early breast cancer. However, ultrasound images are low resolution and poor quality. Thus, developing accurate detection system is a challenging task. In this paper, we propose a fully automatic segmentation algorithm consisting of two parts: fuzzy fully convolutional network and accurately fine-tuning post-processing based on breast anatomy constraints. In the first part, the image is pre-processed by contrast enhancement, and wavelet features are employed for image augmentation. A fuzzy membership function transforms the augmented BUS images into fuzzy domain. The features from convolutional layers are processed using fuzzy logic as well. The conditional random fields (CRFs) post-process the segmentation result. The location relation among the breast anatomy layers is utilized to improve the performance. The proposed method is applied to the dataset with 325 BUS images, and achieves state-of-the-art performance compared with that of existing methods with true positive rate 90.33%, false positive rate 9.00%, and intersection over union (IoU) 81.29% on tumor category, and overall intersection over union (mIoU) 80.47% over five categories: fat layer, mammary layer, muscle layer, background, and tumor.

[1]  J C Kent,et al.  Anatomy of the lactating human breast redefined with ultrasound imaging , 2005, Journal of anatomy.

[2]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Fei Xu,et al.  A saliency model for automated tumor detection in breast ultrasound images , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[4]  Xiaoxiao Li,et al.  Semantic Image Segmentation via Deep Parsing Network , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[5]  Gregory D. Hager,et al.  Adversarial deep structured nets for mass segmentation from mammograms , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[6]  H. D. Cheng,et al.  A novel segmentation method for breast ultrasound images based on neutrosophic l-means clustering. , 2012, Medical physics.

[7]  Yuxuan Wang,et al.  Completely automated segmentation approach for breast ultrasound images using multiple-domain features. , 2012, Ultrasound in medicine & biology.

[8]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[9]  A. Jemal,et al.  Breast cancer statistics, 2015: Convergence of incidence rates between black and white women , 2016, CA: a cancer journal for clinicians.

[10]  Reyer Zwiggelaar,et al.  Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[11]  Xuelong Li,et al.  Automatic segmentation of breast lesions for interaction in ultrasonic computer-aided diagnosis , 2015, Inf. Sci..

[12]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[13]  D. Shen,et al.  Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans , 2016, Scientific Reports.

[14]  Heng-Da Cheng,et al.  A novel fuzzy logic approach to contrast enhancement , 2000, Pattern Recognit..

[15]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[17]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[18]  Min Xian,et al.  Fully automatic segmentation of breast ultrasound images based on breast characteristics in space and frequency domains , 2015, Pattern Recognit..

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Wenbin Zou,et al.  An End-to-End Deep Learning Histochemical Scoring System for Breast Cancer TMA , 2018, IEEE Transactions on Medical Imaging.

[22]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[23]  Maleika Heenaye-Mamode Khan,et al.  Automated breast cancer diagnosis using artificial neural network (ANN) , 2017, 2017 3rd Iranian Conference on Intelligent Systems and Signal Processing (ICSPIS).

[24]  Youyong Kong,et al.  A Hierarchical Fused Fuzzy Deep Neural Network for Data Classification , 2017, IEEE Transactions on Fuzzy Systems.

[25]  Xianglong Tang,et al.  Probability density difference-based active contour for ultrasound image segmentation , 2010, Pattern Recognit..

[26]  Heng-Da Cheng,et al.  Medical Knowledge Constrained Semantic Breast Ultrasound Image Segmentation , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[27]  Fei Xu,et al.  Automatic Breast Ultrasound Image Segmentation: A Survey , 2017, Pattern Recognit..

[28]  P. Mohamed Shakeel,et al.  Lung cancer detection from CT image using improved profuse clustering and deep learning instantaneously trained neural networks , 2019, Measurement.

[29]  Xianglong Tang,et al.  An Effective Approach of Lesion Segmentation Within the Breast Ultrasound Image Based on the Cellular Automata Principle , 2012, Journal of Digital Imaging.

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  Qinghua Huang,et al.  Breast ultrasound image segmentation: a survey , 2017, International Journal of Computer Assisted Radiology and Surgery.

[32]  R. Chang,et al.  Tumor detection in automated breast ultrasound images using quantitative tissue clustering. , 2014, Medical physics.

[33]  Dinggang Shen,et al.  Deep CNN ensembles and suggestive annotations for infant brain MRI segmentation , 2017, Comput. Medical Imaging Graph..

[34]  Oscar Castillo,et al.  Edge-Detection Method for Image Processing Based on Generalized Type-2 Fuzzy Logic , 2014, IEEE Transactions on Fuzzy Systems.

[35]  Min Xian,et al.  A Fully Automatic Breast Ultrasound Image Segmentation Approach Based on Neutro-Connectedness , 2014, 2014 22nd International Conference on Pattern Recognition.

[36]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[37]  Nassir Navab,et al.  Image-to-Images Translation for Multi-Task Organ Segmentation and Bone Suppression in Chest X-Ray Radiography , 2019, IEEE Transactions on Medical Imaging.

[38]  Rahul Dave,et al.  VARIOUS TYPES AND MANAGEMENT OF BREAST CANCER: AN OVERVIEW , 2010, Journal of advanced pharmaceutical technology & research.

[39]  Dae San Kim,et al.  Home network message specification for white goods and its applications , 2002, IEEE Trans. Consumer Electron..

[40]  Annupan Rodtook,et al.  Multi-feature gradient vector flow snakes for adaptive segmentation of the ultrasound images of breast cancer , 2013, J. Vis. Commun. Image Represent..

[41]  Ling Zhang,et al.  Automated breast cancer detection and classification using ultrasound images: A survey , 2015, Pattern Recognit..