Global Guidance Network for Breast Lesion Segmentation in Ultrasound Images

Automatic breast lesion segmentation in ultrasound helps to diagnose breast cancer, which is one of the dreadful diseases that affect women globally. Segmenting breast regions accurately from ultrasound image is a challenging task due to the inherent speckle artifacts, blurry breast lesion boundaries, and inhomogeneous intensity distributions inside the breast lesion regions. Recently, convolutional neural networks (CNNs) have demonstrated remarkable results in medical image segmentation tasks. However, the convolutional operations in a CNN often focus on local regions, which suffer from limited capabilities in capturing long-range dependencies of the input ultrasound image, resulting in degraded breast lesion segmentation accuracy. In this paper, we develop a deep convolutional neural network equipped with a global guidance block (GGB) and breast lesion boundary detection (BD) modules for boosting the breast ultrasound lesion segmentation. The GGB utilizes the multi-layer integrated feature map as a guidance information to learn the long-range non-local dependencies from both spatial and channel domains. The BD modules learn additional breast lesion boundary map to enhance the boundary quality of a segmentation result refinement. Experimental results on a public dataset and a collected dataset show that our network outperforms other medical image segmentation methods and the recent semantic segmentation methods on breast ultrasound lesion segmentation. Moreover, we also show the application of our network on the ultrasound prostate segmentation, in which our method better identifies prostate regions than state-of-the-art networks.

[1]  Reyer Zwiggelaar,et al.  Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[2]  Vladlen Koltun,et al.  Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials , 2011, NIPS.

[3]  Linda K. Olson,et al.  Breast mass segmentation in ultrasound with selective kernel U-Net convolutional neural network , 2020, Biomed. Signal Process. Control..

[4]  Dimitris N. Metaxas,et al.  Automatic boundary extraction of ultrasonic breast lesions , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[5]  Qiegen Liu,et al.  X-Net: Brain Stroke Lesion Segmentation Based on Depthwise Separable Convolution and Long-range Dependencies , 2019, MICCAI.

[6]  Hairong Zheng,et al.  Local and Non-local Deep Feature Fusion for Malignancy Characterization of Hepatocellular Carcinoma , 2018, MICCAI.

[7]  Shiguang Shan,et al.  Interaction-And-Aggregation Network for Person Re-Identification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  D. Boukerroui,et al.  Multiresolution texture based adaptive clustering algorithm for breast lesion segmentation. , 1998, European journal of ultrasound : official journal of the European Federation of Societies for Ultrasound in Medicine and Biology.

[9]  Yuxuan Wang,et al.  Completely automated segmentation approach for breast ultrasound images using multiple-domain features. , 2012, Ultrasound in medicine & biology.

[10]  Huchuan Lu,et al.  Attentive Feedback Network for Boundary-Aware Salient Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Xin Yang,et al.  Deep Attentional Features for Prostate Segmentation in Ultrasound , 2018, MICCAI.

[12]  Walid Al-Dhabyani,et al.  Dataset of breast ultrasound images , 2019, Data in brief.

[13]  Hamid R. Tizhoosh,et al.  Segmentation of Breast Ultrasound Images Using Neural Networks , 2011, EANN/AIAI.

[14]  Ben Glocker,et al.  Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images , 2018, Medical Image Anal..

[15]  Kevin J. Parker,et al.  Multiple Resolution Bayesian Segmentation of Ultrasound Images , 1994, Other Conferences.

[16]  Xiaogang Wang,et al.  Context Encoding for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Alexey Shvets,et al.  TernausNet: U-Net with VGG11 Encoder Pre-Trained on ImageNet for Image Segmentation , 2018, Computer-Aided Analysis of Gastrointestinal Videos.

[18]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Nico Karssemeijer,et al.  Automatic Microcalcification Detection in Multi-vendor Mammography Using Convolutional Neural Networks , 2016, Digital Mammography / IWDM.

[20]  Robert M. Kirberger,et al.  IMAGING ARTIFACTS IN DIAGNOSTIC ULTRASOUND—A REVIEW , 1995 .

[21]  Heng-Da Cheng,et al.  A novel automatic seed point selection algorithm for breast ultrasound images , 2008, 2008 19th International Conference on Pattern Recognition.

[22]  Jinhua Yu,et al.  Automatic tumor segmentation in breast ultrasound images using a dilated fully convolutional network combined with an active contour model , 2018, Medical physics.

[23]  Xiangyu Zhang,et al.  Large Kernel Matters — Improve Semantic Segmentation by Global Convolutional Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Hao Chen,et al.  3D Deeply Supervised Network for Automatic Liver Segmentation from CT Volumes , 2016, MICCAI.

[25]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[26]  Xudong Jiang,et al.  Melanoma Recognition in Dermoscopy Images via Aggregated Deep Convolutional Features , 2019, IEEE Transactions on Biomedical Engineering.

[27]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Sheng-Fang Huang,et al.  Neural network analysis applied to tumor segmentation on 3D breast ultrasound images , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[29]  Dong Ni,et al.  A Deep Convolutional Neural Network-Based Framework for Automatic Fetal Facial Standard Plane Recognition , 2018, IEEE Journal of Biomedical and Health Informatics.

[30]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Xueding Wang,et al.  Medical breast ultrasound image segmentation by machine learning , 2019, Ultrasonics.

[32]  Dimitris N. Metaxas,et al.  Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions , 2003, IEEE Transactions on Medical Imaging.

[33]  Nassir Navab,et al.  Recalibrating Fully Convolutional Networks With Spatial and Channel “Squeeze and Excitation” Blocks , 2018, IEEE Transactions on Medical Imaging.

[34]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[36]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Michael Brady,et al.  Segmentation of ultrasound B-mode images with intensity inhomogeneity correction , 2002, IEEE Transactions on Medical Imaging.

[38]  Gustavo Carneiro,et al.  A deep learning approach for the analysis of masses in mammograms with minimal user intervention , 2017, Medical Image Anal..

[39]  Min Xian,et al.  Fully automatic segmentation of breast ultrasound images based on breast characteristics in space and frequency domains , 2015, Pattern Recognit..

[40]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Jong Hyo Kim,et al.  A novel deep learning-based approach to high accuracy breast density estimation in digital mammography , 2017, Medical Imaging.

[42]  Nam Chul Kim,et al.  RD-Based Seeded Region Growing for Extraction of Breast Tumor in an Ultrasound Volume , 2005, CIS.

[43]  Lin Yang,et al.  MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Xin Yang,et al.  Fine-Grained Recurrent Neural Networks for Automatic Prostate Segmentation in Ultrasound Images , 2016, AAAI.

[45]  Nassim Bouteldja,et al.  OBELISK‐Net: Fewer layers to solve 3D multi‐organ segmentation with sparse deformable convolutions , 2019, Medical Image Anal..

[46]  Henry Horng-Shing Lu,et al.  Cell-based dual snake model: a new approach to extracting highly winding boundaries in the ultrasound images. , 2002, Ultrasound in medicine & biology.

[47]  Xianglong Tang,et al.  Fully automatic and segmentation-robust classification of breast tumors based on local texture analysis of ultrasound images , 2010, Pattern Recognit..

[48]  N. Karssemeijer,et al.  Reducing false positives of microcalcification detection systems by removal of breast arterial calcifications. , 2016, Medical physics.

[49]  Ruey-Feng Chang,et al.  Computer-Aided Multiview Tumor Detection for Automated Whole Breast Ultrasound , 2014, Ultrasonic imaging.

[50]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[51]  Hang Li,et al.  Segmentation of breast anatomy for automated whole breast ultrasound images with boundary regularized convolutional encoder-decoder network , 2018, Neurocomputing.

[52]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[53]  Santanu Chaudhury,et al.  Ultrasound Image Segmentation: A Deeply Supervised Network With Attention to Boundaries , 2019, IEEE Transactions on Biomedical Engineering.

[54]  R. Chang,et al.  Tumor detection in automated breast ultrasound images using quantitative tissue clustering. , 2014, Medical physics.

[55]  Hang Li,et al.  Dense Deconvolutional Network for Skin Lesion Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[56]  Anthony J. Yezzi,et al.  A geometric snake model for segmentation of medical imagery , 1997, IEEE Transactions on Medical Imaging.

[57]  R Saranya,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2019 .

[58]  Marc Modat,et al.  Permutohedral Attention Module for Efficient Non-Local Neural Networks , 2019, MICCAI.

[59]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[60]  Kevin J. Parker,et al.  Multiple Resolution Bayesian Segmentation of Ultrasound Images , 1995 .

[61]  Tat-Seng Chua,et al.  SCA-CNN: Spatial and Channel-Wise Attention in Convolutional Networks for Image Captioning , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).