A Second-Order Subregion Pooling Network for Breast Lesion Segmentation in Ultrasound

Breast lesion segmentation in ultrasound images is a fundamental task for clinical diagnosis of the disease. Unfortunately, existing methods mainly rely on the entire image to learn the global context information, which neglects the spatial relation and results in ambiguity in the segmentation results. In this paper, we propose a novel second-order subregion pooling network (\(S^2P\)-Net) for boosting the breast lesion segmentation in ultrasound images. In our \(S^2P\)-Net, an attention-weighted subregion pooling (ASP) module is introduced in each encoder block of segmentation network to refine features by aggregating global features from the whole image and local information of subregions. Moreover, in each subregion, a guided multi-dimension second-order pooling (GMP) block is designed to leverage additional guidance information and multiple feature dimensions to learn powerful second-order covariance representations. Experimental results on two datasets demonstrate that our proposed \(S^2P\)-Net outperforms state-of-the-art methods.

[1]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[2]  Jian Sun,et al.  Guided Image Filtering , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Chi-Wing Fu,et al.  Bidirectional Feature Pyramid Network with Recurrent Attention Residual Modules for Shadow Detection , 2018, ECCV.

[4]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Ling Shao,et al.  ET-Net: A Generic Edge-aTtention Guidance Network for Medical Image Segmentation , 2019, MICCAI.

[6]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Xueding Wang,et al.  Medical breast ultrasound image segmentation by machine learning , 2019, Ultrasonics.

[9]  A. Stavros,et al.  Solid breast nodules: use of sonography to distinguish between benign and malignant lesions. , 1995, Radiology.

[10]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Shenghua Gao,et al.  CE-Net: Context Encoder Network for 2D Medical Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[12]  Yuxuan Wang,et al.  Completely automated segmentation approach for breast ultrasound images using multiple-domain features. , 2012, Ultrasound in medicine & biology.

[13]  Xin Yang,et al.  Deep Attentional Features for Prostate Segmentation in Ultrasound , 2018, MICCAI.

[14]  A. Jemal,et al.  Cancer statistics, 2017 , 2017, CA: a cancer journal for clinicians.

[15]  Min Xian,et al.  Fully automatic segmentation of breast ultrasound images based on breast characteristics in space and frequency domains , 2015, Pattern Recognit..

[16]  D. Boukerroui,et al.  Multiresolution texture based adaptive clustering algorithm for breast lesion segmentation. , 1998, European journal of ultrasound : official journal of the European Federation of Societies for Ultrasound in Medicine and Biology.

[17]  Dimitris N. Metaxas,et al.  Combining low-, high-level and empirical domain knowledge for automated segmentation of ultrasonic breast lesions , 2003, IEEE Transactions on Medical Imaging.

[18]  Alex C. Kot,et al.  Detection of Spoofing Medium Contours for Face Anti-Spoofing , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[20]  Reyer Zwiggelaar,et al.  Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[21]  Walid Al-Dhabyani,et al.  Dataset of breast ultrasound images , 2019, Data in brief.

[22]  Hang Li,et al.  Segmentation of breast anatomy for automated whole breast ultrasound images with boundary regularized convolutional encoder-decoder network , 2018, Neurocomputing.

[23]  Wilfrido Gómez-Flores,et al.  New Fully Automated Method for Segmentation of Breast Lesions on Ultrasound Based on Texture Analysis. , 2016, Ultrasound in medicine & biology.

[24]  Qilong Wang,et al.  Global Second-Order Pooling Convolutional Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Pheng-Ann Heng,et al.  Aggregating Attentional Dilated Features for Salient Object Detection , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[27]  Woei-Chyn Chu,et al.  Performance measure characterization for evaluating neuroimage segmentation algorithms , 2009, NeuroImage.