Receptive Field Size as a Key Design Parameter for Ultrasound Image Segmentation with U-Net

Automatic and accurate segmentation of medical images is an important task due to the direct impact of this procedure on both disease diagnosis and treatment. Segmentation of ultrasound (US) imaging is particularly challenging due to the presence of speckle noise. Recent deep learning approaches have demonstrated remarkable findings in image segmentation tasks, including segmentation of US images. However, many of the newly proposed structures are either task specific and suffer from poor generalization, or are computationally expensive. In this paper, we show that the receptive field plays a more significant role in the network's performance compared to the network's depth or the number of parameters. We further show that by controlling the size of the receptive field, a deep network can instead be replaced by a shallow network.

[1]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Dong Ni,et al.  Deep Learning in Medical Ultrasound Analysis: A Review , 2019, Engineering.

[3]  Rupert Brooks,et al.  Breast Lesion Segmentation in Ultrasound Images with Limited Annotated Data , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[4]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[5]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[6]  Andrew L. Maas.  Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[7]  Hassan Rivaz,et al.  Two-stage ultrasound image segmentation using U-Net and test time augmentation , 2020, International Journal of Computer Assisted Radiology and Surgery.

[8]  Ming Wu,et al.  D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Klaus H. Maier-Hein,et al.  nnU-Net: Breaking the Spell on Successful Medical Image Segmentation , 2019, ArXiv.

[10]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  J. Alison Noble,et al.  Ultrasound image segmentation: a survey , 2006, IEEE Transactions on Medical Imaging.

[12]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[13]  Raquel Urtasun,et al.  Understanding the Effective Receptive Field in Deep Convolutional Neural Networks , 2016, NIPS.

[14]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[15]  Sébastien Ourselin,et al.  Automatic Brain Tumor Segmentation using Convolutional Neural Networks with Test-Time Augmentation , 2018, BrainLes@MICCAI.

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.