E-Res U-Net: An improved U-Net model for segmentation of muscle images

Abstract In this paper, we propose a new semantic segmentation network called ’E-Res U-Net’, to achieve better segmentation results of deep and superficial muscles in ultrasonic muscle images. This model is based on U-Net, and its structure has been modified to improve the performance of the algorithm. There are three aspects of improvement based on U-Net, including E-Res layer, dilated convolution module, and E-Res path. Additional experiments demonstrate that each designed module in our proposed network is effective, can improve the accuracy compared to the original U-Net. When compared with other algorithms which are state-of-the-art, the experimental result under the overall network structure is even more excellent.

[1]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Amin Taheri-Garavand,et al.  Deep learning-based appearance features extraction for automated carp species identification , 2020 .

[3]  Javier Del Ser,et al.  Deep Learning for Multigrade Brain Tumor Classification in Smart Healthcare Systems: A Prospective Survey , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[4]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[5]  Mohammed Alweshah,et al.  Monarch butterfly optimization algorithm for computed tomography image segmentation , 2021, Multim. Tools Appl..

[6]  Yan Li,et al.  MSN-Net: a multi-scale context nested U-Net for liver segmentation , 2021, Signal Image Video Process..

[7]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[8]  Peter A. Calabresi,et al.  OASIS is Automated Statistical Inference for Segmentation, with applications to multiple sclerosis lesion segmentation in MRI☆ , 2013, NeuroImage: Clinical.

[9]  Kwok-Wing Chau,et al.  A Survey of Deep Learning Techniques: Application in Wind and Solar Energy Resources , 2019, IEEE Access.

[10]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[11]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Sidney Leeman,et al.  DETECTION OF PATHOLOGICAL CHANGE IN DYSTROPHIC MUSCLE WITH B-SCAN ULTRASOUND IMAGING , 1980, The Lancet.

[13]  Mohammad Sohel Rahman,et al.  MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation , 2019, Neural Networks.

[14]  A Macovski,et al.  Novel approaches to low‐cost MRI , 1993, Magnetic resonance in medicine.

[15]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[17]  Wei Shi,et al.  Dilated convolution neural network with LeakyReLU for environmental sound classification , 2017, 2017 22nd International Conference on Digital Signal Processing (DSP).

[18]  P. Peetrons.  Ultrasound of muscles , 2001, European Radiology.

[19]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[20]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[21]  Ian D. Loram,et al.  Estimation of absolute states of human skeletal muscle via standard B-mode ultrasound imaging and deep convolutional neural networks , 2019, Journal of the Royal Society Interface.

[22]  Kwok-Wing Chau,et al.  ANN-based interval forecasting of streamflow discharges using the LUBE method and MOFIPS , 2015, Eng. Appl. Artif. Intell..

[23]  Lijuan Qin,et al.  Study on MRI Medical Image Segmentation Technology Based on CNN-CRF Model , 2020, IEEE Access.

[24]  M L Mendelsohn,et al.  THE ANALYSIS OF CELL IMAGES * , 1966, Annals of the New York Academy of Sciences.

[25]  Krishna Chaitanya,et al.  Test-Time Adaptable Neural Networks for Robust Medical Image Segmentation , 2020, Medical image analysis.

[26]  Bo Tao,et al.  Spatiotemporal Modeling for Nonlinear Distributed Thermal Processes Based on KL Decomposition, MLP and LSTM Network , 2020, IEEE Access.

[27]  R. Adler,et al.  Ultrasound of Muscle Abnormalities , 2005, Ultrasound quarterly.

[28]  Fei Wu,et al.  Deep Q Learning Driven CT Pancreas Segmentation With Geometry-Aware U-Net , 2019, IEEE Transactions on Medical Imaging.

[29]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  S. Pillen,et al.  Skeletal muscle ultrasound , 2010, Neurological research.

[32]  Patrick Richard,et al.  The economic costs of pain in the United States. , 2012, The journal of pain : official journal of the American Pain Society.

[33]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.