Automatic pancreas segmentation based on lightweight DCNN modules and spatial prior propagation

Abstract Nowadays, pancreas segmentation in CT scans has gained more and more attention for computer-assisted diagnosis of inflammation (pancreatitis) or cancer. Despite the thrilling success of deep convolutional neural networks (DCNNs) in automatic pancreas segmentation, the heavy computational complexity of such networks impedes the deployment in clinical applications. To alleviate this issue, this paper establishes a novel end-to-end DCNN model for pursuing high-accurate automatic pancreas segmentation but with low computational cost. Specifically, built upon a simplified FCN architecture, we propose two novel network modules, named as the scale-transferrable feature fusion module (STFFM) and prior propagation module (PPM), respectively, for pancreas segmentation. Equipped with the scale-transferrable operation, STFFM can learn rich fusion features but with very lightweight network architecture. By dynamically adapting the spatial prior to the input slice data as well as the deep feature maps, PPM enables the network model to explore informative spatial priors for pancreas segmentation. Comprehensive experiments on the NIH dataset and the MSD dataset are conducted to evaluate the proposed approach. The obtained experimental results demonstrate that our approach can effectively reduce the computational cost and simultaneously archive the outperforming performance when compared to the state-of-the-art methods.

[1]  B. S. Harish,et al.  A Modified Intuitionistic Fuzzy Clustering Algorithm for Medical Image Segmentation , 2018, J. Intell. Syst..

[2]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Garrison W. Cottrell,et al.  Understanding Convolution for Semantic Segmentation , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[4]  M E Ryan,et al.  Guidelines for credentialing and granting privileges for endoscopic ultrasound. , 2001, Gastrointestinal endoscopy.

[5]  M. S. Maheshan,et al.  Sclera Segmentation using Spatial Kernel Fuzzy Clustering Methods , 2020, ICPRAM.

[6]  Le Lu,et al.  Improving Deep Pancreas Segmentation in CT and MRI Images via Recurrent Neural Contextual Learning and Direct Loss Function , 2017, ArXiv.

[7]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[8]  Yuichiro Hayashi,et al.  An application of cascaded 3D fully convolutional networks for medical image segmentation , 2018, Comput. Medical Imaging Graph..

[9]  Laurence T. Yang,et al.  A survey on deep learning for big data , 2018, Inf. Fusion.

[10]  Dong Xu,et al.  Advanced Deep-Learning Techniques for Salient and Category-Specific Object Detection: A Survey , 2018, IEEE Signal Processing Magazine.

[11]  Ronald M. Summers,et al.  A large annotated medical image dataset for the development and evaluation of segmentation algorithms , 2019, ArXiv.

[12]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[13]  Aimin Hao,et al.  Multi-view multi-scale CNNs for lung nodule type classification from CT images , 2018, Pattern Recognit..

[14]  Alan L. Yuille,et al.  Deep Supervision for Pancreatic Cyst Segmentation in Abdominal CT Scans , 2017, MICCAI.

[15]  Xiaojun Duan,et al.  Saliency-guided level set model for automatic object segmentation , 2019, Pattern Recognit..

[16]  Junwei Han,et al.  PiCANet: Learning Pixel-wise Contextual Attention in ConvNets and Its Application in Saliency Detection , 2017, ArXiv.

[17]  Le Lu,et al.  Pancreas Segmentation in MRI Using Graph-Based Decision Fusion on Convolutional Neural Networks , 2016, MICCAI.

[18]  Chengwen Chu,et al.  Multi‐atlas pancreas segmentation: Atlas selection based on vessel structure , 2017, Medical Image Anal..

[19]  Jun Li,et al.  Probability Map Guided Bi-directional Recurrent UNet for Pancreas Segmentation , 2019, ArXiv.

[20]  Yongdong Zhang,et al.  Automated pulmonary nodule detection in CT images using deep convolutional neural networks , 2019, Pattern Recognit..

[21]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[22]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Daniel Rueckert,et al.  Regression Forest-Based Atlas Localization and Direction Specific Atlas Generation for Pancreas Segmentation , 2016, MICCAI.

[24]  Alan L. Yuille,et al.  Recurrent Saliency Transformation Network: Incorporating Multi-stage Visual Cues for Small Organ Segmentation , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[25]  Xuelong Li,et al.  Detection of Co-salient Objects by Looking Deep and Wide , 2016, International Journal of Computer Vision.

[26]  Kaiming He,et al.  Group Normalization , 2018, ECCV.

[27]  Yan Wang,et al.  A Fixed-Point Model for Pancreas Segmentation in Abdominal CT Scans , 2016, MICCAI.

[28]  Yadong Wang,et al.  A hierarchical local region-based sparse shape composition for liver segmentation in CT scans , 2016, Pattern Recognit..

[29]  Alan L. Yuille,et al.  Bridging the Gap Between 2D and 3D Organ Segmentation , 2018, MICCAI.

[30]  D. S. Guru,et al.  Segmenting MRI brain images using evolutionary computation technique , 2015, 2015 International Conference on Cognitive Computing and Information Processing(CCIP).

[31]  Ronald M. Summers,et al.  DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation , 2015, MICCAI.

[32]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Ronald M. Summers,et al.  Spatial aggregation of holistically‐nested convolutional neural networks for automated pancreas localization and segmentation☆ , 2017, Medical Image Anal..

[34]  Daniel Rueckert,et al.  Discriminative dictionary learning for abdominal multi-organ segmentation , 2015, Medical Image Anal..

[35]  Le Lu,et al.  Pancreas Segmentation in CT and MRI Images via Domain Specific Network Designing and Recurrent Neural Contextual Learning , 2018, ArXiv.

[36]  Deyu Meng,et al.  Co-Saliency Detection via a Self-Paced Multiple-Instance Learning Framework , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Alan L. Yuille,et al.  A 3D Coarse-to-Fine Framework for Volumetric Medical Image Segmentation , 2017, 2018 International Conference on 3D Vision (3DV).

[38]  Jungong Han,et al.  Cross-modality deep feature learning for brain tumor segmentation , 2021, Pattern Recognit..

[39]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[41]  Junwei Han,et al.  Synthesizing Supervision for Learning Deep Saliency Network without Human Annotation , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Dhirendra Kumar,et al.  A modified intuitionistic fuzzy c-means clustering approach to segment human brain MRI image , 2018, Multimedia Tools and Applications.

[43]  Jun Fu,et al.  Dual Attention Network for Scene Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Ting Zhao,et al.  Pyramid Feature Attention Network for Saliency Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Stefan Wesarg,et al.  A Novel Bayesian Model Incorporating Deep Neural Network and Statistical Shape Model for Pancreas Segmentation , 2018, MICCAI.