A propagation-DNN: Deep combination learning of multi-level features for MR prostate segmentation

BACKGROUND AND OBJECTIVE Prostate segmentation on Magnetic Resonance (MR) imaging is problematic because disease changes the shape and boundaries of the gland and it can be difficult to separate the prostate from surrounding tissues. We propose an automated model that extracts and combines multi-level features in a deep neural network to segment prostate on MR images. METHODS Our proposed model, the Propagation Deep Neural Network (P-DNN), incorporates the optimal combination of multi-level feature extraction as a single model. High level features from the convolved data using DNN are extracted for prostate localization and shape recognition, while labeling propagation, by low level cues, is embedded into a deep layer to delineate the prostate boundary. RESULTS A well-recognized benchmarking dataset (50 training data and 30 testing data from patients) was used to evaluate the P-DNN. When compared it to existing DNN methods, the P-DNN statistically outperformed the baseline DNN models with an average improvement in the DSC of 3.19%. When compared to the state-of-the-art non-DNN prostate segmentation methods, P-DNN was competitive by achieving 89.9 ± 2.8% DSC and 6.84 ± 2.5 mm HD on training sets and 84.13 ± 5.18% DSC and 9.74 ± 4.21 mm HD on testing sets. CONCLUSION Our results show that P-DNN maximizes multi-level feature extraction for prostate segmentation of MR images.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Arturo Brunetti,et al.  Machine learning applications in prostate cancer magnetic resonance imaging , 2019, European Radiology Experimental.

[3]  Kenji Hirata,et al.  A convolutional neural network-based system to classify patients using FDG PET/CT examinations , 2020, BMC Cancer.

[4]  Jan Kautz,et al.  Learning Affinity via Spatial Propagation Networks , 2017, NIPS.

[5]  Shi-Min Hu,et al.  Global contrast based salient region detection , 2011, CVPR 2011.

[6]  Michael S. Lew,et al.  Deep learning for visual understanding: A review , 2016, Neurocomputing.

[7]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[8]  David Dagan Feng,et al.  Atlas registration and ensemble deep convolutional neural network-based prostate segmentation using magnetic resonance imaging , 2018, Neurocomputing.

[9]  R. Lenkinski,et al.  Accurate prostate volume estimation using multifeature active shape models on T2-weighted MRI. , 2011, Academic radiology.

[10]  Anant Madabhushi,et al.  Multifeature Landmark-Free Active Appearance Models: Application to Prostate MRI Segmentation , 2012, IEEE Transactions on Medical Imaging.

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Yoshua Bengio,et al.  The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  David Dagan Feng,et al.  Multi-view collaborative segmentation for prostate MRI images , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  Xiaodong Wu,et al.  Optimal Graph Search Segmentation Using Arc-Weighted Graph for Simultaneous Surface Detection of Bladder and Prostate , 2009, MICCAI.

[15]  Pingkun Yan,et al.  Label Image Constrained Multiatlas Selection , 2015, IEEE Transactions on Cybernetics.

[16]  Chunming Li,et al.  A Level Set Method for Image Segmentation in the Presence of Intensity Inhomogeneities With Application to MRI , 2011, IEEE Transactions on Image Processing.

[17]  Giovanni Montana,et al.  Deep neural networks for anatomical brain segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Dinggang Shen,et al.  Segmentation of prostate boundaries from ultrasound images using statistical shape model , 2003, IEEE Transactions on Medical Imaging.

[19]  Weiwei Du,et al.  Graph-based prostate extraction in T2-weighted images for prostate cancer detection , 2015, 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD).

[20]  Chih-Jen Lin,et al.  A Study on L2-Loss (Squared Hinge-Loss) Multiclass SVM , 2013, Neural Computation.

[21]  Xin Wang,et al.  Cancer Metastasis Detection via Spatially Structured Deep Network , 2017, IPMI.

[22]  Hao Chen,et al.  Volumetric ConvNets with Mixed Residual Connections for Automated Prostate Segmentation from 3D MR Images , 2017, AAAI.

[23]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2012, ECCV.

[24]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[25]  Huazhong Shu,et al.  Prostate segmentation on T2 MRI using Optimal Surface Detection , 2013 .

[26]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[27]  Abhinav Gupta,et al.  Designing deep networks for surface normal estimation , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Desire Sidibé,et al.  A survey of prostate segmentation methodologies in ultrasound, magnetic resonance and computed tomography images , 2012, Comput. Methods Programs Biomed..

[29]  Shaoting Zhang,et al.  Recognizing End-Diastole and End-Systole Frames via Deep Temporal Regression Network , 2016, MICCAI.

[30]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Sim Heng Ong,et al.  Automatic 3D Prostate MR Image Segmentation Using Graph Cuts and Level Sets with Shape Prior , 2013, PCM.

[34]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[35]  Yong-Jin Liu,et al.  Manifold SLIC: A Fast Method to Compute Content-Sensitive Superpixels , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[37]  David Dagan Feng,et al.  Feature-Based Image Patch Approximation for Lung Tissue Classification , 2013, IEEE Transactions on Medical Imaging.

[38]  Jiangbin Zheng,et al.  Deep multi-scale feature fusion for pancreas segmentation from CT images , 2020, International Journal of Computer Assisted Radiology and Surgery.

[39]  Yizhou Yu,et al.  Deep Contrast Learning for Salient Object Detection , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Yaozong Gao,et al.  Deformable MR Prostate Segmentation via Deep Feature Learning and Sparse Patch Matching , 2016, IEEE Transactions on Medical Imaging.

[41]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[42]  Jitendra Malik,et al.  Object Segmentation by Long Term Analysis of Point Trajectories , 2010, ECCV.

[43]  Cristian Sminchisescu,et al.  Constrained parametric min-cuts for automatic object segmentation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Elena Marchiori,et al.  Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities , 2016, Scientific Reports.

[45]  Christian Wachinger,et al.  DeepNAT: Deep convolutional neural network for segmenting neuroanatomy , 2017, NeuroImage.

[46]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[47]  James M. Rehg,et al.  The Secrets of Salient Object Segmentation , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[48]  Demetri Terzopoulos,et al.  On Matching Deformable Models to Images , 1987, Topical Meeting on Machine Vision.

[49]  Joachim M. Buhmann,et al.  Visual Saliency Based Active Learning for Prostate MRI Segmentation , 2015, MLMI.

[50]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[51]  C. Davatzikos,et al.  Multi-Atlas Segmentation of the Prostate: A Zooming Process with Robust Registration and Atlas Selection , 2012 .

[52]  Joachim M. Buhmann,et al.  Prostate MRI Segmentation Using Learned Semantic Knowledge and Graph Cuts , 2014, IEEE Transactions on Biomedical Engineering.

[53]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  S. Süsstrunk,et al.  Frequency-tuned salient region detection , 2009, CVPR 2009.

[55]  Florian Jung,et al.  Evaluation of prostate segmentation algorithms for MRI: The PROMISE12 challenge , 2014, Medical Image Anal..

[56]  N Karssemeijer,et al.  Automatic computer-aided detection of prostate cancer based on multiparametric magnetic resonance image analysis , 2012, Physics in medicine and biology.