Spatial probabilistic distribution map-based two-channel 3D U-net for visual pathway segmentation

ABSTRACT Precise segmentation of the visual pathway is significant in preoperative planning to prevent the surgeon from touching it during the operation. Manual segmentation is time consuming and tedious. Thus, automatic segmentation strategies are necessary to assist clinical evaluation. However, the low contrast and blurred boundary between the target and the background in the image make automatic segmentation a challenging problem. This paper proposed a spatial probabilistic distribution map (SPDM)-based two-channel 3D U-Net to make shape and position prior information available for deep learning. First, an atlas calculated by group-wise registration was used to register each training volume image for deformation field determination. Second, the deformation field was used to transform the label of the corresponding training image to the template space, and then all the warped labels were summed up to create an SPDM. Third, the region of interest of the image and SPDM were sent to the network to predict the final segmentation. The proposed method was evaluated and compared against a conventional 3D U-Net on two datasets. Experimental results indicated that our method overcame the problem of low contrast and achieved better performance than previous methods.

[1]  Bennett A. Landman,et al.  Robust non-local multi-atlas segmentation of the optic nerve , 2013, Medical Imaging.

[2]  Dinggang Shen,et al.  Interleaved 3D-CNNs for joint segmentation of small-volume structures in head and neck CT images. , 2018, Medical physics.

[3]  Bo Du,et al.  Boundary-Weighted Domain Adaptive Neural Network for Prostate MR Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[4]  Bo Du,et al.  Shape prior constrained PSO model for bladder wall MRI segmentation , 2017, Neurocomputing.

[5]  Attila Kuba,et al.  Geometrical model-based segmentation of the organs of sight on CT images. , 2008, Medical physics.

[6]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[7]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[8]  Marius George Linguraru,et al.  Deep Learning Guided Partitioned Shape Model for Anterior Visual Pathway Segmentation , 2016, IEEE Transactions on Medical Imaging.

[9]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Bennett A. Landman,et al.  Robust optic nerve segmentation on clinically acquired CT , 2014, Medical Imaging.

[11]  Dinggang Shen,et al.  Hierarchical unbiased graph shrinkage (HUGS): A novel groupwise registration for large data set , 2014, NeuroImage.

[12]  Wenjie Li,et al.  Spatial Probabilistic Distribution Map Based 3D FCN for Visual Pathway Segmentation , 2019, ICIG.

[13]  Bennett A Landman,et al.  Robust optic nerve segmentation on clinically acquired computed tomography , 2014, Journal of medical imaging.

[14]  Benoit M. Dawant,et al.  Automatic delineation of the optic nerves and chiasm on CT images , 2007, SPIE Medical Imaging.

[15]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[16]  Bulat Ibragimov,et al.  Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks , 2017, Medical physics.

[17]  Bo Du,et al.  Exploiting Interslice Correlation for MRI Prostate Image Segmentation, from Recursive Neural Networks Aspect , 2018, Complex..

[18]  Benoit M. Dawant,et al.  An atlas-navigated optimal medial axis and deformable model algorithm (NOMAD) for the segmentation of the optic nerves and chiasm in MR and CT images , 2011, Medical Image Anal..

[19]  Zhijian Song,et al.  Organ at Risk Segmentation in Head and Neck CT Images Using a Two-Stage Segmentation Framework Based on 3D U-Net , 2018, IEEE Access.

[20]  Maximilien Vermandel,et al.  A fast and fully automated approach to segment optic nerves on MRI and its application to radiosurgery , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).