Precise Estimation of Renal Vascular Dominant Regions Using Spatially Aware Fully Convolutional Networks, Tensor-Cut and Voronoi Diagrams

This paper presents a new approach for precisely estimating the renal vascular dominant region using a Voronoi diagram. To provide computer-assisted diagnostics for the pre-surgical simulation of partial nephrectomy surgery, we must obtain information on the renal arteries and the renal vascular dominant regions. We propose a fully automatic segmentation method that combines a neural network and tensor-based graph-cut methods to precisely extract the kidney and renal arteries. First, we use a convolutional neural network to localize the kidney regions and extract tiny renal arteries with a tensor-based graph-cut method. Then we generate a Voronoi diagram to estimate the renal vascular dominant regions based on the segmented kidney and renal arteries. The accuracy of kidney segmentation in 27 cases with 8-fold cross validation reached a Dice score of 95%. The accuracy of renal artery segmentation in 8 cases obtained a centerline overlap ratio of 80%. Each partition region corresponds to a renal vascular dominant region. The final dominant-region estimation accuracy achieved a Dice coefficient of 80%. A clinical application showed the potential of our proposed estimation approach in a real clinical surgical environment. Further validation using large-scale database is our future work.

[1]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[2]  Thomas S. Hatsukami,et al.  3D intracranial artery segmentation using a convolutional autoencoder , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[3]  Jacek Jakubowski,et al.  Kidney Segmentation in CT Data Using Hybrid Level-Set Method with Ellipsoidal Shape Constraints , 2017 .

[4]  Huazhu Fu,et al.  Retinal vessel segmentation via deep learning network and fully-connected conditional random fields , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[5]  Stephen Lin,et al.  DeepVessel: Retinal Vessel Segmentation via Deep Learning and Conditional Random Field , 2016, MICCAI.

[6]  Xiangrong Zhou,et al.  Constructing a Probabilistic Model for Automated Liver Region Segmentation Using Non-contrast X-Ray Torso CT images , 2006, MICCAI.

[7]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[8]  Xiaohui Xie,et al.  DeepEM: Deep 3D ConvNets With EM For Weakly Supervised Pulmonary Nodule Detection , 2018, bioRxiv.

[9]  M. Schaap,et al.  3D Segmentation in the Clinic: A Grand Challenge II - Coronary Artery Tracking , 2008, The MIDAS Journal.

[10]  Yuichiro Hayashi,et al.  Deep learning and its application to medical image segmentation , 2018, ArXiv.

[11]  Leo Joskowicz,et al.  Non-parametric Iterative Model Constraint Graph min-cut for Automatic Kidney Segmentation , 2010, MICCAI.

[12]  Tokunori Yamamoto,et al.  Precise renal artery segmentation for estimation of renal vascular dominant regions , 2016, SPIE Medical Imaging.

[13]  Yuichiro Hayashi,et al.  On the influence of Dice loss function in multi-class organ segmentation of abdominal CT using 3D fully convolutional networks , 2018, ArXiv.

[14]  Joachim Denzler,et al.  Convolutional Patch Networks with Spatial Prior for Road Detection and Urban Scene Understanding , 2015, VISAPP.

[15]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[16]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[17]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[18]  Ronald M. Summers,et al.  Spatial aggregation of holistically‐nested convolutional neural networks for automated pancreas localization and segmentation☆ , 2017, Medical Image Anal..

[19]  Baowei Fei,et al.  Automatic 3D segmentation of the kidney in MR images using wavelet feature extraction and probability shape model , 2012, Medical Imaging.

[20]  Satoru Muto,et al.  Feasibility and accuracy of computational robot‐assisted partial nephrectomy planning by virtual partial nephrectomy analysis , 2015, International journal of urology : official journal of the Japanese Urological Association.

[21]  Chao Qin,et al.  Laparoscopic partial nephrectomy with segmental renal artery clamping: technique and clinical outcomes. , 2011, European urology.

[22]  Xavier Pennec,et al.  A Riemannian Framework for Tensor Computing , 2005, International Journal of Computer Vision.

[23]  Laurent D. Cohen,et al.  Automatic Detection and Segmentation of Kidneys in 3 D CT Images Using Random Forests , 2012 .

[24]  Maher Moakher,et al.  A Differential Geometric Approach to the Geometric Mean of Symmetric Positive-Definite Matrices , 2005, SIAM J. Matrix Anal. Appl..

[25]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[26]  Yefeng Zheng,et al.  Deep Learning and Convolutional Neural Networks for Medical Image Computing , 2017, Advances in Computer Vision and Pattern Recognition.

[27]  Guido Gerig,et al.  Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images , 1998, Medical Image Anal..

[28]  Chengwen Chu,et al.  Multi-organ Segmentation Based on Spatially-Divided Probabilistic Atlas from 3D Abdominal CT Images , 2013, MICCAI.

[29]  Heinz-Otto Peitgen,et al.  Multiple hypothesis template tracking of small 3D vessel structures , 2010, Medical Image Anal..

[30]  Xiaohui Xie,et al.  DeepLung: Deep 3D Dual Path Nets for Automated Pulmonary Nodule Detection and Classification , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[31]  Laurent D. Cohen,et al.  Automatic Detection and Segmentation of Kidneys in 3D CT Images Using Random Forests , 2012, MICCAI.

[32]  Gregory D. Hager,et al.  Adversarial deep structured nets for mass segmentation from mammograms , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[33]  Ronald M. Summers,et al.  Progressive and Multi-path Holistically Nested Neural Networks for Pathological Lung Segmentation from CT Images , 2017, MICCAI.

[34]  Xiaohui Xie,et al.  AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy , 2018, Medical physics.

[35]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[36]  Masahiko Nakamoto,et al.  Three-dimensional reconstruction of renovascular-tumor anatomy to facilitate zero-ischemia partial nephrectomy. , 2012, European urology.

[37]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[38]  P. Shao,et al.  Precise segmental renal artery clamping under the guidance of dual-source computed tomography angiography during laparoscopic partial nephrectomy. , 2012, European urology.

[39]  Daguang Xu,et al.  Deep Learning Based Automatic Segmentation of Pathological Kidney in CT: Local Versus Global Image Context , 2017, Deep Learning and Convolutional Neural Networks for Medical Image Computing.

[40]  Alejandro F. Frangi,et al.  Tensor-Based Graph-Cut in Riemannian Metric Space and Its Application to Renal Artery Segmentation , 2016, MICCAI.

[41]  Yuichiro Hayashi,et al.  Towards dense volumetric pancreas segmentation in CT using 3D fully convolutional networks , 2017, Medical Imaging.

[42]  Yuichiro Hayashi,et al.  An application of cascaded 3D fully convolutional networks for medical image segmentation , 2018, Comput. Medical Imaging Graph..

[43]  Daw-Tung Lin,et al.  Computer-aided kidney segmentation on abdominal CT images , 2006, IEEE Transactions on Information Technology in Biomedicine.

[44]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[45]  Max A. Viergever,et al.  Automatic Coronary Calcium Scoring in Cardiac CT Angiography Using Convolutional Neural Networks , 2015, MICCAI.

[46]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[47]  Christopher Joseph Pal,et al.  Convolutional networks for kidney segmentation in contrast-enhanced CT scans , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[48]  Marius George Linguraru,et al.  Abdominal multi-organ segmentation from CT images using conditional shape-location and unsupervised intensity priors , 2015, Medical Image Anal..

[49]  Seyed-Ahmad Ahmadi,et al.  Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields , 2016, MICCAI.

[50]  Shuo Li,et al.  A learning-based automatic clinical organ segmentation in medical images , 2007, SPIE Medical Imaging.

[51]  Krzysztof Krawiec,et al.  Segmenting Retinal Blood Vessels With Deep Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[52]  N. Saitō,et al.  A novel 3-dimensional image analysis system for case-specific kidney anatomy and surgical simulation to facilitate clampless partial nephrectomy. , 2014, Urology.

[53]  Anh Nguyen,et al.  Spatial PixelCNN: Generating Images from Patches , 2017, ArXiv.