Abdominal CT urography kidney segmentation using spatiotemporal fully convolutional network

Kidney segmentation is fundamental for accurate diagnosis and treatment of kidney diseases. Computed tomography urography imaging is commonly used for radiologic diagnosis of patients with urologic disease. Recently, 2D and 3D fully convolutional networks are widely employed for medical image segmentation. However, most 2D fully convolutional networks do not take inter-slice spatial information into consideration, resulting in incomplete and inaccurate segmentation of targets in 3D volumes. While the spatial information is truly important for 3D volumes segmentation. To tackle these problems, we propose a computed tomography urography kidney segmentation method on the basis of spatiotemporal fully convolutional networks that employ the convolutional long short-term memory network to model inter-slice features of computed tomography urography images. We trained and tested our proposed method on kidney computed tomography urography data. The experimental results demonstrate our proposed method can effectively leverage the inter-slice spatial information to achieve better (or comparable) results than current 2D and 3D fully convolutional networks.

[1]  Shu Zhang,et al.  Automatic pancreas segmentation based on lightweight DCNN modules and spatial prior propagation , 2020, Pattern Recognit..

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  R. Youssef,et al.  Anatomic predictors of formation of lower caliceal calculi: is it the time for three-dimensional computed tomography urography? , 2008, Journal of endourology.

[4]  Anne L. Martel,et al.  Determining tumor cellularity in digital slides using ResNet , 2018, Medical Imaging.

[5]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[6]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Hossein Baharvand,et al.  Automatic white blood cell classification using pre-trained deep learning models: ResNet and Inception , 2018, International Conference on Machine Vision.

[9]  Sanjukta Krishnagopal,et al.  Bidirectional Convolutional LSTM for the Detection of Violence in Videos , 2018, ECCV Workshops.

[10]  Miriam Bellver,et al.  RVOS: End-To-End Recurrent Network for Video Object Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Hao Chen,et al.  Automatic 3D Cardiovascular MR Segmentation with Densely-Connected Volumetric ConvNets , 2017, MICCAI.

[12]  J. Lee,et al.  Comparison of stone-free rates following shock wave lithotripsy, percutaneous nephrolithotomy, and retrograde intrarenal surgery for treatment of renal stones: A systematic review and network meta-analysis , 2019, PloS one.

[13]  Yan Xu,et al.  The value of three-dimensional helical computed tomography for the retrograde flexible ureteronephroscopy in the treatment of lower pole calyx stones , 2016, Chronic diseases and translational medicine.

[14]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[15]  Klaus H. Maier-Hein,et al.  An attempt at beating the 3D U-Net , 2019, Submissions to the 2019 Kidney Tumor Segmentation Challenge: KiTS19.

[16]  Ronald M. Summers,et al.  Deep Learning in Medical Imaging: Overview and Future Promise of an Exciting New Technique , 2016 .

[17]  Jiwoong Jeong,et al.  Weekly supervised convolutional long short-term memory neural networks for MR-TRUS registration , 2020, Medical Imaging.