A Lumen Segmentation Method in Ureteroscopy Images based on a Deep Residual U-Net architecture

U reteroscopy is becoming the first surgical treatment option for the majority of urinary affections. This procedure is performed using an endoscope which provides the surgeon with the visual information necessary to navigate inside the urinary tract. Having in mind the development of surgical assistance systems, that could enhance the performance of surgeon, the task of lumen segmentation is a fundamental part since this is the visual reference which marks the path that the endoscope should follow. This is something that has not been analyzed in ureteroscopy data before. However, this task presents several challenges given the image quality and the conditions itself of ureteroscopy procedures. In this paper, we study the implementation of a Deep Neural Network which exploits the advantage of residual units in an architecture based on U-Net. For the training of these networks, we analyze the use of two different color spaces: gray-scale and RGB data images. We found that training on gray-scale images gives the best results obtaining mean values of Dice Score, Precision, and Recall of 0.73, 0.58, and 0.92 respectively. The results obtained shows that the use of residual U-Net could be a suitable model for further development for a computer-aided system for navigation and guidance through the urinary system.

[1]  Sharib Ali,et al.  MI-UNet: Improved Segmentation in Ureteroscopy , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[2]  M. Humphreys,et al.  Robotic ureteroscopy: The future of stone management? , 2020 .

[3]  Emanuele Frontoni,et al.  Inter-foetus Membrane Segmentation for TTTS Using Adversarial Networks , 2019, Annals of Biomedical Engineering.

[4]  Dahong Qian,et al.  Real-Time Detection of Ureteral Orifice in Urinary Endoscopy Videos Based on Deep Learning , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Danail Stoyanov,et al.  Deep Learning Based Robotic Tool Detection and Articulation Estimation With Spatio-Temporal Layers , 2019, IEEE Robotics and Automation Letters.

[6]  Sharib Ali,et al.  Endoscopy artifact detection (EAD 2019) challenge dataset , 2019, ArXiv.

[7]  Yao Lu,et al.  RIC-Unet: An Improved Neural Network Based on Unet for Nuclei Segmentation in Histology Images , 2019, IEEE Access.

[8]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[9]  Antonio M. López,et al.  A Benchmark for Endoluminal Scene Segmentation of Colonoscopy Images , 2016, Journal of healthcare engineering.

[10]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[11]  F. Montorsi,et al.  Current Standard Technique for Modern Flexible Ureteroscopy: Tips and Tricks. , 2016, European urology.

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Joachim M. Buhmann,et al.  Crowdsourcing the creation of image segmentation algorithms for connectomics , 2015, Front. Neuroanat..

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  Dan Wang,et al.  A Lumen Detection-Based Intestinal Direction Vector Acquisition Method for Wireless Endoscopy Systems , 2015, IEEE Transactions on Biomedical Engineering.

[16]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[17]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Manoj Monga,et al.  Ureteroscopy : indications, instrumentation & technique , 2013 .

[19]  G. Gallo,et al.  Lumen Detection in Endoscopic Images: A Boosting Classification Approach , 2012 .

[20]  Jérôme Szewczyk,et al.  An algorithm for calculi segmentation on ureteroscopic images , 2011, International Journal of Computer Assisted Radiology and Surgery.

[21]  B. Ginneken,et al.  3D Segmentation in the Clinic: A Grand Challenge , 2007 .

[22]  Antonis A. Argyros,et al.  Lumen detection for capsule endoscopy , 2008 .

[23]  J. J. de la Rosette,et al.  Handling and prevention of complications in stone basketing. , 2006, European urology.

[24]  Suresh Senan,et al.  Renal mobility during uncoached quiet respiration: an analysis of 4DCT scans. , 2006, International journal of radiation oncology, biology, physics.

[25]  C. Porter,et al.  Treatment of upper tract urothelial carcinoma: a review of surgical and adjuvant therapy. , 2006, Reviews in urology.

[26]  Qiang Ji,et al.  A new efficient ellipse detection method , 2002, Object recognition supported by user interaction for service robots.