Toward image-guided partial nephrectomy with the da Vinci robot: exploring surface acquisition methods for intraoperative re-registration

Our overarching goal is to facilitate wider adoption of robot-assisted partial nephrectomy through image- guidance, which can enable a surgeon to visualize subsurface features and instrument locations in real time intraoperatively. This is motivated by the observation that while there are compelling lifelong health benefits of partial nephrectomy, radical nephrectomy remains an overused surgical approach for many kidney cancers. Image-guidance may facilitate wider adoption of the procedure because it has the potential to increase surgeons' confidence in efficiently and safely exposing critical structures as well as achieving negative margins with maximal benign tissue sparing, particularly in a minimally invasive setting. To maintain the accuracy of image-guidance during the procedure as the kidney moves, periodic re-registration of medical image data to kidney anatomy is necessary. In this paper, we evaluate three registration approaches for the da Vinci Surgical System that have the potential to enable real-time updates to the display of segmented preoperative images within its console. Specifically, we compare the use of surface ink fiducials triangulated from stereo endoscope images, point clouds obtained without fiducials using a stereoscopic depth mapping algorithm, and points obtained by lightly tracing the da Vinci tool tip over the kidney surface. We compare and contrast the three approaches from both an accuracy and a workflow perspective.

[1]  Courtenay Glisson,et al.  The use of virtual fiducials in image-guided kidney surgery , 2011, Medical Imaging.

[2]  S. Duke Herrell,et al.  Feasibility study for image guided kidney surgery: assessment of required intraoperative surface for accurate image to physical space registrations , 2006, SPIE Medical Imaging.

[3]  S. Duke Herrell,et al.  Towards image guided robotic surgery: multi-arm tracking through hybrid localization , 2009, International Journal of Computer Assisted Radiology and Surgery.

[4]  Ron Kikinis,et al.  3D Slicer , 2012, 2004 2nd IEEE International Symposium on Biomedical Imaging: Nano to Macro (IEEE Cat No. 04EX821).

[5]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[6]  Darius Burschka,et al.  DaVinci Canvas: A Telerobotic Surgical System with Integrated, Robot-Assisted, Laparoscopic Ultrasound Capability , 2005, MICCAI.

[7]  R. Galloway,et al.  Kidney deformation and intraprocedural registration: a study of elements of image-guided kidney surgery. , 2011, Journal of endourology.

[8]  Jay B. West,et al.  Predicting error in rigid-body point-based registration , 1998, IEEE Transactions on Medical Imaging.

[9]  W. Stadler,et al.  Kidney cancer , 1998, The Lancet.

[10]  R. Galloway,et al.  Image-guided robotic surgery: update on research and potential applications in urologic surgery , 2012, Current opinion in urology.

[11]  Lena Maier-Hein,et al.  Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgery , 2013, Medical Image Anal..

[12]  Jiaolong Yang,et al.  Go-ICP: A Globally Optimal Solution to 3D ICP Point-Set Registration , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Guang-Zhong Yang,et al.  Three-Dimensional Tissue Deformation Recovery and Tracking , 2010, IEEE Signal Processing Magazine.

[14]  Robert J. Webster,et al.  A novel method for texture-mapping conoscopic surfaces for minimally invasive image-guided kidney surgery , 2016, International Journal of Computer Assisted Radiology and Surgery.

[15]  Guang-Zhong Yang,et al.  An effective visualisation and registration system for image-guided robotic partial nephrectomy , 2012, Journal of Robotic Surgery.

[16]  Austin Reiter,et al.  Appearance learning for 3D tracking of robotic surgical tools , 2014, Int. J. Robotics Res..

[17]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  R. Abugharbieh,et al.  Towards multi-modal image-guided tumour identification in robot-assisted partial nephrectomy , 2014, 2nd Middle East Conference on Biomedical Engineering.

[19]  Xiaoli Zhang,et al.  Application of visual tracking for robot-assisted laparoscopic surgery , 2002, J. Field Robotics.

[20]  Septimiu E. Salcudean,et al.  A System for MR-Ultrasound Guidance during Robot-Assisted Laparoscopic Radical Prostatectomy , 2015, MICCAI.

[21]  S. Herrell Toward image-guided robotic surgery: Determining intrinsic accuracy of the da Vinci robot , 2007 .

[22]  Russell H. Taylor,et al.  Augmented reality during robot-assisted laparoscopic partial nephrectomy: toward real-time 3D-CT to stereoscopic video registration. , 2009, Urology.

[23]  S. Duke Herrell,et al.  A kidney deformation model for use in non-rigid registration during image-guided surgery , 2008, SPIE Medical Imaging.

[24]  Robert J. Webster,et al.  Registration methods for gross motion correction during image- guided kidney surgery , 2011 .

[25]  S. Matin,et al.  Guideline for management of the clinical stage 1 renal mass , 2009 .

[26]  Heiko Hirschmüller,et al.  Stereo Processing by Semiglobal Matching and Mutual Information , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Jeffrey A. Cadeddu,et al.  Toward Long-Term and Accurate Augmented-Reality for Monocular Endoscopic Videos , 2014, IEEE Transactions on Biomedical Engineering.

[28]  John T. Wei,et al.  National utilization trends of partial nephrectomy for renal cell carcinoma: a case of underutilization? , 2006, Urology.

[29]  A. Darzi,et al.  Augmented reality partial nephrectomy: examining the current status and future perspectives. , 2014, Urology.

[30]  Wisama Khalil,et al.  Modeling, Identification and Control of Robots , 2003 .

[31]  Paolo Cignoni,et al.  MeshLab: an Open-Source Mesh Processing Tool , 2008, Eurographics Italian Chapter Conference.

[32]  Robert L Galloway,et al.  Toward image guided robotic surgery: system validation. , 2009, The Journal of urology.

[33]  Joan Climent,et al.  Automatic Instrument Localization in Laparoscopic Surgery , 2009, Progress in Computer Vision and Image Analysis.

[34]  Russell H. Taylor,et al.  Video to CT Registration for Image Overlay on Solid Organs , 2008 .

[35]  Robert Rohling,et al.  Intra-operative "Pick-Up" Ultrasound for Robot Assisted Surgery with Vessel Extraction and Registration: A Feasibility Study , 2011, IPCAI.

[36]  Guang-Zhong Yang,et al.  Soft-Tissue Motion Tracking and Structure Estimation for Robotic Assisted MIS Procedures , 2005, MICCAI.