6DOF Needle Pose Estimation for Robot-Assisted Vitreoretinal Surgery

Vitreoretinal (VR) surgery is typical microsurgery with delicate and complex surgical procedures. The vision-based navigation for robot-assisted VR surgery has not been fully exploited because of the challenges that arise from illumination, high precision, and safety assessments. This paper presents a novel method to estimate the 6DOF needle pose specifically for the application of robotic intraocular needle navigation using optical coherence tomography (OCT) volumes. The key ingredients of the proposed method are 1) 3D needle point cloud segmentation in OCT volume and 2) needle point cloud 6DOF pose estimation using a modified iterative closest point (ICP) algorithm. To address the former, a voting mechanism with geometric features of the needle is utilized to robustly segment the needle in OCT volume. Afterward, the CAD model of the needle point cloud is matched with the segmented needle point cloud to estimate the 6DOF needle pose with a proposed shift-rotate ICP (SR-ICP). This method is evaluated by the existing ophthalmic robot on ex-vivo pig eyes. The quantitative and qualitative results are evaluated and presented for the proposed method.

[1]  A. Farmery,et al.  First-in-human study of the safety and viability of intraocular robotic surgery , 2018, Nature Biomedical Engineering.

[2]  Haoran Yu,et al.  Design, calibration and preliminary testing of a robotic telemanipulator for OCT guided retinal surgery , 2013, 2013 IEEE International Conference on Robotics and Automation.

[3]  Nassir Navab,et al.  Concurrent Segmentation and Localization for Tracking of Surgical Instruments , 2017, MICCAI.

[4]  Cameron N. Riviere,et al.  A study of instrument motion in retinal microsurgery , 2000, Proceedings of the 22nd Annual International Conference of the IEEE Engineering in Medicine and Biology Society (Cat. No.00CH37143).

[5]  Alois Knoll,et al.  Kinematics and dynamics analysis of a hybrid parallel-serial micromanipulator designed for biomedical applications , 2013, 2013 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[6]  Nils Gessert,et al.  A deep learning approach for pose estimation from volumetric OCT data , 2018, Medical Image Anal..

[7]  Russell H. Taylor,et al.  3-DOF Force-Sensing Motorized Micro-Forceps for Robot-Assisted Vitreoretinal Surgery , 2017, IEEE Sensors Journal.

[8]  Thomas Probst,et al.  Automatic Tool Landmark Detection for Stereo Vision in Robot-Assisted Retinal Surgery , 2018, IEEE Robotics and Automation Letters.

[9]  K. Hynynen,et al.  Transcranial MRI-guided focused ultrasound surgery of brain tumors: Initial findings in patients , 2008 .

[10]  Mamoru Mitsuishi,et al.  A parallel robot to assist vitreoretinal surgery , 2009, International Journal of Computer Assisted Radiology and Surgery.

[11]  Sarthak Misra,et al.  Real-time three-dimensional flexible needle tracking using two-dimensional ultrasound , 2013, 2013 IEEE International Conference on Robotics and Automation.

[12]  Nassir Navab,et al.  Real-Time 3D Model Tracking in Color and Depth on a Single CPU Core , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Nassir Navab,et al.  Fast 5DOF needle tracking in iOCT , 2018, International Journal of Computer Assisted Radiology and Surgery.

[14]  Nassir Navab,et al.  Introducing Augmented Reality to Optical Coherence Tomography in Ophthalmic Microsurgery , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[15]  Russell H. Taylor,et al.  Data-Driven Visual Tracking in Retinal Microsurgery , 2012, MICCAI.

[16]  M. Ali Nasseri,et al.  A targeted drug delivery platform for assisting retinal surgeons for treating Age-related Macular Degeneration (AMD) , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[17]  Russell H. Taylor,et al.  Towards automatic calibration of Fourier-Domain OCT for robot-assisted vitreoretinal surgery , 2010, Optics express.

[18]  Nassir Navab,et al.  Towards Robotic Eye Surgery: Marker-Free, Online Hand-Eye Calibration Using Optical Coherence Tomography Images , 2018, IEEE Robotics and Automation Letters.

[19]  Jin U. Kang,et al.  Active tremor cancellation by a "smart" handheld vitreoretinal microsurgical tool using swept source optical coherence tomography. , 2012, Optics express.

[20]  T. Michael Nork,et al.  Validation of a Rabbit Model of Choroidal Neovascularization Induced by a Subretinal Injection of FGF-LPS , 2014 .

[21]  Ming Li,et al.  Real‐time interactive MRI‐guided cardiac surgery: Aortic valve replacement using a direct apical approach , 2006, Magnetic resonance in medicine.

[22]  Peter K Kaiser,et al.  Intraoperative optical coherence tomography using the RESCAN 700: preliminary results from the DISCOVER study , 2014, British Journal of Ophthalmology.

[23]  Junzhou Huang,et al.  Instrument Tracking via Online Learning in Retinal Microsurgery , 2014, MICCAI.

[24]  Nassir Navab,et al.  Real-time localization of articulated surgical instruments in retinal microsurgery , 2016, Medical Image Anal..

[25]  Nassir Navab,et al.  Surgical Tool Tracking and Pose Estimation in Retinal Microsurgery , 2015, MICCAI.