Beveled needle position and pose estimation based on optical coherence tomography in ophthalmic microsurgery

The needle position and pose is essential information in ophthalmic microsurgery. Estimation of these parameters is still an open problem, which hinders the application of various robot-assisted surgeries, such as autonomous injection. This paper presents a method to estimate the position and pose of beveled needle using three-dimensional Optical Coherence Tomography (OCT) image cube. The incomplete 3D point cloud of beveled needle obtained from OCT image cube is used to reconstruct the needle by fitting the projection of needle points based on its geometric features. We demonstrate the applicability of our method in ophthalmic injection surgery using ex vivo pig eyes and evaluate the accuracy of position and pose information using a micromanipulator.

[1]  L. Bynoe,et al.  RETINAL ENDOVASCULAR SURGERY FOR CENTRAL RETINAL VEIN OCCLUSION: Initial Experience of Four Surgeons , 2004, Retina.

[2]  Peter K Kaiser,et al.  Intraoperative optical coherence tomography using the RESCAN 700: preliminary results from the DISCOVER study , 2014, British Journal of Ophthalmology.

[3]  Jin U. Kang,et al.  Active tremor cancellation by a "smart" handheld vitreoretinal microsurgical tool using swept source optical coherence tomography. , 2012, Optics express.

[4]  Russell H. Taylor,et al.  Towards automatic calibration of Fourier-Domain OCT for robot-assisted vitreoretinal surgery , 2010, Optics express.

[5]  Nassir Navab,et al.  Surgical Tool Tracking and Pose Estimation in Retinal Microsurgery , 2015, MICCAI.

[6]  Alois Knoll,et al.  Needle Segmentation in Volumetric Optical Coherence Tomography Images for Ophthalmic Microsurgery , 2017 .

[7]  T. Michael Nork,et al.  Validation of a Rabbit Model of Choroidal Neovascularization Induced by a Subretinal Injection of FGF-LPS , 2014 .

[8]  Nassir Navab,et al.  Real-time localization of articulated surgical instruments in retinal microsurgery , 2016, Medical Image Anal..

[9]  Haoran Yu,et al.  Design, calibration and preliminary testing of a robotic telemanipulator for OCT guided retinal surgery , 2013, 2013 IEEE International Conference on Robotics and Automation.

[10]  K. Hynynen,et al.  Transcranial Magnetic Resonance Imaging– Guided Focused Ultrasound Surgery of Brain Tumors: Initial Findings in 3 Patients , 2010, Neurosurgery.

[11]  Andrew E. Johnson,et al.  Surface registration by matching oriented points , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[12]  Nassir Navab,et al.  Introducing Augmented Reality to Optical Coherence Tomography in Ophthalmic Microsurgery , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[13]  Ming Li,et al.  Real‐time interactive MRI‐guided cardiac surgery: Aortic valve replacement using a direct apical approach , 2006, Magnetic resonance in medicine.

[14]  Russell H. Taylor,et al.  Data-Driven Visual Tracking in Retinal Microsurgery , 2012, MICCAI.

[15]  Junzhou Huang,et al.  Instrument Tracking via Online Learning in Retinal Microsurgery , 2014, MICCAI.

[16]  Mamoru Mitsuishi,et al.  A parallel robot to assist vitreoretinal surgery , 2009, International Journal of Computer Assisted Radiology and Surgery.

[17]  Sarthak Misra,et al.  Real-time three-dimensional flexible needle tracking using two-dimensional ultrasound , 2013, 2013 IEEE International Conference on Robotics and Automation.

[18]  Russell H. Taylor,et al.  Computer-Integrated Surgery: Technology and Clinical Applications , 1995 .

[19]  Jitendra Malik,et al.  Aligning 3D models to RGB-D images of cluttered scenes , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).