Automated stereo vision instrument tracking for intraoperative OCT guided anterior segment ophthalmic surgical maneuvers.

Microscope-integrated intraoperative OCT (iOCT) enables imaging of tissue cross-sections concurrent with ophthalmic surgical maneuvers. However, limited acquisition rates and complex three-dimensional visualization methods preclude real-time surgical guidance using iOCT. We present an automated stereo vision surgical instrument tracking system integrated with a prototype iOCT system. We demonstrate, for the first time, automatically tracked video-rate cross-sectional iOCT imaging of instrument-tissue interactions during ophthalmic surgical maneuvers. The iOCT scan-field is automatically centered on the surgical instrument tip, ensuring continuous visualization of instrument positions relative to the underlying tissue over a 2500 mm(2) field with sub-millimeter positional resolution and <1° angular resolution. Automated instrument tracking has the added advantage of providing feedback on surgical dynamics during precision tissue manipulations because it makes it possible to use only two cross-sectional iOCT images, aligned parallel and perpendicular to the surgical instrument, which also reduces both system complexity and data throughput requirements. Our current implementation is suitable for anterior segment surgery. Further system modifications are proposed for applications in posterior segment surgery. Finally, the instrument tracking system described is modular and system agnostic, making it compatible with different commercial and research OCT and surgical microscopy systems and surgical instrumentations. These advances address critical barriers to the development of iOCT-guided surgical maneuvers and may also be translatable to applications in microsurgery outside of ophthalmology.

[1]  Jay B. West,et al.  Designing optically tracked instruments for image-guided surgery , 2004, IEEE Transactions on Medical Imaging.

[2]  Darius Burschka,et al.  Navigating inner space: 3-D assistance for minimally invasive surgery , 2005, Robotics Auton. Syst..

[3]  W. Drexler,et al.  Line-field parallel swept source MHz OCT for structural and functional retinal imaging. , 2015, Biomedical optics express.

[4]  Marcus Ang,et al.  Intraoperative anterior segment optical coherence tomography: a novel assessment tool during deep anterior lamellar keratoplasty. , 2014, American journal of ophthalmology.

[5]  Russell H. Taylor,et al.  Single Fiber Optical Coherence Tomography Microsurgical Instruments for Computer and Robot-Assisted Retinal Surgery , 2009, MICCAI.

[6]  Joseph A Izatt,et al.  Intraoperative spectral domain optical coherence tomography for vitreoretinal surgery. , 2010, Optics letters.

[7]  Bernd Hamann,et al.  Improved representation of retinal data acquired with volumetric Fd-OCT: co-registration, visualization, and reconstruction of a large field of view , 2008, SPIE BiOS.

[8]  Ramiro S. Maldonado,et al.  The use of optical coherence tomography in intraoperative ophthalmic imaging. , 2011, Ophthalmic surgery, lasers & imaging : the official journal of the International Society for Imaging in the Eye.

[9]  János Németh,et al.  Optical and ultrasound measurement of axial length and anterior chamber depth for intraocular lens power calculation , 2003, Journal of cataract and refractive surgery.

[10]  Russell H. Taylor,et al.  Visual Tracking of Surgical Tools for Proximity Detection in Retinal Surgery , 2011, IPCAI.

[11]  Jigang Wu,et al.  Manual-scanning optical coherence tomography probe based on position tracking. , 2009, Optics letters.

[12]  Peter K Kaiser,et al.  NOVEL MICROARCHITECTURAL DYNAMICS IN RHEGMATOGENOUS RETINAL DETACHMENTS IDENTIFIED WITH INTRAOPERATIVE OPTICAL COHERENCE TOMOGRAPHY , 2013, Retina.

[13]  Daniel Grest,et al.  A Comparison of Iterative 2D-3D Pose Estimation Methods for Real-Time Applications , 2009, SCIA.

[14]  Jin U. Kang,et al.  Fiber-optic OCT sensor guided “SMART” micro-forceps for microsurgery , 2013, Biomedical optics express.

[15]  Sina Farsiu,et al.  Visualization of Real-Time Intraoperative Maneuvers with a Microscope-Mounted Spectral Domain Optical Coherence Tomography System , 2013, Retina.

[16]  Eva Lankenau,et al.  Optimizing descemet membrane endothelial keratoplasty using intraoperative optical coherence tomography. , 2013, JAMA ophthalmology.

[17]  Larry S. Davis,et al.  Iterative Pose Estimation Using Coplanar Feature Points , 1996, Comput. Vis. Image Underst..

[18]  Peter Koch,et al.  Real-time 3D rendering of optical coherence tomography volumetric data , 2009, European Conference on Biomedical Optics.

[19]  Changhuei Yang,et al.  Handheld forward-imaging needle endoscope for ophthalmic optical coherence tomography inspection. , 2008, Journal of biomedical optics.

[20]  Reginald Birngruber,et al.  Intraoperative 2-dimensional optical coherence tomography as a new tool for anterior segment surgery. , 2005, Archives of ophthalmology.

[21]  Joseph A. Izatt,et al.  Visualization of vitreoretinal surgical manipulations using intraoperative spectral domain optical coherence tomography , 2011, BiOS.

[22]  Sina Farsiu,et al.  Integration of a spectral domain optical coherence tomography system into a surgical microscope for intraoperative imaging. , 2011, Investigative ophthalmology & visual science.

[23]  Russell H. Taylor,et al.  Data-Driven Visual Tracking in Retinal Microsurgery , 2012, MICCAI.

[24]  Junzhou Huang,et al.  Instrument Tracking via Online Learning in Retinal Microsurgery , 2014, MICCAI.

[25]  Jin-Hui Shen,et al.  Miniature real-time intraoperative forward-imaging optical coherence tomography probe. , 2013, Biomedical optics express.

[26]  Susanne Binder,et al.  FEASIBILITY OF INTRASURGICAL SPECTRAL-DOMAIN OPTICAL COHERENCE TOMOGRAPHY , 2011, Retina.

[27]  Oliver Findl,et al.  Predicting the postoperative intraocular lens position using continuous intraoperative optical coherence tomography measurements. , 2013, Investigative ophthalmology & visual science.

[28]  Andrew M. Rollins,et al.  Integrative Advances for OCT-Guided Ophthalmic Surgery and Intraoperative OCT: Microscope Integration, Surgical Instrumentation, and Heads-Up Display Surgeon Feedback , 2014, 2015 Conference on Lasers and Electro-Optics (CLEO).

[29]  Vijaysekhar Jayaraman,et al.  MEMS tunable VCSEL light source for ultrahigh speed 60kHz - 1MHz axial scan rate and long range centimeter class OCT imaging , 2012, Photonics West - Biomedical Optics.

[30]  A. Hayashi,et al.  Efficacy of Intraoperative Anterior Segment Optical Coherence Tomography during Descemet's Stripping Automated Endothelial Keratoplasty , 2014, ISRN ophthalmology.

[31]  Sunil K Srivastava,et al.  Intraoperative spectral-domain optical coherence tomography during complex retinal detachment repair. , 2011, Ophthalmic surgery, lasers & imaging : the official journal of the International Society for Imaging in the Eye.

[32]  Joseph A. Izatt,et al.  Real-Time Acquisition, Processing, and 3D Visualization of Anterior Segment Swept Source Optical Coherence Tomography (SSOCT) at 10 volumes (275 MVoxels) per second , 2014 .

[33]  Yuankai K. Tao,et al.  Microscope-integrated intraoperative OCT with electrically tunable focus and heads-up display for imaging of ophthalmic surgical maneuvers. , 2014, Biomedical optics express.

[34]  Bernd Hamann,et al.  Comparison of real-time visualization of volumetric OCT data sets by CPU-slicing and GPU-ray casting methods , 2009, BiOS.

[35]  Wolfgang Wieser,et al.  Full volumetric video rate OCT of the posterior eye with up to 195.2 volumes/s , 2015, Photonics West - Biomedical Optics.

[36]  N. Yenerel,et al.  Intraoperative use of AS-OCT during intrastromal corneal ring segment implantation. , 2012, Ophthalmic surgery, lasers & imaging : the official journal of the International Society for Imaging in the Eye.

[37]  William M. Wells,et al.  Medical Image Computing and Computer-Assisted Intervention — MICCAI’98 , 1998, Lecture Notes in Computer Science.

[38]  Russell H. Taylor,et al.  Unified Detection and Tracking of Instruments during Retinal Microsurgery , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Gabor Fichtinger,et al.  Electromagnetic tracking in surgical and interventional environments: usability study , 2015, International Journal of Computer Assisted Radiology and Surgery.

[40]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  C K Hitzenberger,et al.  Improved prediction of intraocular lens power using partial coherence interferometry , 2001, Journal of cataract and refractive surgery.