Autonomous Positioning of Eye Surgical Robot Using the Tool Shadow and Kalman Filtering

Vitreoretinal surgery is one of the most difficult surgical operations, even for experienced surgeons. Thus, a master-slave eye surgical robot has been developed to assist the surgeon in safely performing vitreoretinal surgeries; however, in the master-slave control, the robotic positioning accuracy depends on the surgeon’s coordination skills. This paper proposes a new method of autonomous robotic positioning using the shadow of the surgical instrument. First, the microscope image is segmented into three regions—namely, a micropipette, its shadow, and the eye ground—using a Gaussian mixture model (GMM). The tips of the micropipette and its shadow are then extracted from the contour lines of the segmented regions. The micropipette is then autonomously moved down to the simulated eye ground until the distance between the tips of micropipette and its shadow in the microscopic image reaches a predefined threshold. To handle possible occlusions, the tip of the shadow is estimated using a Kalman filter. Experiments to evaluate the robotic positioning accuracy in the vertical direction were performed. The results show that the autonomous positioning using the Kalman filter enhanced the accuracy of robotic positioning.

[1]  Greg Welch,et al.  An Introduction to Kalman Filter , 1995, SIGGRAPH 2001.

[2]  Cameron N. Riviere,et al.  Real-time retinal vessel mapping and localization for intraocular surgery , 2013, 2013 IEEE International Conference on Robotics and Automation.

[3]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[4]  Cameron N. Riviere,et al.  Toward monocular camera-guided retinal vein cannulation with an actively stabilized handheld robot , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Russell H. Taylor,et al.  Force-sensing microneedle for assisted retinal vein cannulation , 2014, IEEE SENSORS 2014 Proceedings.

[6]  Lm Ross The Image Processing Handbook , Sixth Edition, John C. Russ. CRC Press, Boca Raton FL, 2011, 972 pages. ISBN 1-4398-4045-0 (Hardcover) , 2011, Microscopy and Microanalysis.

[7]  A. Joussen,et al.  Retinal vessel diameter measurements by spectral domain optical coherence tomography , 2015, Graefe's Archive for Clinical and Experimental Ophthalmology.

[8]  J. L. Roux An Introduction to the Kalman Filter , 2003 .

[9]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[10]  Fumihito Arai,et al.  Autonomous 3-D positioning of surgical instrument concerning compatibility with the eye surgical procedure , 2016 .

[11]  Fumihito Arai,et al.  Image Processing for Autonomous Positioning of Eye Surgery Robot in Micro-Cannulation , 2017 .

[12]  Mamoru Mitsuishi,et al.  Design and development of miniature parallel robot for eye surgery , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[13]  Louis A. Lobes,et al.  Vision-Based Control of a Handheld Surgical Micromanipulator With Virtual Fixtures , 2013, IEEE Transactions on Robotics.