Toward Autonomous Robotic Micro-Suturing using Optical Coherence Tomography Calibration and Path Planning

Robotic automation has the potential to assist human surgeons in performing suturing tasks in microsurgery, and in order to do so a robot must be able to guide a needle with sub-millimeter precision through soft tissue. This paper presents a robotic suturing system that uses 3D optical coherence tomography (OCT) system for imaging feedback. Calibration of the robot-OCT and robot-needle transforms, wound detection, keypoint identification, and path planning are all performed automatically. The calibration method handles pose uncertainty when the needle is grasped using a variant of iterative closest points. The path planner uses the identified wound shape to calculate needle entry and exit points to yield an evenly-matched wound shape after closure. Experiments on tissue phantoms and animal tissue demonstrate that the system can pass a suture needle through wounds with 0.200 mm overall accuracy in achieving the planned entry and exit points, and over 20× more precise than prior autonomous suturing robots.

[1]  Ji Ma,et al.  Autonomous suturing via surgical robot: An algorithm for optimal selection of needle diameter, shape, and path , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[2]  Vladlen Koltun,et al.  Open3D: A Modern Library for 3D Data Processing , 2018, ArXiv.

[3]  G. Ripandelli,et al.  Optical coherence tomography. , 1998, Seminars in ophthalmology.

[4]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Kris Hauser,et al.  Robust Contact Generation for Robot Simulation with Unstructured Meshes , 2013, ISRR.

[6]  Murat Cenk Cavusoglu,et al.  Needle path planning for autonomous robotic surgical suturing , 2013, 2013 IEEE International Conference on Robotics and Automation.

[7]  John T. Wen,et al.  Autonomous suturing using minimally invasive surgical robots , 2000, Proceedings of the 2000. IEEE International Conference on Control Applications. Conference Proceedings (Cat. No.00CH37162).

[8]  Kris Hauser,et al.  Optical Coherence Tomography Guided Robotic Needle Insertion for Deep Anterior Lamellar Keratoplasty , 2019, IEEE Transactions on Biomedical Engineering.

[9]  M. Ali Nasseri,et al.  A targeted drug delivery platform for assisting retinal surgeons for treating Age-related Macular Degeneration (AMD) , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[10]  Joseph A. Izatt,et al.  Real-Time Image-Guided Cooperative Robotic Assist Device for Deep Anterior Lamellar Keratoplasty , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Nabil Simaan,et al.  Evaluation of microsurgical tasks with OCT-guided and/or robot-assisted ophthalmic forceps. , 2015, Biomedical optics express.

[12]  Rita Cucchiara,et al.  Optimized Block-Based Connected Components Labeling With Decision Trees , 2010, IEEE Transactions on Image Processing.

[13]  Kenneth Y. Goldberg,et al.  Automating multi-throw multilateral surgical suturing with a mechanical needle guide and sequential convex optimization , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Danna Zhou,et al.  d. , 1934, Microbial pathogenesis.

[15]  Alois Knoll,et al.  Automation of tissue piercing using circular needles and vision guidance for computer aided laparoscopic surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.

[16]  Joseph A. Izatt,et al.  Real-time corneal segmentation and 3D needle tracking in intrasurgical OCT , 2018, Biomedical optics express.

[17]  Nassir Navab,et al.  Towards Robotic Eye Surgery: Marker-Free, Online Hand-Eye Calibration Using Optical Coherence Tomography Images , 2018, IEEE Robotics and Automation Letters.

[18]  Jun Liu,et al.  Robotic Microsurgery: Validating an Assessment Tool and Plotting the Learning Curve , 2014, Plastic and reconstructive surgery.

[19]  Sina Farsiu,et al.  Length-adaptive graph search for automatic segmentation of pathological features in optical coherence tomography images , 2016, Journal of biomedical optics.