Automating multi-throw multilateral surgical suturing with a mechanical needle guide and sequential convex optimization

For supervised automation of multi-throw suturing in Robot-Assisted Minimally Invasive Surgery, we present a novel mechanical needle guide and a framework for optimizing needle size, trajectory, and control parameters using sequential convex programming. The Suture Needle Angular Positioner (SNAP) results in a 3x error reduction in the needle pose estimate in comparison with the standard actuator. We evaluate the algorithm and SNAP on a da Vinci Research Kit using tissue phantoms and compare completion time with that of humans from the JIGSAWS dataset [5]. Initial results suggest that the dVRK can perform suturing at 30% of human speed while completing 86% suture throws attempted. Videos and data are available at: berkeleyautomation.github.io/amts.

[1]  Alois Knoll,et al.  Automation of tissue piercing using circular needles and vision guidance for computer aided laparoscopic surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.

[2]  Sir Ara W Darzi,et al.  The impact of minimally invasive surgical techniques. , 2004, Annual review of medicine.

[3]  John T. Wen,et al.  Autonomous suturing using minimally invasive surgical robots , 2000, Proceedings of the 2000. IEEE International Conference on Control Applications. Conference Proceedings (Cat. No.00CH37162).

[4]  Blake Hannaford,et al.  Semi-autonomous simulated brain tumor ablation with RAVENII Surgical Robot using behavior tree , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Gregory D. Hager,et al.  Transition state clustering: Unsupervised surgical trajectory segmentation for robot learning , 2017, ISRR.

[6]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Wyatt S. Newman,et al.  Automatic initialization and dynamic tracking of surgical suture threads , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[8]  A. Knoll,et al.  Toward increased autonomy in the surgical OR: needs, requests, and expectations , 2013, Surgical Endoscopy.

[9]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Pieter Abbeel,et al.  Gaussian belief space planning with discontinuities in sensing domains , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Pieter Abbeel,et al.  Motion planning with sequential convex optimization and convex collision checking , 2014, Int. J. Robotics Res..

[12]  Ankush Gupta,et al.  A case study of trajectory transfer through non-rigid registration for a simplified suturing scenario , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Gregory D. Hager,et al.  Human-Machine Collaborative surgery using learned models , 2011, 2011 IEEE International Conference on Robotics and Automation.

[14]  E. Moore,et al.  Single-layer continuous versus two-layer interrupted intestinal anastomosis: a prospective randomized trial. , 2000, Annals of surgery.

[15]  Sebastian Bodenstedt,et al.  Image-based tracking of the suturing needle during laparoscopic interventions , 2015, Medical Imaging.

[16]  Murat Cenk Cavusoglu,et al.  Needle path planning for autonomous robotic surgical suturing , 2013, 2013 IEEE International Conference on Robotics and Automation.

[17]  Pieter Abbeel,et al.  Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[18]  Pieter Abbeel,et al.  Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations , 2010, 2010 IEEE International Conference on Robotics and Automation.

[19]  J. Kaouk,et al.  Fundamental skills of robotic surgery: a multi-institutional randomized controlled trial for validation of a simulation-based curriculum. , 2013, Urology.

[20]  Luiz Velho,et al.  A Hierarchical Segmentation of Articulated Bodies , 2008, Comput. Graph. Forum.

[21]  Luc Soler,et al.  Circular needle and needle-holder localization for computer-aided suturing in laparoscopic surgery , 2005, SPIE Medical Imaging.

[22]  Gregory D. Hager,et al.  Task versus Subtask Surgical Skill Evaluation of Robotic Minimally Invasive Surgery , 2009, MICCAI.

[23]  Gregory D. Hager,et al.  An Improved Model for Segmentation and Recognition of Fine-Grained Activities with Application to Surgical Training Tasks , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[24]  Michael D. Marion,et al.  Suture choice and other methods of skin closure. , 2009, The Surgical clinics of North America.

[25]  Jürgen Schmidhuber,et al.  A System for Robotic Heart Surgery that Learns to Tie Knots Using Recurrent Neural Networks , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Scott Niekum,et al.  Learning grounded finite-state representations from unstructured demonstrations , 2015, Int. J. Robotics Res..

[27]  Pieter Abbeel,et al.  Autonomous multilateral debridement with the Raven surgical robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Pieter Abbeel,et al.  Planning locally optimal, curvature-constrained trajectories in 3D using sequential convex optimization , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[29]  R. Veldkamp,et al.  Laparoscopic surgery versus open surgery for colon cancer : short-term outcomes of a randomised trial , 2022 .

[30]  Murat Cenk Cavusoglu,et al.  Modeling of needle-tissue interaction forces during surgical suturing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[31]  Pieter Abbeel,et al.  Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization , 2013, Robotics: Science and Systems.

[32]  K. M. Deliparaschos,et al.  Evolution of autonomous and semi‐autonomous robotic surgical systems: a review of the literature , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.