Parallelism in Autonomous Robotic Surgery

Robots can perform multiple tasks in parallel. This work is about leveraging this capability in automating multilateral surgical subtasks. In particular, we explore, in a simulation study, the benefits of considering this parallelism capability in developing execution models for autonomous robotic surgery. We apply our work to two surgical subtask categories: (i) coupled-motion subtasks, where multiple robot arms share the same resources to perform the subtask, and (ii) decoupled-motion subtasks, where each robot arm executes its part of the task independently from the others. We propose and develop parallel execution models for the surgical debridement subtask, a representative of the first category, and the multi-throw suturing subtask, a representative of the second one. Comparing these parallel execution models to the state-of-the-art ones shows significant reductions in the subtasks completion time by at least 40%. In 20 trials, our results show that our proposed model for the surgical debridement subtask, that uses hierarchical concurrent state machines, provides a parallel execution framework that is efficient while greatly reducing collisions between the arms compared to a naive parallel execution model without coordination. We also show how applying parallelism can lead to execution models that go beyond the normal practice of human surgeons. We finally propose the notion of “automation for surgical manual execution” where we argue that autonomous robotic surgery research can be used as a tool for surgeons to discover novel manual execution models that can significantly improve their surgical practice.

[1]  Santosh Iyer,et al.  A single arm, single camera system for automated suturing , 2013, 2013 IEEE International Conference on Robotics and Automation.

[2]  Blake Hannaford,et al.  Semi-autonomous simulated brain tumor ablation with RAVENII Surgical Robot using behavior tree , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Michael D. Marion,et al.  Suture choice and other methods of skin closure. , 2009, The Surgical clinics of North America.

[4]  M. Granick,et al.  Toward a common language: surgical wound bed preparation and debridement , 2006, Wound repair and regeneration : official publication of the Wound Healing Society [and] the European Tissue Repair Society.

[5]  Michael C. Yip,et al.  Robot Autonomy for Surgery , 2017, The Encyclopedia of Medical Robotics.

[6]  Ryan K. Orosco,et al.  SuPer: A Surgical Perception Framework for Endoscopic Tissue Manipulation With Surgical Robotics , 2020, IEEE Robotics and Automation Letters.

[7]  Carme Torras,et al.  Reinforcement Learning of Bimanual Robot Skills , 2020, Springer Tracts in Advanced Robotics.

[8]  Ji Ma,et al.  Autonomous suturing via surgical robot: An algorithm for optimal selection of needle diameter, shape, and path , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[9]  James B. Rawlings,et al.  Tutorial overview of model predictive control , 2000 .

[10]  Blake Hannaford,et al.  Raven-II: An Open Platform for Surgical Robotics Research , 2013, IEEE Transactions on Biomedical Engineering.

[11]  Petter Ögren,et al.  Towards a unified behavior trees framework for robot control , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[12]  Bruno Siciliano,et al.  A V-REP Simulator for the da Vinci Research Kit Robotic Platform , 2018, 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

[13]  Pieter Abbeel,et al.  Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations , 2010, 2010 IEEE International Conference on Robotics and Automation.

[14]  Pieter Abbeel,et al.  Autonomous multilateral debridement with the Raven surgical robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Fanny Ficuciello,et al.  Haptic-guided shared control for needle grasping optimization in minimally invasive robotic surgery , 2019, 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[16]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[17]  C. Iavazzo,et al.  The Role of Knotless Barbed Suture in Gynecologic Surgery , 2015, Surgical innovation.

[18]  Ryan S. Decker,et al.  Supervised autonomous robotic soft tissue surgery , 2016, Science Translational Medicine.

[19]  Pieter Abbeel,et al.  Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Gregory D. Hager,et al.  Human-Machine Collaborative surgery using learned models , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  A.G. Alleyne,et al.  A survey of iterative learning control , 2006, IEEE Control Systems.

[22]  Changyeob Shin,et al.  Autonomous Suturing Framework and Quantification Using a Cable-Driven Surgical Robot , 2021, IEEE Transactions on Robotics.

[23]  G. Watanabe,et al.  [da Vinci surgical system]. , 2014, Kyobu geka. The Japanese journal of thoracic surgery.

[24]  R. Autorino,et al.  Robotic surgery in urology: the way forward , 2020, World Journal of Urology.

[25]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[26]  Mamoru Mitsuishi,et al.  Online Trajectory Planning and Force Control for Automation of Surgical Tasks , 2018, IEEE Transactions on Automation Science and Engineering.

[27]  T. Dalsgaard,et al.  Robot‐assisted surgery in gynecological oncology: current status and controversies on patient benefits, cost and surgeon conditions – a systematic review , 2017, Acta obstetricia et gynecologica Scandinavica.

[28]  S. Hansen,et al.  Hierarchical, concurrent state machines for behavior modeling and scenario control , 1994, Fifth Annual Conference on AI, and Planning in High Autonomy Systems.

[29]  Christopher P. Childers,et al.  Estimation of the Acquisition and Operating Costs for Robotic Surgery , 2018, JAMA.

[30]  Bruno Siciliano,et al.  Passive Virtual Fixtures Adaptation in Minimally Invasive Robotic Surgery , 2018, IEEE Robotics and Automation Letters.

[31]  Kenneth Y. Goldberg,et al.  Automating multi-throw multilateral surgical suturing with a mechanical needle guide and sequential convex optimization , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[32]  G. Fagogenis,et al.  Autonomous robotic intracardiac catheter navigation using haptic vision , 2019, Science Robotics.

[33]  Paolo Fiorini,et al.  Autonomy in Surgical Robotics , 2021, Annu. Rev. Control. Robotics Auton. Syst..