An Open-Source Framework for Surgical Subtask Automation

Robot-Assisted Surgery (RAS) is becoming a standard in Minimally Invasive Surgery (MIS). Despite RAS’ benefits and potential, surgeons still have to perform themselves a number of monotonous and time-consuming subtasks like knot- tying or blunt dissection. Many believe that the next big step in development is the automation of such subtasks. Partial automation can reduce the cognitive load on surgeons, supporting them to pay more attention to the most critical elements of the surgical workflow. Our aim was to develop a framework to ease and fasten the automation of surgical subtasks. This framework was built alongside the da Vinci Research Kit (dVRK), while it can be ported easily onto further robotic platforms, since it is based on the Robot Operating System (ROS). The software includes both stereo vision-based and hierarchical motion planning, with a wide palette of often used surgical gestures—such as grasping, cutting or soft tissue manipulation—as building blocks to support the high-level implementation of autonomous surgical subtasks. This open-source surgical automation framework—irob-saf—is available at https://github.com/ABC-iRobotics/irob-saf.

[1]  Peter Kazanzides,et al.  CoSTAR in Surgery : A Cross-platform User Interface for Surgical Robot Task Specification , 2017 .

[2]  L. MacKenzie,et al.  Hierarchical decomposition of laparoscopic surgery: a human factors approach to investigating the operating room environment , 2001, Minimally invasive therapy & allied technologies : MITAT : official journal of the Society for Minimally Invasive Therapy.

[3]  Pieter Abbeel,et al.  Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Allison M. Okamura,et al.  Autonomous robotic palpation: Machine learning techniques to identify hard inclusions in soft tissues , 2013, 2013 IEEE International Conference on Robotics and Automation.

[5]  Imre J. Rudas,et al.  Towards surgical subtask automation — Blunt dissection , 2017, 2017 IEEE 21st International Conference on Intelligent Engineering Systems (INES).

[6]  Kenneth Y. Goldberg,et al.  Tumor localization using automated palpation with Gaussian Process Adaptive Sampling , 2016, 2016 IEEE International Conference on Automation Science and Engineering (CASE).

[7]  Imre J. Rudas,et al.  Origins of surgical robotics: From space to the operating room , 2016 .

[8]  Imre J. Rudas,et al.  Open-Source Research Platforms and System Integration in Modern Surgical Robotics , 2015 .

[9]  Narges Ahmidi,et al.  Analysis of the Structure of Surgical Activity for a Suturing and Knot-Tying Task , 2016, PloS one.

[10]  Kenneth Y. Goldberg,et al.  Automating multi-throw multilateral surgical suturing with a mechanical needle guide and sequential convex optimization , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).