A paced shared-control teleoperated architecture for supervised automation of multilateral surgical tasks

Automation of repetitive tasks can improve laparoscopic surgical procedures by unloading surgeons and reducing duration, trauma, and expense. However, surgical procedures involve delicate manipulation of deformable tissues in a very dynamic environment, suggesting that automated execution of surgical tasks should be carried out under the supervision of the surgeon. We propose a teleoperated architecture that allows a surgeon to employ and supervise agents that can autonomously perform or assist with surgical tasks. The architecture is independent of the automation method. It includes a dominance factor that allows the surgeon to take control over the slave robot at any time, and an aggressiveness factor that sets the performance pace of the autonomous agent. We tested the architecture during execution of a multilateral tension-and-cut task, where a human operator and an autonomous agent are responsible for tensioning or cutting of a tissue. The architecture allowed for supervised and paced automation of the task. We found that collaboration of the human operator and autonomous agent can lead to shorter completion time compared to performance of only a human.

[1]  Brian L. Davies.  Synergistic Robots in Surgery-Surgeons and Robots Working Co-Operatively , 1997, ISER.

[2]  John T. Wen,et al.  Autonomous suturing using minimally invasive surgical robots , 2000, Proceedings of the 2000. IEEE International Conference on Control Applications. Conference Proceedings (Cat. No.00CH37162).

[3]  Marcia Kilchenman O'Malley,et al.  Passive and active assistance for human performance of a simulated underactuated dynamic task , 2003, 11th Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2003. HAPTICS 2003. Proceedings..

[4]  Holly A. Yanco,et al.  Blending human and robot inputs for sliding scale autonomy , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[5]  Ranjan Mukherjee,et al.  A shared-control approach to haptic interface design for minimally invasive telesurgical training , 2005, IEEE Transactions on Control Systems Technology.

[6]  Mark R. Cutkosky,et al.  Feedback Strategies for Telemanipulation with Shared Control of Object Handling Forces , 2005, Presence: Teleoperators & Virtual Environments.

[7]  Blake Hannaford,et al.  Generalized approach for modeling minimally invasive surgery as a stochastic process using a discrete Markov model , 2006, IEEE Transactions on Biomedical Engineering.

[8]  Darius Burschka,et al.  Automation of Manual Tasks for Minimally Invasive Surgery , 2008, Fourth International Conference on Autonomic and Autonomous Systems (ICAS'08).

[9]  A. Deguet,et al.  The cisst libraries for computer assisted intervention systems , 2008, The MIDAS Journal.

[10]  Brian L. Davies,et al.  Robotic surgery: from autonomous systems to intelligent tools , 2010, Robotica.

[11]  E.D. Light,et al.  3-D ultrasound guidance of autonomous robot for location of ferrous shrapnel , 2009, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[12]  Gregory D. Hager,et al.  Task versus Subtask Surgical Skill Evaluation of Robotic Minimally Invasive Surgery , 2009, MICCAI.

[13]  Pieter Abbeel,et al.  Superhuman performance of surgical tasks by robots using iterative learning from human-guided demonstrations , 2010, 2010 IEEE International Conference on Robotics and Automation.

[14]  Alois Knoll,et al.  Automation of tissue piercing using circular needles and vision guidance for computer aided laparoscopic surgery , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  Gregory D. Hager,et al.  Human-Machine Collaborative surgery using learned models , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  Keyvan Hashtrudi-Zaad,et al.  Shared control architectures for haptic training: Performance and coupled stability analysis , 2011, Int. J. Robotics Res..

[17]  K. M. Deliparaschos,et al.  Evolution of autonomous and semi‐autonomous robotic surgical systems: a review of the literature , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[18]  Siddhartha S. Srinivasa,et al.  Formalizing Assistive Teleoperation , 2012, Robotics: Science and Systems.

[19]  F. Brody,et al.  Review of robotic versus conventional laparoscopic surgery , 2014, Surgical Endoscopy.

[20]  Allison M. Okamura,et al.  Autonomous robotic palpation: Machine learning techniques to identify hard inclusions in soft tissues , 2013, 2013 IEEE International Conference on Robotics and Automation.

[21]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Mahdi Tavakoli,et al.  Absolute Stability of a Class of Trilateral Haptic Systems , 2014, IEEE Transactions on Haptics.

[23]  Mamoru Mitsuishi,et al.  Online Trajectory Planning in Dynamic Environments for Surgical Task Automation , 2014, Robotics: Science and Systems.

[24]  Pieter Abbeel,et al.  Autonomous multilateral debridement with the Raven surgical robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Pieter Abbeel,et al.  Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[26]  Allison M. Okamura,et al.  Teleoperated versus open needle driving: Kinematic analysis of experienced surgeons and novice users , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Lawrence H. Kim,et al.  Design and evaluation of a trilateral shared-control architecture for teleoperated training robots , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).