Toward human-robot collaboration in surgery: Performance assessment of human and robotic agents in an inclusion segmentation task

Increasing the level of autonomy in robot-assisted surgery has the potential to improve the safety, speed, and applicability of robot-assisted surgical systems. To facilitate the development and incorporation of robot autonomy in clinical settings, human-robot collaboration models have been suggested in which human and robotic agents work together to accomplish a task. In this work, we measure performance of several human-robot collaboration models in two experiments based on the task of segmenting a stiff inclusion in soft tissue, which simulates a tumor. In the inclusion segmentation experiment, twelve participants explored an artificial tissue and identified the inclusion boundary under the collaboration models of (1) teleoperation, (2) supervised control, (3) traded control, and (4) full autonomy. In the boundary identification experiment, we isolate the performance of human and robotic agents in the boundary identification sub-task; participants and a robotic agent independently identified the boundary of four virtually palpated tissues. Results from the inclusion segmentation experiment indicate that human agents complete the task faster; teleoperation had the fastest task times. Results of both experiments indicate that the robotic agent identifies boundaries with higher sensitivity and less variance than human agents. This indicates that task accuracy increases when a robotic agent segments the boundary, while including a human agent can decrease the overall task time.

[1]  Woong Youn Chung,et al.  Robot-assisted endoscopic surgery for thyroid cancer: experience with the first 100 patients , 2009, Surgical Endoscopy.

[2]  Allison M. Okamura,et al.  A Framework for Multilateral Manipulation in Surgical Tasks , 2016, IEEE Transactions on Automation Science and Engineering.

[3]  Jessie Y. Chen C.,et al.  Human-Agent Teaming for Multi-Robot Control:A Literature Review , 2013 .

[4]  K M Fram Laparoscopically assisted vaginal hysterectomy versus abdominal hysterectomy in stage I endometrial cancer , 2002, International journal of gynecological cancer : official journal of the International Gynecological Cancer Society.

[5]  Allison M. Okamura,et al.  Methods to Segment Hard Inclusions in Soft Tissue During Autonomous Robotic Palpation , 2015, IEEE Transactions on Robotics.

[6]  Darius Burschka,et al.  Automation of Manual Tasks for Minimally Invasive Surgery , 2008, Fourth International Conference on Autonomic and Autonomous Systems (ICAS'08).

[7]  Yeongjin Kim,et al.  Robotic system with sweeping palpation and needle biopsy for prostate cancer diagnosis , 2014, The international journal of medical robotics + computer assisted surgery : MRCAS.

[8]  Rajnikant V. Patel,et al.  Robot-assisted Tactile Sensing for Minimally Invasive Tumor Localization , 2009, Int. J. Robotics Res..

[9]  Kaspar Althoefer,et al.  A novel tumor localization method using haptic palpation based on soft tissue probing data , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Rasoul Khayati,et al.  Fully automated tumor segmentation based on improved fuzzy connectedness algorithm in brain MR images , 2011, Comput. Biol. Medicine.

[11]  A. D'Amico,et al.  Radical retropubic prostatectomy and robotic-assisted laparoscopic prostatectomy: likelihood of positive surgical margin(s). , 2010, Urology.

[12]  S. Lipsitz,et al.  Comparative effectiveness of minimally invasive vs open radical prostatectomy. , 2009, JAMA.

[13]  Tobias Ortmaier,et al.  An automated insertion tool for cochlear implants with integrated force sensing capability , 2014, International Journal of Computer Assisted Radiology and Surgery.

[14]  Allison M. Okamura,et al.  Models of human-centered automation in a debridement task , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  K. M. Deliparaschos,et al.  Evolution of autonomous and semi‐autonomous robotic surgical systems: a review of the literature , 2011, The international journal of medical robotics + computer assisted surgery : MRCAS.

[16]  Kaspar Althoefer,et al.  Rolling Mechanical Imaging for Tissue Abnormality Localization During Minimally Invasive Surgery , 2010, IEEE Transactions on Biomedical Engineering.

[17]  Aditi Jahagirdar,et al.  Automated Preliminary Brain Tumor Segmentation Using MRI Images , 2014 .

[18]  Pieter Abbeel,et al.  Autonomous multilateral debridement with the Raven surgical robot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[19]  G. Phillips,et al.  Minimally invasive comprehensive surgical staging for endometrial cancer: Robotics or laparoscopy? , 2009, Gynecologic oncology.