Compensatory motion scaling for time-delayed robotic surgery

Round trip signal latency, or time delay, is an unavoidable constraint that currently stands as a major barrier to safe and efficient remote telesurgery. While there have been significant technological advancements aimed at reducing the time delay, studies evaluating methods of mitigating the negative effects of time delay are needed. Herein, we explored instrument motion scaling as a method to improve performance in time-delayed robotic surgery. This was a robotic surgery user study using the da Vinci Research Kit system. A ring transfer task was performed under normal circumstances (no added time delay), and with 250 ms, 500 ms, and 750 ms delay. Robotic instrument motion scaling was modulated across a range of values (− 0.15, − 0.1, 0, + 0.1, + 0.15), with negative values indicating less instrument displacement for a given amount of operator movement. The primary outcomes were task completion time and total errors. Three-dimensional instrument movement was compared against different motion scales using dynamic time warping to demonstrate the effects of scaling. Performance declined with increasing time delay. Statistically significant increases in task time and number of errors were seen at 500 ms and 750 ms delay (p < 0.05). Total errors were positively correlated with task time on linear regression (R = 0.79, p < 0.001). Under 750 ms delay, negative instrument motion scaling improved error rates. Negative motion scaling trended toward improving task times toward those seen in non-delayed scenarios. Improvements in instrument path motion were seen with the implementation of negative motion scaling. Under time-delayed conditions, negative robotic instrument motion scaling yielded fewer surgical errors with slight improvement in task time. Motion scaling is a promising method of improving the safety and efficiency of time-delayed robotic surgery and warrants further investigation.

[1]  Louis B. Rosenberg,et al.  Virtual fixtures: Perceptual tools for telerobotic manipulation , 1993, Proceedings of IEEE Virtual Reality Annual International Symposium.

[2]  Lydia E. Kavraki,et al.  Treatment planning for a radiosurgical system with general kinematics , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[3]  Russell H. Taylor,et al.  A telerobotic assistant for laparoscopic surgery , 1995 .

[4]  P. Green,et al.  Telepresence surgery , 1995 .

[5]  John Kenneth Salisbury,et al.  The Black Falcon: a teleoperated surgical instrument for minimally invasive surgery , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[6]  Jacques Marescaux,et al.  Transatlantic robot-assisted telesurgery , 2001, Nature.

[7]  Robert D. Howe,et al.  Virtual Fixtures for Robotic Cardiac Surgery , 2001, MICCAI.

[8]  Volkmar Falk,et al.  Limitations for manual and telemanipulator-assisted motion tracking--implications for endoscopic beating-heart surgery. , 2003, The Annals of thoracic surgery.

[9]  R. Satava.  Robotic surgery: from past to future--a personal journey. , 2003, The Surgical clinics of North America.

[10]  Russell H. Taylor,et al.  Simple Biomanipulation Tasks with 'Steady Hand' Cooperative Manipulator , 2003, MICCAI.

[11]  Wei Tech Ang,et al.  Active tremor compensation in handheld instrument for microsurgery , 2004 .

[12]  T. Kim,et al.  The effect of delayed visual feedback on telerobotic surgery , 2005, Surgical Endoscopy And Other Interventional Techniques.

[13]  Ralph J Damiano,et al.  Optimizing motion scaling and magnification in robotic surgery. , 2004, Surgery.

[14]  Sunil M Prasad,et al.  Surgical robotics: impact of motion scaling on task performance. , 2004, Journal of the American College of Surgeons.

[15]  M. Anvari,et al.  Establishment of the World's First Telerobotic Remote Surgical Service: For Provision of Advanced Laparoscopic Surgery in a Rural Community , 2005, Annals of surgery.

[16]  Mehran Anvari,et al.  The impact of latency on surgical precision and task completion during robotic-assisted remote telepresence surgery , 2005, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[17]  Cameron N. Riviere,et al.  Robotic Compensation of Biological Motion to Enhance Surgical Accuracy , 2006, Proceedings of the IEEE.

[18]  Philip Chan,et al.  Toward accurate dynamic time warping in linear time and space , 2007, Intell. Data Anal..

[19]  M. Dufaut,et al.  Paradigms and experimental set-up for the determination of the acceptable delay in Telesurgery , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Russell H. Taylor,et al.  Telerobotic Control by Virtual Fixtures for Surgical Applications , 2007, Advances in Telerobotics.

[21]  Brett Harnett,et al.  Transcontinental telesurgical nephrectomy using the da Vinci robot in a porcine model. , 2008, Urology.

[22]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[23]  Blake Hannaford,et al.  Using Kinect TM and a Haptic Interface for Implementation of Real-Time Virtual Fixtures , 2011 .

[24]  Blake Hannaford,et al.  Using Kinect and a Haptic Interface for Implementation of Real-Time Virtual Fixture , 2011 .

[25]  Louis A. Lobes,et al.  Vision-Based Control of a Handheld Surgical Micromanipulator With Virtual Fixtures , 2013, IEEE Transactions on Robotics.

[26]  Peter Kazanzides,et al.  An open-source research kit for the da Vinci® Surgical System , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[27]  Jacques Felblinger,et al.  Determination of the latency effects on surgical performance and the acceptable latency levels in telesurgery using the dV-Trainer® simulator , 2014, Surgical Endoscopy.

[28]  Song Xu,et al.  Impact of delay on telesurgical performance: study on the robotic simulator dV-Trainer , 2016, International Journal of Computer Assisted Radiology and Surgery.

[29]  Wilfried Philips,et al.  Effect of video lag on laparoscopic surgery: correlation between performance and usability at low latencies , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[30]  Michael C. Yip,et al.  Robot Autonomy for Surgery , 2017, The Encyclopedia of Medical Robotics.

[31]  Andreas Holzinger,et al.  Legal, regulatory, and ethical frameworks for development of standards in artificial intelligence (AI) and autonomous robotic surgery , 2019, The international journal of medical robotics + computer assisted surgery : MRCAS.

[32]  Andreas Holzinger,et al.  Legal, regulatory and ethical frameworks or standards for AI and autonomous robotic surgery , 2019 .

[33]  Florian Richter,et al.  Motion Scaling Solutions for Improved Performance in High Delay Surgical Teleoperation , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[34]  Michael C. Yip,et al.  SuPer: A Surgical Perception Framework for Endoscopic Tissue Manipulation With Surgical Robotics , 2019, IEEE Robotics and Automation Letters.