Effects of Onset Latency and Robot Speed Delays on Mimicry-Control Teleoperation

In this paper, we study the effects of delays in a mimicry-control robot teleoperation interface which involves a user moving their arms to directly show the robot how to move and the robot follows in real time. Unlike prior work considering delays in other teleoperation systems, we consider delays due to robot slowness in addition to latency in the onset of movement commands. We present a human-subjects study that shows how different amounts and types of delays have different effects on task performance. We compare the movements under different delays to reveal the strategies that operators use to adapt to delay conditions and to explain performance differences. Our results show that users can quickly develop strategies to adapt to slowness delays but not onset latency delays. We discuss the implications of our results for the future development of methods designed to mitigate the effects of delays.

[1]  Bilge Mutlu,et al.  RelaxedIK: Real-time Synthesis of Accurate and Feasible Robot Arm Motion , 2018, Robotics: Science and Systems.

[2]  Eiichi Yoshida,et al.  On human motion imitation by humanoid robot , 2008, 2008 IEEE International Conference on Robotics and Automation.

[3]  A. Lanfranco,et al.  Robotic Surgery: A Current Perspective , 2004, Annals of surgery.

[4]  Christopher G. Atkeson,et al.  Adapting human motion for the control of a humanoid robot , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[5]  Richard P. Paul,et al.  Teleprogramming: Toward Delay-Invariant Remote Manipulation , 1992, Presence: Teleoperators & Virtual Environments.

[6]  Jean-Jacques E. Slotine,et al.  Telemanipulation with Time Delays , 2004, Int. J. Robotics Res..

[7]  Bilge Mutlu,et al.  A Motion Retargeting Method for Effective Mimicry-Based Teleoperation of Robot Arms , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[8]  Robert D. Howe,et al.  A Comparison of Delay and Bandwidth Limitations in Teleoperation , 1996 .

[9]  Matteo Rubagotti,et al.  Semi-Autonomous Robot Teleoperation With Obstacle Avoidance via Model Predictive Control , 2019, IEEE Robotics and Automation Letters.

[10]  Mehran Anvari,et al.  The impact of latency on surgical precision and task completion during robotic-assisted remote telepresence surgery , 2005, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[11]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[12]  Blake Hannaford,et al.  Quantitative performance assessment of surgical robot systems: telerobotic fls , 2008 .

[13]  Mark W. Spong,et al.  Bilateral teleoperation: An historical survey , 2006, Autom..

[14]  Bernd Henze,et al.  A wearable, ultralight interface for bimanual teleoperation of a compliant, whole-body-controlled humanoid robot , 2018 .

[15]  S. Ellis.  Pictorial communication in virtual and real environments , 1991 .

[16]  Hermann von Helmholtz,et al.  Treatise on Physiological Optics , 1962 .

[17]  Thomas B. Sheridan,et al.  Telerobotics , 1989, Autom..

[18]  Bilge Mutlu,et al.  Shared control–based bimanual robot manipulation , 2019, Science Robotics.

[19]  Yifei Zhang,et al.  Augmented Reality Predictive Displays to Help Mitigate the Effects of Delayed Telesurgery , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[20]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[21]  Nikolaos G. Tsagarakis,et al.  Bi-Manual Articulated Robot Teleoperation using an External RGB-D Range Sensor , 2018, 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[22]  Nathaniel I. Durlach,et al.  Telepresence, time delay and adaptation , 1991 .

[23]  Bilge Mutlu,et al.  Shared Dynamic Curves: A Shared-Control Telemanipulation Method for Motor Task Training , 2018, HRI.

[24]  Dongjun Lee,et al.  Passive Bilateral Teleoperation With Constant Time Delay , 2006, IEEE Transactions on Robotics.

[25]  Guy Hoffman,et al.  Evaluating Fluency in Human–Robot Collaboration , 2019, IEEE Transactions on Human-Machine Systems.

[26]  Won S. Kim,et al.  The phantom robot: predictive displays for teleoperation with time delay , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[27]  Thomas B. Sheridan,et al.  Remote Manipulative Control with Transmission Delay , 1963 .