Using Temporal Sensitivity to Predict Performance Under Latency in Teleoperation

Objective This article establishes a relationship between temporal sensitivity and task performance under one-way latency between input and response. Background As the latency between human input and telerobot response increases, performance (e.g., speed to complete task and accuracy) declines. Tools, such as predictive displays, have been developed to ameliorate performance costs. However, more work is needed to understand the relationship between individual differences and task performance. Temporal sensitivity in particular was the focus of this research. Method Participants completed two tasks. In the time estimation task, participants estimated the duration of a series of visual stimuli. In the second task, participants drove a remote-controlled (RC) car through a track. On each trial, there was a latency between the participant’s input into the controller and the response by the RC car, with latencies ranging from 400 to 1,000 milliseconds between trials. Completion time and the number of errors made were recorded. Results Temporal sensitivity predicted the total number of errors made during a trial but was not found to be a predictor of completion time. It was however predictive of error rate (i.e., errors per minute), suggesting a possible speed/accuracy trade-off. Conclusion This was an initial step in establishing a link between temporal sensitivity and performance with latency. Application The study has applications toward training teleoperators who may experience latency, such as astronauts and surgeons.

[1]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[2]  Thomas B. Sheridan,et al.  Space teleoperation through time delay: review and prognosis , 1993, IEEE Trans. Robotics Autom..

[3]  S. Grondin Timing and time perception: A review of recent behavioral and neuroscience findings and theoretical directions , 2010, Attention, perception & psychophysics.

[4]  C. Douglas Creelman,et al.  Human Discrimination of Auditory Duration , 1962 .

[5]  Steven R. Oleson,et al.  HERRO Missions to Mars and Venus using Telerobotic Surface Exploration from Orbit , 2011 .

[6]  Mahdi Tavakoli,et al.  Generalized Predictive Control of a Surgical Robot for Beating-Heart Surgery Under Delayed and Slowly-Sampled Ultrasound Image Data , 2016, IEEE Robotics and Automation Letters.

[7]  Jonathan W. Peirce,et al.  PsychoPy—Psychophysics software in Python , 2007, Journal of Neuroscience Methods.

[8]  S. W. Brown,et al.  Multiple timing and the allocation of attention. , 1990, Acta psychologica.

[9]  G. Ballantyne Robotic surgery, telerobotic surgery, telepresence, and telementoring , 2002, Surgical Endoscopy And Other Interventional Techniques.

[10]  R. Litan,et al.  Douglas J , 2006 .

[11]  Thomas B. Sheridan,et al.  Remote Manipulative Control with Transmission Delay , 1963 .

[12]  Steven E. Butner,et al.  Transforming a surgical robot for human telesurgery , 2003, IEEE Trans. Robotics Autom..

[13]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[14]  L E Marks,et al.  Cross-modality matching functions generated by magnitude estimation , 1980, Perception & psychophysics.

[15]  W Schiff,et al.  Information Used in Judging Impending Collision , 1979, Perception.

[16]  Paul C. Johnson Extension of Nakagawa & Schielzeth's R2GLMM to random slopes models , 2014, Methods in ecology and evolution.

[17]  I. Scott MacKenzie,et al.  Lag as a determinant of human performance in interactive systems , 1993, INTERCHI.

[18]  Dan F. Lester,et al.  Human space exploration and human spaceflight: Latency and the cognitive scale of the universe , 2011 .

[19]  Craig R. Carignan,et al.  Effects of time delay on telerobotic control of neutral buoyancy vehicles , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[20]  Shinichi Nakagawa,et al.  A general and simple method for obtaining R2 from generalized linear mixed‐effects models , 2013 .

[21]  Blake Hannaford,et al.  Teleoperation in surgical robotics – network latency effects on surgical performance , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Vipul R. Patel,et al.  History of robotic surgery , 2010, Journal of robotic surgery.

[23]  J. Marescaux,et al.  Transcontinental Robot-Assisted Remote Telesurgery: Feasibility and Potential Applications , 2002, Annals of surgery.