Driver Modeling for Teleoperation with Time Delay

Abstract The results from a user study on teleoperated steering tasks are used to create a driver model under different latency conditions. The 31-subject user study explored the effects of latency on teleoperated steering tasks using a simulated mobile robot receiving input commands from a teleoperator via a computer gamepad. Using fundamental concepts from automotive steering models, and examining the users' input commands to the simulated robot under different latency conditions, a model of a human teleoperator for steering tasks was developed, tuned and validated. The model is a PD controller with feedback based on the projected lateral displacement of the robot. The tuning of the model gains for different latency scenarios reflects the real-world control strategies that users must employ when adapting to system latency. Simulation results show that the control gains can be interpolated to predict teleoperator performance under latency scenarios that were not tested with users. An analysis of the closed-loop stability of the system confirms our empirical observation that the ratio of the controller gains Kd/Kp increases as the latency increases.

[1]  S. Ertugrul,et al.  Intelligent Modeling of Human Driver: A Survey , 2007, 2007 IEEE Intelligent Vehicles Symposium.

[2]  Jacques Droulez,et al.  Role of steering wheel feedback on driver performance: driving simulator and modeling analysis , 2007 .

[3]  Thomas B. Sheridan,et al.  Remote Manipulative Control with Transmission Delay , 1963 .

[4]  Patricia L. McDermott,et al.  An investigation of real world control of robotic assets under communication latency , 2006, HRI '06.

[5]  Kaleb McDowell,et al.  The Effects of Time Lag on Driving Performance and a Possible Mitigation , 2010, IEEE Transactions on Robotics.

[6]  Edwin Olson,et al.  LCM: Lightweight Communications and Marshalling , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Huei Peng,et al.  An adaptive lateral preview driver model , 2005 .

[8]  Ian Pitt,et al.  Beyond the Gamepad: HCI and Game Controller Design and Evaluation , 2015, Game User Experience Evaluation.

[9]  Craig R. Carignan,et al.  Effects of time delay on telerobotic control of neutral buoyancy vehicles , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[10]  Charles C. MacAdam,et al.  Understanding and Modeling the Human Driver , 2003 .

[11]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[12]  S. Salivahanan Control Systems Engineering , 2015 .

[13]  L. Brito Palma,et al.  Low order models for human controller - Mouse interface , 2012, 2012 IEEE 16th International Conference on Intelligent Engineering Systems (INES).

[14]  Steven Eric Vozar,et al.  A Framework for Improving the Speed and Performance of Teleoperated Mobile Manipulators. , 2013 .