Investigation of Multiple Resource Theory Design Principles on Robot Teleoperation and Workload Management

Robot interfaces often only use the visual channel. Inspired by Wickens’ Multiple Resource Theory, we investigated if the addition of audio elements would reduce cognitive workload and improve performance. Specifically, we designed a search and threat-defusal task (primary) with a memory test task (secondary). Eleven participants – predominantly first responders – were recruited to control a robot to clear all threats in a combination of four conditions of primary and secondary tasks in visual and auditory channels. While we did not find any statistically significant differences in performance or workload across subjects, making it questionable that Multiple Resource Theory could shorten longer-term task completion time and reduce workload. Our results suggest that considering individual differences for splitting interface modalities across multiple channels requires further investigation.

[1]  Linda R. Elliott,et al.  Managing workload in human-robot interaction: A review of empirical studies , 2010, Comput. Hum. Behav..

[2]  Verena Nitsch,et al.  Using multisensory cues for direction information in teleoperation: More is not always better , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[3]  Geert-Jan M. Kruijff,et al.  Multi-view operator control unit to improve situation awareness in USAR missions , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[4]  R. Pagano.  Understanding Statistics in the Behavioral Sciences , 1981 .

[5]  Jean Scholtz,et al.  Beyond Usability Evaluation: Analysis of Human-Robot Interaction at a Major Robotics Competition , 2004, Hum. Comput. Interact..

[6]  Christopher D. Wickens,et al.  Mission Control of Multiple Unmanned Aerial Vehicles: A Workload Analysis , 2005, Hum. Factors.

[7]  Holly A. Yanco,et al.  Rescuing interfaces: A multi-year study of human-robot interaction at the AAAI Robot Rescue Competition , 2007, Auton. Robots.

[8]  Katherine M. Tsui,et al.  Design and validation of two-handed multi-touch tabletop controllers for robot teleoperation , 2011, IUI '11.

[9]  Jürgen Roßmann,et al.  Robotic teleoperation: Mediated and supported by virtual testbeds , 2017, 2017 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR).

[10]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[11]  Adam Norton,et al.  Physical and Cognitive Load Effects Due to a Powered Lower-Body Exoskeleton , 2020, Hum. Factors.

[12]  David B. Kaber,et al.  Investigation of multi-modal interface features for adaptive automation of a human-robot system , 2006, Int. J. Hum. Comput. Stud..

[13]  Céline McKeown,et al.  Designing for Situation Awareness: An Approach to User-Centered Design , 2013 .

[14]  Florian Jentsch,et al.  Designing Effective Soldier-Robot Teams in Complex Environments: Training, Interfaces, and Individual Differences , 2011, HCI.

[15]  Jessie Y. C. Chen,et al.  Individual Differences in Human-Robot Interaction in a Military Multitasking Environment , 2011 .

[16]  Holly A. Yanco,et al.  Modeling trust to improve human-robot interaction , 2012 .

[17]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[18]  Dennis J. Folds,et al.  Auditory Monitoring of up to Eight Simultaneous Sources , 1994 .

[19]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[20]  Holly A. Yanco,et al.  Improving Human-Robot Interaction through Interface Evolution , 2010 .

[21]  Linda R. Elliott,et al.  Effects of Visual, Auditory, and Tactile Cues on Army Platoon Leader Decision Making , 2005 .

[22]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .