A Predictive Model for Human-Unmanned Vehicle Systems : Final Report

Advances in automation are making it possible for a single operator to control multiple unmanned vehicles (UVs). This capability is desirable in order to reduce the operational costs of human-UV systems (HUVS), extend human capabilities, and improve system effectiveness. However, the high complexity of these systems introduces many significant challenges to system designers. To help understand and overcome these challenges, high-fidelity computational models of the HUVS must be developed. These models should have two capabilities. First, they must be able to describe the behavior of the various entities in the team, including both the human operator and the UVs in the team. Second, these models must have the ability to predict how changes in the HUVS and its mission will alter the performance characteristics of the system. In this report, we describe our work toward developing such a model. Via user studies, we show that our model has the ability to describe the behavior of a HUVS consisting of a single human operator and multiple independent UVs with homogeneous capabilities. We also evaluate the model’s ability to predict how changes in the team size, the human-UV interface, the UV’s autonomy levels, and operator strategies affect the system’s performance.

[1]  Hiroshi Furukawa,et al.  A flexible delegation-type interface enhances system performance in human supervision of multiple robots: empirical studies with RoboFlag , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[2]  Mary L. Cummings,et al.  Operator scheduling strategies in supervisory control of multiple UAVs , 2007 .

[3]  Jacob W. Crandall,et al.  Predicting Operator Capacity for Supervisory Control of Multiple UAVs , 2007, Innovations in Intelligent Machines.

[4]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[5]  Michael Lewis,et al.  Human control for cooperating robot teams , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[6]  Michael A. Goodrich,et al.  Experiments in adjustable autonomy , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[7]  Michael A. Goodrich,et al.  Task Switching and Multi-Robot Teams , 2005 .

[8]  J. Veltman,et al.  Physiological workload reactions to increasing levels of task difficulty. , 1998, Ergonomics.

[9]  David B. Kaber,et al.  The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task , 2004 .

[10]  Reid G. Simmons,et al.  Coordinated Multiagent Teams and Sliding Autonomy for Large-Scale Assembly , 2006, Proceedings of the IEEE.

[11]  Randal W. Beard,et al.  Semi-autonomous human-UAV interfaces for fixed-wing mini-UAVs , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[12]  Dan R. Olsen,et al.  Fan-out: measuring human control of multiple robots , 2004, CHI.

[13]  John M. Dolan,et al.  Scheduling to Minimize Downtime in Human-Multirobot Supervisory Control , 2006 .

[14]  Dan R. Olsen,et al.  Metrics for Evaluating Human-Robot Interactions , 2003 .

[15]  J. Gregory Trafton,et al.  Human control of multiple unmanned vehicles: effects of interface type on execution and task switching times , 2006, HRI '06.

[16]  Hansjörg Neth,et al.  Juggling Multiple Tasks: A Rational Analysis of Multitasking in a Synthetic Task Environment , 2006 .

[17]  Jean Scholtz,et al.  Awareness in human-robot interactions , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[18]  Mary L. Cummings,et al.  Automation Bias in Intelligent Time Critical Decision Support Systems , 2004 .

[19]  Jayson L. Colebank,et al.  A Resurvey of Shift Work-Related Fatigue in MQ-1 Predator Unmanned Aircraft System Crewmembers , 2008 .

[20]  Jean Scholtz,et al.  Common metrics for human-robot interaction , 2006, HRI '06.

[21]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[22]  M. K. Tulga,et al.  A model for dynamic allocation of human attention among multiple tasks , 1978 .

[23]  Mica R. Endsley,et al.  Automation and situation awareness. , 1996 .

[24]  Heath A. Ruff,et al.  Human Interaction with Levels of Automation and Decision-Aid Fidelity in the Supervisory Control of Multiple Simulated Unmanned Air Vehicles , 2002, Presence: Teleoperators & Virtual Environments.

[25]  Stephanie Guerlain,et al.  An Interactive Decision Support Tool for Real-time In-flight Replanning of Autonomous Vehicles , 2004 .

[26]  Thomas B. Sheridan,et al.  Mitigation of human supervisory control wait times through automation strategies , 2005 .

[27]  M R Endsley,et al.  Level of automation effects on performance, situation awareness and workload in a dynamic control task. , 1999, Ergonomics.

[28]  Christopher D. Wickens,et al.  Unmanned Aerial Vehicle Flight Control: False Alarms versus Misses , 2004 .

[29]  Jeffrey D. Anderson,et al.  Managing autonomy in robot teams: Observations from four experiments , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[30]  Jacob W. Crandall,et al.  Identifying Predictive Metrics for Supervisory Control of Multiple Robots , 2007, IEEE Transactions on Robotics.

[31]  K. Preston White,et al.  Systems engineering models of human-machine interaction , 1981, Proceedings of the IEEE.

[32]  Mica R. Endsley,et al.  Design and Evaluation for Situation Awareness Enhancement , 1988 .

[33]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[34]  Hankins Tc,et al.  A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. , 1998, Aviation, space, and environmental medicine.

[35]  Christopher D. Wickens,et al.  Using Interference Models to Predict Performance in a Multiple-Task UAV Environment - 2 UAVs , 2003 .

[36]  Mary L. Cummings,et al.  Predicting Controller Capacity in Remote Supervision of Multiple Unmanned Vehicles , 2008 .

[37]  Laurel D. Riek,et al.  A decomposition of UAV-related situation awareness , 2006, HRI '06.

[38]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .