Modeling Workload Impact in Multiple Unmanned Vehicle Supervisory Control

Discrete-event simulations for futuristic unmanned vehicle (UV) systems enable a cost- and time-effective methodology for evaluating various autonomy and human-automation design parameters. Operator mental workload is an important factor to consider in such models. We suggest that the effects of operator workload on system performance can be modeled in such a simulation environment through a quantitative relation between operator attention and utilization, i.e., operator busy time used as a surrogate real-time workload measure. To validate our model, a heterogeneous UV simulation experiment was conducted with 74 participants. Performance-based measures of attention switching delays were incorporated in the discrete-event simulation model by UV wait times due to operator attention inefficiencies (WTAIs). Experimental results showed that WTAI is significantly associated with operator utilization (UT) such that high UT levels correspond to higher wait times. The inclusion of this empirical UT-WTAI relation in the discrete-event simulation model of multiple UV supervisory control resulted in more accurate replications of data, as well as more accurate predictions for alternative UV team structures. These results have implications for the design of future human-UV systems, as well as more general multiple task supervisory control models.

[1]  Yili Liu,et al.  Development of an Adaptive Workload Management System Using the Queueing Network-Model Human Processor (QN-MHP) , 2008, IEEE Transactions on Intelligent Transportation Systems.

[2]  Andrew Feickert.  Army's Future Combat System (FCS): Background and Issues for Congress [Updated March 5, 2008] , 2008 .

[3]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[4]  Jaime R. Carbonell,et al.  A Queueing Model of Visual Sampling Experimental Validation , 1968 .

[5]  D. Kahneman.  Attention and Effort , 1973 .

[6]  Yili Liu,et al.  Queuing Network Modeling of Driver Workload and Performance , 2006, IEEE Transactions on Intelligent Transportation Systems.

[7]  Michael Wooldridge,et al.  Introduction to multiagent systems , 2001 .

[8]  F. T. Eggemeier,et al.  Recommendations for Mental Workload Measurement in a Test and Evaluation Environment , 1993 .

[9]  Thomas B. Sheridan,et al.  On How Often the Supervisor Should Sample , 1970, IEEE Trans. Syst. Sci. Cybern..

[10]  Diana Schmidt.  A Queuing Analysis of the Air Traffic Controller''s Workload , 1978 .

[11]  K. Preston White,et al.  Systems engineering models of human-machine interaction , 1981, Proceedings of the IEEE.

[12]  David S Alberts,et al.  Network Centric Warfare: Developing and Leveraging Information Superiority , 1999 .

[13]  Mary L. Cummings,et al.  Predicting Controller Capacity in Supervisory Control of Multiple UAVs , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[14]  Raja Parasuraman,et al.  Decision theory analysis of response latencies in vigilance. , 1976, Journal of experimental psychology. Human perception and performance.

[15]  Yili Liu,et al.  Queueing network modeling of human performance of concurrent spatial and verbal tasks , 1994, IEEE Trans. Syst. Man Cybern. Part A.

[16]  Andrew Feickert.  The Army's Future Combat System (FCS): Background and Issues for Congress. CRS Report for Congress , 2005 .

[17]  Mary L. Cummings,et al.  Developing Operator Capacity Estimates for Supervisory Control of Autonomous Vehicles , 2007, Hum. Factors.

[18]  Jacob W. Crandall,et al.  The Impact of Heterogeneity on Operator Performance in Future Unmanned Vehicle Systems , 2008 .

[19]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[20]  John W. Senders,et al.  The Human Operator as a Monitor and Controller of Multidegree of Freedom Systems , 1964 .

[21]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[22]  Carl Nehme,et al.  Modeling human supervisory control in heterogeneous unmanned vehicle systems , 2009 .

[23]  Yoav Shoham,et al.  Multiagent Systems - Algorithmic, Game-Theoretic, and Logical Foundations , 2009 .

[24]  Dan R. Olsen,et al.  Metrics for Evaluating Human-Robot Interactions , 2003 .

[25]  C. Wickens.  Engineering psychology and human performance, 2nd ed. , 1992 .

[26]  Michael Pinedo,et al.  Scheduling: Theory, Algorithms, and Systems , 1994 .

[27]  John D. Lee,et al.  Trust in Automation: Designing for Appropriate Reliance , 2004 .

[28]  Jacob W. Crandall,et al.  Predicting Operator Capacity for Supervisory Control of Multiple UAVs , 2007, Innovations in Intelligent Machines.

[29]  Mary L. Cummings,et al.  Automation Architecture for Single Operator, Multiple UAV Command and Control, , 2007 .

[30]  Edward D. Lazowska,et al.  Quantitative system performance - computer system analysis using queueing network models , 1983, Int. CMG Conference.

[31]  D. Broadbent.  Perception and communication , 1958 .

[32]  Robert W. Proctor,et al.  Human factors in simple and complex systems , 1993 .

[33]  Jacob W. Crandall,et al.  Identifying Predictive Metrics for Supervisory Control of Multiple Robots , 2007, IEEE Transactions on Robotics.

[34]  Yili Liu,et al.  Queuing Network Modeling of a Real-Time Psychophysiological Index of Mental Workload—P300 in Event-Related Potential (ERP) , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[35]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[36]  Michael A. Goodrich,et al.  Validating human-robot interaction schemes in multitasking environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[37]  D. Hebb.  Drives and the C.N.S. (conceptual nervous system). , 1955, Psychological review.

[38]  R Parasuraman,et al.  Decision theory analysis of response latencies in vigilance. , 1976, Journal of experimental psychology. Human perception and performance.

[39]  Yili Liu,et al.  Queueing Network-Model Human Processor (QN-MHP): A computational architecture for multitask performance in human-machine systems , 2006, TCHI.

[40]  John M. Dolan,et al.  Scheduling to Minimize Downtime in Human-Multirobot Supervisory Control , 2006 .

[41]  A. Welford.  THE ‘PSYCHOLOGICAL REFRACTORY PERIOD’ AND THE TIMING OF HIGH‐SPEED PERFORMANCE—A REVIEW AND A THEORY , 1952 .