Computing the Effects of Operator Attention Allocation in Human Control of Multiple Robots

In time-critical systems in which a human operator supervises multiple semiautomated tasks, failure of the operator to focus attention on high-priority tasks in a timely manner can lower the effectiveness of the system and potentially result in catastrophic consequences. These systems must integrate computer-based technologies that help the human operator place attention on the right tasks at the right times to be successful. One way to assist the operator in this process is to compute where the operator's attention should be focused and then use this computation to influence the operator's behavior. In this paper, we analyze the ability of a particular modeling method to make such computations for effective attention allocation in human-multiple-robot systems. Our results demonstrate that it is not sufficient to simply compute and dictate how operators should allocate their attention. Rather, in stochastic domains, where small changes in either the endogenous or exogenous environment can dramatically affect model fidelity, model predictions should guide rather than dictate operator attentional resources so that operators can effectively exercise their judgment and experience.

[1]  Emilio Frazzoli,et al.  On Efficient Cooperative Strategies between UAVs and Humans in a Dynamic Environment , 2008 .

[2]  Emilio Frazzoli,et al.  Human-in-the-loop vehicle routing policies for dynamic environments , 2008, 2008 47th IEEE Conference on Decision and Control.

[3]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[4]  Gary G. Koch,et al.  Categorical Data Analysis Using The SAS1 System , 1995 .

[5]  L. Bainbridge Ironies of Automation , 1982 .

[6]  H. D. Graham,et al.  ASSESSING THE IMPACT OF HAPTIC PERIPHERAL DISPLAYS FOR UAV OPERATORS , 2008 .

[7]  Mary L. Cummings,et al.  The Impact of Intelligent Aiding for Multiple Unmanned Aerial Vehicle Schedule Management , 2007 .

[8]  Birsen Donmez,et al.  Modeling Workload Impact in Multiple Unmanned Vehicle Supervisory Control , 2010, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[9]  James P Bliss,et al.  Alarm mistrust in automobiles: how collision alarm reliability affects driving. , 2003, Applied ergonomics.

[10]  Mary L. Cummings,et al.  Automation Bias in Intelligent Time Critical Decision Support Systems , 2004 .

[11]  H. Simon,et al.  The sciences of the artificial (3rd ed.) , 1996 .

[12]  Ravi S. Adapathya,et al.  Strategic Behavior, Workload, and Performance in Task Scheduling , 1991 .

[13]  M. K. Tulga,et al.  A model for dynamic allocation of human attention among multiple tasks , 1978 .

[14]  Mary L. Cummings,et al.  Predicting Controller Capacity in Supervisory Control of Multiple UAVs , 2008, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[15]  Joshua D. Hoffman,et al.  Collision warning design to mitigate driver distraction , 2004, CHI.

[16]  Marti A. Hearst Mixed-initiative interaction , 1999 .

[17]  Herbert A. Simon,et al.  The Sciences of the Artificial , 1970 .

[18]  Jacob W. Crandall,et al.  Predictive Model for Human-Unmanned Vehicle Systems , 2009, J. Aerosp. Comput. Inf. Commun..

[19]  David B. Kaber,et al.  The effects of level of automation and adaptive automation on human performance, situation awareness and workload in a dynamic control task , 2004 .

[20]  John M. Dolan,et al.  Scheduling for humans in multirobot supervisory control , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Joshua D. Hoffman,et al.  A Dynamic Programming Algorithm for Scheduling In-Vehicle Messages , 2008, IEEE Transactions on Intelligent Transportation Systems.

[22]  Martin WIELAND,et al.  SEISMIC EARLY WARNING SYSTEM FOR A NUCLEAR POWER PLANT , 2000 .

[23]  Milind Tambe,et al.  Adjustable Autonomy in the Context of Coordination , 2004 .

[24]  Jacob W. Crandall,et al.  Identifying Predictive Metrics for Supervisory Control of Multiple Robots , 2007, IEEE Transactions on Robotics.

[25]  W D Smith,et al.  Aircraft Alerting Systems Criteria Study. Volume 1. Collation and Analysis of Aircraft Alerting Systems Data , 1977 .

[26]  Thomas B. Sheridan,et al.  Human and Computer Control of Undersea Teleoperators , 1978 .

[27]  Milind Tambe,et al.  Safety in the Context of Coordination via Adjustable Autonomy , 2009, Safety and Security in Multiagent Systems.

[28]  John D. Lee,et al.  Trust, self-confidence, and operators' adaptation to automation , 1994, Int. J. Hum. Comput. Stud..

[29]  Mary L. Cummings,et al.  Automated Scheduling Decision Support for Supervisory Control of Multiple UAVs , 2006, J. Aerosp. Comput. Inf. Commun..

[30]  Curry Guinn,et al.  Mixed-initiative interaction , 1999 .

[31]  Hansjörg Neth,et al.  Juggling Multiple Tasks: A Rational Analysis of Multitasking in a Synthetic Task Environment , 2006 .

[32]  Heath A. Ruff,et al.  Human Interaction with Levels of Automation and Decision-Aid Fidelity in the Supervisory Control of Multiple Simulated Unmanned Air Vehicles , 2002, Presence: Teleoperators & Virtual Environments.

[33]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[34]  Birsen Donmez,et al.  Auditory Decision Aiding in Supervisory Control of Multiple Unmanned Aerial Vehicles , 2009, Hum. Factors.

[35]  P A Hancock,et al.  Alarm effectiveness in driver-centred collision-warning systems. , 1997, Ergonomics.

[36]  Mary L. Cummings,et al.  Predicting Controller Capacity in Remote Supervision of Multiple Unmanned Vehicles , 2008 .

[37]  John M. Dolan,et al.  Scheduling to Minimize Downtime in Human-Multirobot Supervisory Control , 2006 .