Effects of automation and task load on task switching during human supervision of multiple semi-autonomous robots in a dynamic environment

The present study assessed the impact of task load and level of automation (LOA) on task switching in participants supervising a team of four or eight semi-autonomous robots in a simulated ‘capture the flag’ game. Participants were faster to perform the same task than when they chose to switch between different task actions. They also took longer to switch between different tasks when supervising the robots at a high compared to a low LOA. Task load, as manipulated by the number of robots to be supervised, did not influence switch costs. The results suggest that the design of future unmanned vehicle (UV) systems should take into account not simply how many UVs an operator can supervise, but also the impact of LOA and task operations on task switching during supervision of multiple UVs. The findings of this study are relevant for the ergonomics practice of UV systems. This research extends the cognitive theory of task switching to inform the design of UV systems and results show that switching between UVs is an important factor to consider.

[1]  Catherine M Arrington,et al.  Voluntary task switching: chasing the elusive homunculus. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[2]  Ulrich Mayr,et al.  On How to Be Unpredictable , 2006, Psychological science.

[3]  Jessie Y. C. Chen,et al.  Human Performance Issues and User Interface Design for Teleoperated Robots , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  Hiroshi Furukawa,et al.  A flexible delegation-type interface enhances system performance in human supervision of multiple robots: empirical studies with RoboFlag , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Raja Parasuraman,et al.  Designing for Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control , 2007, Hum. Factors.

[6]  R. D'Andrea,et al.  The RoboFlag testbed , 2003, Proceedings of the 2003 American Control Conference, 2003..

[7]  G. Logan.  Executive control of thought and action , 1985 .

[8]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[9]  Robin R. Murphy,et al.  Human-robot interactions during the robot-assisted urban search and rescue response at the World Trade Center , 2003, IEEE Trans. Syst. Man Cybern. Part B.

[10]  G. D. Logan.  Task Switching , 2022 .

[11]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[12]  Michael A. Goodrich,et al.  Validating human-robot interaction schemes in multitasking environments , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[13]  A. Jersild.  Mental set and shift , 2011 .

[14]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[15]  Provocation: Is the UAV Control Ratio the Right Question? , 2007 .

[16]  F. Hawkins.  Human factors in aviation. , 1979, Journal of psychosomatic research.

[17]  D. Meyer,et al.  Executive control of cognitive processes in task switching. , 2001, Journal of experimental psychology. Human perception and performance.

[18]  Michael A. Goodrich,et al.  Task Switching and Multi-Robot Teams , 2005 .

[19]  Jessie Y.C. Chen,et al.  Effects of imperfect automation and individual differences on concurrent performance of military and robotics tasks in a simulated multitasking environment , 2009, Ergonomics.

[20]  Nancy J. Cooke.  Human Factors of Remotely Operated Vehicles , 2006 .

[21]  Mary L. Cummings,et al.  Developing Operator Capacity Estimates for Supervisory Control of Autonomous Vehicles , 2007, Hum. Factors.

[22]  Karel Brookhuis,et al.  Human Factors in Design Safety and Management , 2005 .

[23]  Raja Parasuraman,et al.  Adaptive Automation for Human-Robot Teaming in Future Command and Control Systems , 2007 .

[24]  Raja Parasuraman,et al.  Consequences of shifting one level of automation to another: main effects and their stability , 2005 .

[25]  Earl L. Wiener.  13 – Cockpit Automation , 1988 .

[26]  Raja Parasuraman,et al.  Adaptive Automation for Human Supervision of Multiple Uninhabited Vehicles: Effects on Change Detection, Situation Awareness, and Mental Workload , 2009 .

[27]  Richard W. Pew,et al.  Human-system integration in the system development process : a new look , 2007 .

[28]  Christopher D. Wickens,et al.  An introduction to human factors engineering , 1997 .

[29]  Timothy W. McLain,et al.  Cooperative forest fire surveillance using a team of small unmanned air vehicles , 2006, Int. J. Syst. Sci..

[30]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[31]  Catherine M Arrington,et al.  The Cost of a Voluntary Task Switch , 2004, Psychological science.

[32]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..