A UAS mission assistant system employing a theory-of-mind about the human operator

An overly high degree of complex automation can lead to human error in a human-machine-system. By means of a cognitive assistant system the operator of an Unmanned Aerial System (UAS) control station shall be supported in a way that reduces human error. The assistant system monitors the operator's behavior and the progress of the UAS mission. Using knowledge based on models of the operator and the mission, the assistant system can infer if problems arise and if the operator reacts appropriately. If he or she fails to do so, the assistant system intervenes adaptively to the operator's cognitive state. Early experiments confirm a significant reduction of human error.

[1]  I. Apperly.  Mindreaders: The Cognitive Basis of "Theory of Mind" , 2010 .

[2]  Axel Schulte,et al.  Cognitive Automation based Guidance and Operator Assistance for semi-autonomous Mission Accomplishment of the UAV Demonstrator SAGITTA , 2013 .

[3]  Axel Schulte,et al.  Mental models as common ground for human-agent interaction in cognitive assistant systems , 2014 .

[4]  Axel Schulte,et al.  Task-based Guidance of Multiple UAV Using Cognitive Automation , 2011 .

[5]  Axel Schulte,et al.  UAV Capability Management using Agent Supervisory Control , 2013 .

[6]  Axel Schulte,et al.  Intent-Based UAV Mission Management Using an Adaptive Mixed-Initiative Operator Assistant System , 2013 .

[7]  David Harris,et al.  A human‐centred design agenda for the development of single crew operated commercial aircraft , 2007 .

[8]  Jens Rasmussen,et al.  Information Processing and Human-Machine Interaction: An Approach to Cognitive Engineering , 1986 .

[9]  Axel Schulte,et al.  System-Ergonomic Design of Cognitive Automation: Dual-Mode Cognitive Design of Vehicle Guidance and Control Work Systems , 2010, Studies in Computational Intelligence.

[10]  Axel Schulte,et al.  Managing Cockpit Crew Excess Task Load in Military Manned-Unmanned Teaming Missions by Dual-Mode Cognitive Automation Approaches , 2011 .

[11]  Axel Schulte,et al.  Concept, Design and Evaluation of Cognitive Task-based UAV Guidance , 2012 .

[12]  L. Bainbridge.  Ironies of Automation , 1982 .

[13]  Erik Hollnagel,et al.  Joint Cognitive Systems: Patterns in Cognitive Systems Engineering , 2006 .

[14]  D. Woods,et al.  Automation Surprises , 2001 .

[15]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[16]  Reiner Onken,et al.  Modelling of Pilot Behaviour Using Petri Nets , 1994, Application and Theory of Petri Nets.

[17]  Lars Michael Kristensen,et al.  Coloured Petri Nets - Modelling and Validation of Concurrent Systems , 2009 .

[18]  Thomas B. Sheridan,et al.  The System Perspective on Human Factors in Aviation , 2010 .

[19]  Axel Schulte,et al.  Enhancing Military Helicopter Pilot Assistant System Through Resource Adaptive Dialogue Management , 2013 .

[20]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[21]  Joel Lachter,et al.  Task Allocation for Single Pilot Operations: A Role for the Ground , 2012 .