Self-scaling Human-Agent Cooperation Concept for Joint Fighter-UCAV Operations

In this article, we describe human automation integration concepts that allow the guidance and the mission management of multiple UCAVs (Unmanned Combat Aerial Vehicles) from aboard a manned single-seat fighter aircraft. The conceptual basis of our approach is dual-mode cognitive automation. This concept uses two distinct modes of human-agent cooperation, a hierarchical relationship with agents working in delegation mode, and a heterarchical relationship with an agent working in assistance mode. For the hierarchical relationship we suggest three delegation modes (team-, intent-, and task-based). The agent in heterarchical relationship, i.e. the assistant system, adapts the operator-assistant system cooperation and the guidance of UCAVs according to the named delegation modes. The adaptation is shaped by the assessment of the operator’s mental state and external situation features. Thereby, we aim at balancing the operator’s activity and work demands. Future research at our institute will concentrate on developing a software prototype for human-in-the-loop experiments.

[1]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[2]  Axel Schulte,et al.  Task-based Guidance of Multiple UAV Using Cognitive Automation , 2011 .

[3]  Axel Schulte,et al.  Designing a Support System to Mitigate Pilot Error While Minimizing Out-of-the-Loop-Effects , 2016, HCI.

[4]  David B. Kaber,et al.  Out‐of‐the‐loop performance problems and the use of intermediate levels of automation for improved control system functioning and safety , 1997 .

[5]  Axel Schulte,et al.  Human-UAV Co-operation Based on Artificial Cognition , 2009, HCI.

[6]  Jeffrey M. Bradshaw,et al.  Dimensions of Adjustable Autonomy and Mixed-Initiative Interaction , 2003, Agents and Computational Autonomy.

[7]  Jeremy W. Baxter,et al.  Fly-by-agent: Controlling a pool of UAVs via a multi-agent system , 2008, Knowl. Based Syst..

[8]  Qiang Ji,et al.  Cross-subject workload classification with a hierarchical Bayes model , 2012, NeuroImage.

[9]  Nadine B. Sarter,et al.  Team Play with a Powerful and Independent Agent: Operational Experiences and Automation Surprises on the Airbus A-320 , 1997, Hum. Factors.

[10]  Raja Parasuraman,et al.  Adaptive Automation for Human-Robot Teaming in Future Command and Control Systems , 2007 .

[11]  Renwick E. Curry,et al.  Flight-deck automation: promises and problems , 1980 .

[12]  Axel Schulte,et al.  System-Ergonomic Design of Cognitive Automation: Dual-Mode Cognitive Design of Vehicle Guidance and Control Work Systems , 2010, Studies in Computational Intelligence.

[13]  Axel Schulte,et al.  Design Patterns for Human-Cognitive Agent Teaming , 2016, HCI.

[14]  Mica R. Endsley,et al.  The Out-of-the-Loop Performance Problem and Level of Control in Automation , 1995, Hum. Factors.

[15]  Jeffrey M. Bradshaw,et al.  Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity , 2004, IEEE Intell. Syst..

[16]  Axel Schulte,et al.  Human-System Interaction Analysis for Military Pilot Activity and Mental Workload Determination , 2015, 2015 IEEE International Conference on Systems, Man, and Cybernetics.

[17]  Raja Parasuraman,et al.  Adaptable and Adaptive Automation for Supervisory Control of Multiple Autonomous Vehicles , 2012 .

[18]  Vincenzo Lippiello,et al.  Mixed-Initiative Planning and Execution for Multiple Drones in Search and Rescue Missions , 2015, ICAPS.

[19]  Tjerk de Greef,et al.  Eye Movement as Indicators of Mental Workload to Trigger Adaptive Automation , 2009, HCI.

[20]  Glenn F. Wilson,et al.  Performance Enhancement in an Uninhabited Air Vehicle Task Using Psychophysiologically Determined Adaptive Aiding , 2007, Hum. Factors.

[21]  Axel Schulte,et al.  Management of multiple unmanned combat aerial vehicles from a single-seat fighter cockpit in manned-unmanned fighter missions , 2013 .

[22]  Axel Schulte,et al.  Self-explanation capability for cognitive agents on-board of UCAVs to improve cooperation in a manned-unmanned fighter team , 2013 .