Management of multiple unmanned combat aerial vehicles from a single-seat fighter cockpit in manned-unmanned fighter missions

This article describes a concept for a single-seat fighter cockpit based system, simultaneously managing up to three unmanned combat aerial vehicles (UCAV) during mission execution. The concept is primarily based on the theory of cooperative and cognitive automation, developed at the Institute of Flight Systems at the University of the Bundeswehr Munich (UBM). Its main component is a modular assistant system, which consists of one artificial cognitive unit (ACU) per UCAV, a self-explanation capability module (SECM) and a team coordination module (TCM). The ACUs grant the unmanned team members capabilities for cooperative and rational behavior in the mission context. In order to support the manned-unmanned collaboration the assistant system is equipped with a SECM and TCM. The SECM explains the observable behavior of the unmanned platforms to the human pilot. It also aims at increasing the pilot’s trust in the unmanned systems. The TCM is responsible for all aspects of team coordination, especially between manned and unmanned tasks. The presented concept is implemented in a highly realistic mission simulation environment including a generic fighter simulator, equipped with conventional avionic systems. The article concludes with first experimental results obtained in a test campaign in collaboration with the German Air Force.

[1]  Axel Schulte,et al.  System-Ergonomic Design of Cognitive Automation: Dual-Mode Cognitive Design of Vehicle Guidance and Control Work Systems , 2010, Studies in Computational Intelligence.

[2]  Axel Schulte,et al.  Human factors in the guidance of uninhabited vehicles: oxymoron or tautology? , 2009, Cognition, Technology & Work.

[3]  Reiner Onken,et al.  COSA – A generic cognitive system architecture based on a cognitive model of human behavior , 2003, Cognition, Technology & Work.

[4]  Christopher D. Wickens,et al.  Unmanned Aerial Vehicle Flight Control: False Alarms versus Misses , 2004 .

[5]  Herbert H. Clark,et al.  Grounding in communication , 1991, Perspectives on socially shared cognition.

[6]  Gareth R. Jones,et al.  The experience and evolution of trust: Implications for cooperation and teamwork , 1998 .

[7]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[8]  Johann H. Schlichter,et al.  Computer-Supported Cooperative Work: Introduction to Distributed Applications , 2010 .

[9]  Charles E. Billings,et al.  Aviation Automation: The Search for A Human-centered Approach , 1996 .

[10]  Jeremy W. Baxter,et al.  Fly-by-agent: Controlling a pool of UAVs via a multi-agent system , 2008, Knowl. Based Syst..

[11]  E. Salas,et al.  Toward an understanding of team performance and training. , 1992 .

[12]  Richard A. Guzzo,et al.  Teams in organizations: recent research on performance and effectiveness. , 1996, Annual review of psychology.

[13]  Axel Schulte,et al.  Task-based Guidance of Multiple UAV Using Cognitive Automation , 2011 .

[14]  Jeremy W. Baxter,et al.  Controlling teams of uninhabited air vehicles , 2005, AAMAS '05.

[15]  Nicholas R. Jennings,et al.  Coordination techniques for distributed artificial intelligence , 1996 .

[16]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[17]  Kevin Crowston,et al.  The interdisciplinary study of coordination , 1994, CSUR.

[18]  Axel Schulte,et al.  Self-explanation capability for cognitive agents on-board of UCAVs to improve cooperation in a manned-unmanned fighter team , 2013 .

[19]  David Woods,et al.  1. How to make automated systems team players , 2002 .

[20]  Axel Schulte,et al.  Single-Seat Cockpit-Based Management of Multiple UCAVs Using On-Board Cognitive Agents for Coordination in Manned-Unmanned Fighter Missions , 2013, HCI.

[21]  Mica R. Endsley,et al.  Situation awareness global assessment technique (SAGAT) , 1988, Proceedings of the IEEE 1988 National Aerospace and Electronics Conference.

[22]  Mica R. Endsley,et al.  Toward a Theory of Situation Awareness in Dynamic Systems , 1995, Hum. Factors.

[23]  Kevin W Williams,et al.  A Summary of Unmanned Aircraft Accident/Incident Data: Human Factors Implications , 2004 .

[24]  Paul J. Feltovich,et al.  Common Ground and Coordination in Joint Activity , 2005 .