Establishing a Variable Automation Paradigm for UAV-Based Reconnaissance in Manned-Unmanned Teaming Missions

This work addresses the factor of degraded automation reliability of machine based aerial reconnaissance in a manned-unmanned teaming approach. An army transport helicopter is accompanied by three unmanned aerial vehicles for reconnaissance purposes, guided by the helicopters crew. Automated capabilities onboard the UAVs offer high automated, task-based guidance as well as manual operation. We designed and implemented an assistance system in our helicopter flight simulator, that supports the commander in gaining relevant reconnaissance information on flight routes for the helicopter to follow. Due to imperfection in automated reconnaissance performed by machine algorithms, we explicitly regarded the aspect of degrading reliability by utilizing the paradigm of “Levels of Automation”. The automation system produces reconnaissance results, thereby considering differing automation reliability. Several data representation modes were applied to display preprocessed results in the helicopters multi-function displays. We conducted an extensive human-in-the-loop campaign with army helicopter crews in full mission scenarios, in which system-triggered changes between the automation levels occurred and the cooperative human-machine relationship changed online. This paper presents questionnaire-gathered results of our investigation during mission execution, shedding light on human factors, user acceptance and system design aspects.

[1]  Axel Schulte,et al.  Model-based prediction of workload for adaptive associate systems , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[2]  Peter Stütz,et al.  Performance prediction and selection of aerial perception functions during UAV missions , 2017, 2017 IEEE Aerospace Conference.

[3]  M R Endsley,et al.  Level of automation effects on performance, situation awareness and workload in a dynamic control task. , 1999, Ergonomics.

[4]  Peter Stütz,et al.  Model-Driven Payload Sensor Operation Assistance for a Transport Helicopter Crew in Manned-Unmanned Teaming Missions: Assistance Realization, Modelling Experimental Evaluation of Mental Workload , 2017, HCI.

[5]  Axel Schulte,et al.  Concept, Design and Evaluation of Cognitive Task-based UAV Guidance , 2012 .

[6]  Peter Stütz,et al.  Model-Driven Sensor Operation Assistance for a Transport Helicopter Crew in Manned-Unmanned Teaming Missions: Selecting the Automation Level by Machine Decision-Making , 2017 .

[7]  Mica R. Endsley,et al.  The Application of Human Factors to the Development of Expert Systems for Advanced Cockpits , 1987 .

[8]  Joseph R. Keebler,et al.  Factors Affecting Performance of Human-Automation Teams , 2017 .

[9]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[10]  Thomas B. Sheridan,et al.  Adaptive Automation, Level of Automation, Allocation Authority, Supervisory Control, and Adaptive Control: Distinctions and Modes of Adaptation , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.