Mental Workload Assessment for UAV Traffic Control Using Consumer-Grade BCI Equipment

The increasing popularity of unmanned aerial vehicles (UAVs) in critical applications makes supervisory systems based on the presence of human in the control loop of crucial importance. In UAV-traffic monitoring scenarios, where human operators are responsible for managing drones, systems flexibly supporting different levels of autonomy are needed to assist them when critical conditions occur. The assessment of UAV controllers’ performance thus their mental workload may be used to discriminate the level and type of automation required. The aim of this paper is to build a mental-workload prediction model based on UAV operators’ cognitive demand to support the design of an adjustable autonomy supervisory system. A classification and validation procedure was performed to both categorize the cognitive workload measured by ElectroEncephaloGram signals and evaluate the obtained patterns from the point of view of accuracy. Then, a user study was carried out to identify critical workload conditions by evaluating operators’ performance in accomplishing the assigned tasks. Results obtained in this study provided precious indications for guiding next developments in the field.

[1]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[2]  Abdel-Illah Mouaddib,et al.  Humans-Robots Sliding Collaboration Control in Complex Environments with Adjustable Autonomy , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[3]  Olga Sourina,et al.  EEG-based mental workload recognition related to multitasking , 2015, 2015 10th International Conference on Information, Communications and Signal Processing (ICICS).

[4]  Trevor Hastie,et al.  An Introduction to Statistical Learning , 2013, Springer Texts in Statistics.

[5]  Raja Parasuraman,et al.  18. Delegation Interfaces for Human Supervision of Multiple Unmanned Vehicles: Theory, Experiments, and Practical Applications , 2006 .

[6]  Seyed Kamaledin Setarehdan,et al.  Quantifying mental workload of operators performing n-back working memory task: Toward fNIRS based passive BCI system , 2016, 2016 23rd Iranian Conference on Biomedical Engineering and 2016 1st International Iranian Conference on Biomedical Engineering (ICBME).

[7]  Michael A. Goodrich,et al.  Human-Robot Interaction: A Survey , 2008, Found. Trends Hum. Comput. Interact..

[8]  Mel Siegel,et al.  Perceived mental workload and operator performance of dexterous manipulators under time delay with master-slave interfaces , 2015, 2015 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA).

[9]  Glenn F. Wilson,et al.  Operator Functional State Classification during a Simulated ATC Task Using EEG , 1997 .

[10]  Wolfgang Rosenstiel,et al.  Using Cross-Task Classification for Classifying Workload Levels in Complex Learning Tasks , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[11]  Peerapon Vateekul,et al.  Online music emotion prediction on multiple sessions of EEG data using SVM , 2016, 2016 13th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[12]  Christopher D. Wickens,et al.  Workload Demands of Remotely Piloted Vehicle Supervision and Control: (1) Single Vehicle Performance , 2002 .

[13]  R Parasuraman,et al.  Effects of automation and task load on task switching during human supervision of multiple semi-autonomous robots in a dynamic environment , 2010, Ergonomics.

[14]  Jacek Gwizdka,et al.  Using Wireless EEG Signals to Assess Memory Workload in the $n$-Back Task , 2016, IEEE Transactions on Human-Machine Systems.

[15]  Milind Tambe,et al.  Multiagent Adjustable Autonomy Framework (MAAF) for multi-robot, multi-human teams , 2008, 2008 International Symposium on Collaborative Technologies and Systems.

[16]  J. Martinerie,et al.  Prediction of performance level during a cognitive task from ongoing EEG oscillatory activities , 2008, Clinical Neurophysiology.

[17]  B. Cain.  A Review of the Mental Workload Literature , 2007 .

[18]  Sergio Montenegro,et al.  Obstacle Detection and Collision Avoidance Using Ultrasonic Distance Sensors for an Autonomous Quadrocopter , 2012 .

[19]  Takahiro Hayashi,et al.  Utilization of NASA-TLX for Workload Evaluation of Gaze-Writing Systems , 2014, 2014 IEEE International Symposium on Multimedia.

[20]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[21]  Jie Wang,et al.  Study on relation between operator and trainee's mental workload for ship maneuvering simulator exercise using heart rate variability , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[22]  Jose L. Contreras-Vidal,et al.  Simultaneous scalp electroencephalography (EEG), electromyography (EMG), and whole-body segmental inertial recording for multi-modal neural decoding. , 2013, Journal of visualized experiments : JoVE.

[23]  Frederik W. Heger,et al.  Sliding Autonomy for Complex Coordinated Multi-Robot Tasks: Analysis & Experiments , 2006, Robotics: Science and Systems.

[24]  Andrew Kopeikin,et al.  Flight Testing a Heterogeneous Multi-UAV System with Human Supervision , 2012 .

[25]  Li-Wei Ko,et al.  Review of Wireless and Wearable Electroencephalogram Systems and Brain-Computer Interfaces – A Mini-Review , 2009, Gerontology.