Exploring Novel Methodology for Classifying Cognitive Workload

This paper describes our work in extracting useful cognitive load classification information from a relatively simple and non-invasive physiological measurement technique, with application in a range of Human Factors and Human-Computer Interaction contexts. We employ novel methodologies, including signal processing, machine learning and genetic algorithms, to classify Galvanic Skin Response/Electrodermal Activity (GSR/EDA) signals during performance of a customised game task (UAV Defender) in high- and low-workload conditions. Our results reveal that Support Vector Machine Linear was the most successful technique for classifying the level of cognitive load that an operator is undergoing during easy, medium, and difficult operation conditions. This methodology has the advantage of applicability in critical task situations, where other cognitive load measurement methodologies are problematic due to sampling delay (e.g. questionnaires), or difficulty of implementation (e.g. other psych-physiological measures). A proposed cognitive load classification pipeline for real-time implementation and its use in human factors contexts is discussed.

[1]  Ki H. Chon,et al.  Frequency-domain electrodermal activity index of sympathetic function , 2016, 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI).

[2]  P. Welch The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[3]  Jennifer Healey,et al.  SmartCar: detecting driver stress , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Fang Chen,et al.  Galvanic skin response (GSR) as an index of cognitive load , 2007, CHI Extended Abstracts.

[5]  Lana M Trick,et al.  Multiple-object tracking while driving: the multiple-vehicle tracking task , 2014, Attention, perception & psychophysics.

[6]  Harun Uguz,et al.  A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm , 2011, Knowl. Based Syst..

[7]  Andreas Dünser,et al.  The Use of Depth in Change Detection and Multiple Object Tracking , 2009 .

[8]  C. Rennie,et al.  Decomposing skin conductance into tonic and phasic components. , 1997, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  Martin Lochner,et al.  Analysis of maritime team workload and communication dynamics in standard and emergency scenarios , 2018 .

[10]  Andreas Dunser,et al.  Combining EEG with Pupillometry to Improve Cognitive Workload Detection , 2015, Computer.

[11]  G F Wilson,et al.  Evoked potential, cardiac, blink, and respiration measures of pilot workload in air-to-ground missions. , 1994, Aviation, space, and environmental medicine.

[12]  B. Cain A Review of the Mental Workload Literature , 2007 .

[13]  Yang Wang,et al.  Measurable Decision Making with GSR and Pupillary Analysis for Intelligent User Interface , 2015, ACM Trans. Comput. Hum. Interact..

[14]  Yang Wang,et al.  GSR and Blink Features for Cognitive Load Classification , 2013, INTERACT.

[15]  Andreas Dünser,et al.  Detecting Intention Through Motor-Imagery-Triggered Pupil Dilations , 2019, Hum. Comput. Interact..

[16]  Z W Pylyshyn,et al.  Tracking multiple independent targets: evidence for a parallel tracking mechanism. , 1988, Spatial vision.

[17]  Shumin Zhai Editorial: TOCHI turns twenty , 2014, TCHI.

[18]  B. Hjorth EEG analysis based on time domain properties. , 1970, Electroencephalography and clinical neurophysiology.

[19]  Hasan Ayaz,et al.  Cognitive Workload Assessment of Air Traffic Controllers Using Optical Brain Imaging Sensors , 2010 .

[20]  Rebecca Brown,et al.  Evaluation of Subjective and EEG-Based Measures of Mental Workload , 2013, HCI.

[21]  Gavin C. Cawley,et al.  On Over-fitting in Model Selection and Subsequent Selection Bias in Performance Evaluation , 2010, J. Mach. Learn. Res..

[22]  Huosheng Hu,et al.  The Usefulness of Mean and Median Frequencies in Electromyography Analysis , 2012 .