Cognitive Load During Multitasking Can Be Accurately Assessed Based on Single Channel Electroencephalography Using Graph Methods

Mental workload has been widely estimated based on electroencephalography (EEG) in the frequency domain. However, simple frequency features are not entirely accurate indicators of the cognitive load because surface EEG signals are weak, nonstationary and randomness. We hypothesize that graph methods, which analyse the relationship between each point and other points of the EEG signals, may provide a more precise identification of the mental load. To investigate this hypothesis, we aim to identify the optimum graph features from 14 channel EEG recordings (sampling rate = 128 Hz) in order to detect the high cognitive load related to multitasking. Three graph features: mean degree <inline-formula> <tex-math notation="LaTeX">$\overline {d}$ </tex-math></inline-formula>, clustering coefficient <inline-formula> <tex-math notation="LaTeX">$\overline {c}$ </tex-math></inline-formula>, and degree distribution <inline-formula> <tex-math notation="LaTeX">$p(k)$ </tex-math></inline-formula>, are extracted from 48 subjects EEG records. Each experimental subject conducts two tasks: without tasks and with a simultaneous capacity task, respectively. After the experiment is completed, the feeling of the subject with the cognitive load tags in three types: low load, medium load, and heavy load. The optimal features of these three levels of the subject sensation and two types of cognitive load in different tasks are selected on the basis of statistical analysis. Then all graph features are forwarded into a support vector machine (SVM) and a decision tree to conduct objective scoring classification and a three subjective rating classification, respectively. Based on the present results,channels O2, T8, FC6, F8, and AF4 are considered optimal for a more efficiently estimation of the cognitive load. <inline-formula> <tex-math notation="LaTeX">$\overline {c}$ </tex-math></inline-formula> associated with F8 and T8 during low cognitive load is significantly lower than those associated with high cognitive load (p < 0.001). Using three graph features, the accuracy of identifying two types of mental load is 89.6%. Current findings suggest that the mental workload associated with multi-tasks can be accurately assessed using the graph approaches to EEG data.

[1]  Yavuz Akbulut,et al.  Effect of multitasking, physical environment and electroencephalography use on cognitive load and retention , 2019, Comput. Hum. Behav..

[2]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[3]  Konstantinos N. Plataniotis,et al.  High Cognitive Load Assessment in Drivers Through Wireless Electroencephalography and the Validation of a Modified N-Back Task , 2019, IEEE Transactions on Human-Machine Systems.

[4]  Rosa H. M. Chan,et al.  An evaluation of mental workload with frontal EEG , 2017, PloS one.

[5]  Mark E. J. Newman,et al.  The Structure and Function of Complex Networks , 2003, SIAM Rev..

[6]  F. Paas,et al.  Cognitive Load Theory and Instructional Design: Recent Developments , 2003 .

[7]  Johan A. K. Suykens,et al.  Least squares support vector machine classifiers: a large scale algorithm , 1999 .

[8]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[9]  Zhongwan Yang,et al.  Feature Extraction and Simulation of EEG Signals During Exercise-Induced Fatigue , 2019, IEEE Access.

[10]  S. Ali Etemad,et al.  Dynamically adaptive simulation based on expertise and cognitive load , 2018, 2018 IEEE Games, Entertainment, Media Conference (GEM).

[11]  D. Leutner,et al.  Direct Measurement of Cognitive Load in Multimedia Learning , 2003 .

[12]  Iftikhar Ahmad,et al.  Beyond traditional approaches: a partial directed coherence with graph theory-based mental load assessment using EEG modality , 2020, Neural Computing and Applications.

[13]  Rongrong Fu,et al.  EEG characteristic analysis of coach bus drivers based on brain connectivity as revealed via a graph theoretical network , 2018, RSC advances.

[14]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[15]  Kyle A. Bernhardt,et al.  The effects of dynamic workload and experience on commercially available EEG cognitive state metrics in a high-fidelity air traffic control environment. , 2019, Applied ergonomics.

[16]  Narasimhan Sundararajan,et al.  Classification of Mental Tasks from Eeg Signals Using Extreme Learning Machine , 2006, Int. J. Neural Syst..

[17]  Mohammad Soleymani,et al.  Single Trial Classification of EEG and Peripheral Physiological Signals for Recognition of Emotions Induced by Music Videos , 2010, Brain Informatics.

[18]  Feng Liu,et al.  Age-related network topological difference based on the sleep ECG signal , 2018, Physiological measurement.

[19]  Mark Billinghurst,et al.  In AI We Trust: Investigating the Relationship between Biosignals, Trust and Cognitive Load in VR , 2019, VRST.

[20]  Brennan R. Payne,et al.  A Review of Psychophysiological Measures to Assess Cognitive States in Real-World Driving , 2019, Front. Hum. Neurosci..

[21]  Maria Bannert,et al.  Managing Cognitive Load--Recent Trends in Cognitive Load Theory. Commentary. , 2002 .

[22]  Shoushui Wei,et al.  Efficient sleep classification based on entropy features and a support vector machine classifier , 2018, Physiological measurement.

[23]  A. Hani,et al.  Mental stress assessment using simultaneous measurement of EEG and fNIRS. , 2016, Biomedical optics express.

[24]  Yan Li,et al.  Analysis and Classification of Sleep Stages Based on Difference Visibility Graphs From a Single-Channel EEG Signal , 2014, IEEE Journal of Biomedical and Health Informatics.

[25]  Michael Bliemel,et al.  Psychophysiological Measures of Cognitive Absorption and Cognitive Load in E-Learning Applications , 2016, ICIS.

[26]  Yan Li,et al.  Analysis of alcoholic EEG signals based on horizontal visibility graph entropy , 2014, Brain Informatics.

[27]  Yuguo Yu,et al.  Enhanced functional connectivity properties of human brains during in-situ nature experience , 2016, PeerJ.

[28]  Anastasios Bezerianos,et al.  Driving Fatigue Recognition With Functional Connectivity Based on Phase Synchronization , 2020, IEEE Transactions on Cognitive and Developmental Systems.

[29]  W. Marsden I and J , 2012 .

[30]  O. Sourina,et al.  STEW: Simultaneous Task EEG Workload Data Set , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  Chengyu Liu,et al.  Comparison of different threshold values r for approximate entropy: application to investigate the heart rate variability between heart failure and healthy control groups , 2011, Physiological measurement.

[32]  U. Rajendra Acharya,et al.  Application of Non-Linear and Wavelet Based Features for the Automated Identification of Epileptic EEG signals , 2012, Int. J. Neural Syst..

[33]  Wei Zhang,et al.  Cognitive Load Recognition Using Multi-channel Complex Network Method , 2017, ISNN.

[34]  Oren Shriki,et al.  EEG-Based Prediction of Cognitive Load in Intelligence Tests , 2019, bioRxiv.

[35]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..