Single feature spatio-temporal architecture for EEG Based cognitive load assessment

The study of electroencephalography (EEG) data for cognitive load analysis plays an important role in identification of stress-inducing tasks. This can be useful in applications such as optimal work allocation, increasing efficiency in the workplace and ensuring safety in difficult work environments. In order for such systems to be realistically deployable, easy acquisition and processing of the data on a wearable device is imperative. Current techniques primarily perform offline processing to analyse a multi-channel EEG to make a post facto assessment. This work focusses on building a new deep learning architecture that performs a single feature based spatio-temporal analysis of EEG data. This is achieved by creating a brain topographic map based on a single feature followed by spatio-temporal analysis using the developed network architecture. Data from two cognitive load experiments on the Physionet EEGMAT dataset were used to validate the performance. The network achieves an accuracy of 98.3% which is better than similar state-of-the-art approaches. Moreover, the proposed approach facilitates analysis of the spatial propagation of a signal, which is not possible through conventional EEG signal representations.

[1]  Yongtian He,et al.  Deep learning for electroencephalogram (EEG) classification tasks: a review , 2019, Journal of neural engineering.

[2]  Martin Luessi,et al.  MEG and EEG data analysis with MNE-Python , 2013, Front. Neuroinform..

[3]  Anton Popov,et al.  Electroencephalograms during Mental Arithmetic Task Performance , 2019, Data.

[4]  Yijun Wang,et al.  Predicting Intended Movement Direction Using EEG from Human Posterior Parietal Cortex , 2009, HCI.

[5]  Akshaya Ramaswamy,et al.  Spatio-temporal action detection and localization using a hierarchical LSTM , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Guangyuan Liu,et al.  Pattern Recognition of Cognitive Load Using EEG and ECG Signals , 2020, Sensors.

[7]  Andrew Zisserman,et al.  Quo Vadis, Action Recognition? A New Model and the Kinetics Dataset , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Pavlo D. Antonenko,et al.  Using Electroencephalography to Measure Cognitive Load , 2010 .

[9]  Junfeng Chen,et al.  Learning Spatial–Spectral–Temporal EEG Features With Recurrent 3D Convolutional Neural Networks for Cross-Task Mental Workload Assessment , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Boreom Lee,et al.  EEG microstate features according to performance on a mental arithmetic task , 2021, Scientific reports.

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Mohammed Yeasin,et al.  Learning Representations from EEG with Deep Recurrent-Convolutional Neural Networks , 2015, ICLR.

[13]  J. García-Madariaga,et al.  Revealing Unconscious Consumer Reactions to Advertisements That Include Visual Metaphors. A Neurophysiological Experiment , 2020, Frontiers in psychology.

[14]  S. K R,et al.  SMORASO-DT : A hybrid machine learning classification model to classify individuals based on working memory load in mental arithmetic task , 2020, medRxiv.

[15]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[16]  J. Richman,et al.  Physiological time-series analysis using approximate entropy and sample entropy. , 2000, American journal of physiology. Heart and circulatory physiology.

[17]  A K Pradhan,et al.  The view from the road: the contribution of on-road glance-monitoring technologies to understanding driver behavior. , 2013, Accident; analysis and prevention.

[18]  Binish Fatimah,et al.  Automatic detection of mental arithmetic task and its difficulty level using EEG signals , 2020, 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT).