Single trial prediction of normal and excessive cognitive load through EEG feature fusion

Detection of subtle changes in cognitive states (e.g., cognitive overload) or epistemic state of mind remains a challenge. As they typically lack visible expressions, indirect methods like analysis of facial expressions are ineffective at best. Towards solving such problem, we present a statistical approach to predict cognitive load from single trial electrophysiological recordings of brain activity (i.e., EEG). We evaluated the utility of two commonly used sets of features, namely, wavelet entropy and band-specific power (theta, alpha, and beta) to predict levels of cognitive load. We show that performance of the model (i.e., support vector machine) could be improved by feature fusion (such as wavelet entropy and spectral power features together) and also integrating nonlinear representations learned through deep belief networks. Our results demonstrate predictions of cognitive load across four different levels with an overall accuracy of 92% during execution of a memory task.

[1]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[2]  Mohammed Yeasin,et al.  Modulation of brain connectivity by memory load in a working memory network , 2014, 2014 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB).

[3]  Mohammed Yeasin,et al.  Spectrotemporal dynamics of the EEG during working memory encoding and maintenance predicts individual behavioral capacity , 2014, The European journal of neuroscience.

[4]  Kilseop Ryu,et al.  Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic , 2005 .

[5]  P. Bashivan,et al.  Neural correlates of visual working memory load through unsupervised spatial filtering of EEG , 2013 .

[6]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[7]  Angela R. Laird,et al.  Modelling neural correlates of working memory: A coordinate-based meta-analysis , 2012, NeuroImage.

[8]  R. Kass,et al.  Automatic correction of ocular artifacts in the EEG: a comparison of regression-based and component-based methods. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[9]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[10]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[11]  Carlos E. Thomaz,et al.  Evaluating SVM and MLDA in the extraction of discriminant regions for mental state prediction , 2009, NeuroImage.

[12]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[13]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[14]  E. Basar,et al.  Wavelet entropy: a new tool for analysis of short duration brain electrical signals , 2001, Journal of Neuroscience Methods.

[15]  M. Sigman,et al.  A big-world network in ASD: Dynamical connectivity analysis reflects a deficit in long-range connections and an excess of short-range connections , 2010, Neuropsychologia.

[16]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[17]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[18]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[19]  Peter Robinson,et al.  Real-Time Inference of Complex Mental States from Facial Expressions and Head Gestures , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[20]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[21]  J. Lisman,et al.  Oscillations in the alpha band (9-12 Hz) increase with memory load during retention in a short-term memory task. , 2002, Cerebral cortex.

[22]  O. Jensen,et al.  Frontal theta activity in humans increases with memory load in a working memory task , 2002, The European journal of neuroscience.

[23]  Michael E. Smith,et al.  Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods , 1998, Hum. Factors.

[24]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[25]  Nigel H. Lovell,et al.  Estimating cognitive workload using wavelet entropy-based features during an arithmetic task , 2013, Comput. Biol. Medicine.

[26]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[27]  Razvan Pascanu,et al.  Theano: new features and speed improvements , 2012, ArXiv.

[28]  E. Martin,et al.  Simultaneous EEG-fMRI during a Working Memory Task: Modulations in Low and High Frequency Bands , 2010, PloS one.

[29]  Pavlo D. Antonenko,et al.  Using Electroencephalography to Measure Cognitive Load , 2010 .