Cognitive workload modulation through degraded visual stimuli: a single-trial EEG study

OBJECTIVE Our experiments explored the effect of visual stimuli degradation on cognitive workload. APPROACH We investigated the subjective assessment, event-related potentials (ERPs) as well as electroencephalogram (EEG) as measures of cognitive workload. MAIN RESULTS These experiments confirm that degradation of visual stimuli increases cognitive workload as assessed by subjective NASA task load index and confirmed by the observed P300 amplitude attenuation. Furthermore, the single-trial multi-level classification using features extracted from ERPs and EEG is found to be promising. Specifically, the adopted single-trial oscillatory EEG/ERP detection method achieved an average accuracy of 85% for discriminating 4 workload levels. Additionally, we found from the spatial patterns obtained from EEG signals that the frontal parts carry information that can be used for differentiating workload levels. SIGNIFICANCE Our results show that visual stimuli can modulate cognitive workload, and the modulation can be measured by the single trial EEG/ERP detection method.

[1]  Kilian G. Seeber.  Cognitive load in simultaneous interpreting: Existing theories — new models , 2011 .

[2]  Hasan Ayaz,et al.  Optical brain monitoring for operator training and mental workload assessment , 2012, NeuroImage.

[3]  G. Pfurtscheller,et al.  The BCI competition III: validating alternative approaches to actual BCI problems , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  J. C. Ballard.  Computerized assessment of sustained attention: a review of factors affecting vigilance performance. , 1996, Journal of clinical and experimental neuropsychology.

[5]  Darryl G. Humphrey,et al.  Assessment of mental workload with task-irrelevant auditory probes , 1995, Biological Psychology.

[6]  Jodi Forlizzi,et al.  Psycho-physiological measures for assessing cognitive load , 2010, UbiComp.

[7]  Christian Mühl,et al.  Review of the Use of Electroencephalography as an Evaluation Method for Human-Computer Interaction , 2013, PhyCS.

[8]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[9]  A. Gevins,et al.  Neurophysiological measures of working memory and individual differences in cognitive ability and cognitive style. , 2000, Cerebral cortex.

[10]  Ke Yu,et al.  The Analytic Bilinear Discrimination of Single-Trial EEG Signals in Rapid Image Triage , 2014, PloS one.

[11]  Mickaël Causse,et al.  Monitoring Cognitive and Emotional Processes Through Pupil and Cardiac Response During Dynamic Versus Logical Task , 2010, Applied psychophysiology and biofeedback.

[12]  Kenneth B. Campbell,et al.  Intelligence and the effects of perceptual processing demands, task difficulty and processing speed on P300, reaction time and movement time , 1998 .

[13]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[14]  Hasan Ayaz,et al.  Cognitive Workload Assessment of Air Traffic Controllers Using Optical Brain Imaging Sensors , 2010 .

[15]  D. R. Davies,et al.  The effects of music and task difficulty on performance at a visual vigilance task. , 1973, British journal of psychology.

[16]  M Congedo,et al.  Classification of movement intention by spatially filtered electromagnetic inverse solutions , 2006, Physics in medicine and biology.

[17]  U. Erdmann,et al.  Auditory probe sensitivity to mental workload changes - an event-related potential study. , 2001, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  Brendan Z. Allison,et al.  Workload assessment of computer gaming using a single-stimulus event-related potential paradigm , 2008, Biological Psychology.

[19]  Makoto Sato,et al.  Single-trial classification of vowel speech imagery using common spatial patterns , 2009, Neural Networks.

[20]  Nigel H. Lovell,et al.  Estimating cognitive workload using wavelet entropy-based features during an arithmetic task , 2013, Comput. Biol. Medicine.

[21]  Caspar M. Schwiedrzik,et al.  Stimulus Predictability Reduces Responses in Primary Visual Cortex , 2010, The Journal of Neuroscience.

[22]  Xiaoping Li,et al.  Common Spatio-Temporal Pattern for Single-Trial Detection of Event-Related Potential in Rapid Serial Visual Presentation Triage , 2011, IEEE Transactions on Biomedical Engineering.

[23]  John J. B. Allen,et al.  Frontal EEG asymmetry as a moderator and mediator of emotion , 2004, Biological Psychology.

[24]  K Yu,et al.  Bilinear common spatial pattern for single-trial ERP-based rapid serial visual presentation triage. , 2012, Journal of neural engineering.

[25]  B. Dosher,et al.  External noise distinguishes attention mechanisms , 1998, Vision Research.

[26]  W. De Clercq,et al.  Automatic Removal of Ocular Artifacts in the EEG without an EOG Reference Channel , 2006, Proceedings of the 7th Nordic Signal Processing Symposium - NORSIG 2006.

[27]  Carryl L. Baldwin,et al.  Adaptive training using an artificial neural network and EEG metrics for within- and cross-task workload classification , 2012, NeuroImage.

[28]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[29]  William J Tyler,et al.  A quantitative overview of biophysical forces impinging on neural function , 2013, Physical biology.

[30]  Scott Makeig,et al.  Estimation of task workload from EEG data: New and current tools and perspectives , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  E. Martin,et al.  Simultaneous EEG-fMRI during a Working Memory Task: Modulations in Low and High Frequency Bands , 2010, PloS one.

[32]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[33]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[34]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[35]  Wolfgang Rosenstiel,et al.  Using Cross-Task Classification for Classifying Workload Levels in Complex Learning Tasks , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[36]  Robert Oostenveld,et al.  Estimating workload using EEG spectral power and ERPs in the n-back task , 2012, Journal of neural engineering.

[37]  Klaus-Robert Müller,et al.  Combined Optimization of Spatial and Temporal Filters for Improving Brain-Computer Interfacing , 2006, IEEE Transactions on Biomedical Engineering.

[38]  Kilseop Ryu,et al.  Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic , 2005 .

[39]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[40]  Cuntai Guan,et al.  Filter Bank Common Spatial Pattern (FBCSP) in Brain-Computer Interface , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[41]  P. Blackwell,et al.  Effect of Differential Levels of Ambient Noise on Vigilance Performance , 1971, Perceptual and motor skills.

[42]  Guofa Shou,et al.  Frontal theta EEG dynamics in a real-world air traffic control task , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[43]  Indu P. Bodala,et al.  Cognitive workload estimation due to vague visual stimuli using saccadic eye movements , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[44]  J. Polich,et al.  Task difficulty, probability, and inter-stimulus interval as determinants of P300 from auditory stimuli. , 1987, Electroencephalography and clinical neurophysiology.