Sensing and Assessing Cognitive Workload Across Multiple Tasks

Workload assessment models are an important tool to develop an understanding of an individual's limitations. Finding times of excess workload can help prevent an individual from continuing work that may result in human performance issues, such as an increase in errors or reaction time. Currently workload assessments are created on a task by task basis, varying drastically depending on sensors and task goals. Developing independent models for specific tasks is time consuming and not practical when being applied to real-world situations. In this experiment we collected physiological signals including electroencephalogram EEG, Heart Rate and Heart Rate Variability HR/HRV and Eye-Tracking. Subjects were asked to perform two independent tasks performed at two distinct levels of difficulty, an easy level and a difficult level. We then developed and compared performance of multiple models using deep and shallow learning techniques to determine the best methods to increase generalization of the models across tasks.

[1]  Gerald Matthews,et al.  Use of EEG Workload Indices for Diagnostic Monitoring of Vigilance Decrement , 2014, Hum. Factors.

[2]  Carina Benigna Walter,et al.  EEG workload prediction in a closed-loop learning environment , 2015 .

[3]  Masatoshi Okutomi,et al.  A Novel Inference of a Restricted Boltzmann Machine , 2014, 2014 22nd International Conference on Pattern Recognition.

[4]  Venkatram Vishwanath,et al.  SKOPE: a framework for modeling and exploring workload behavior , 2014, Conf. Computing Frontiers.

[5]  Hasan Ayaz,et al.  Neural Adaptation to a Working Memory Task: A Concurrent EEG-fNIRS Study , 2015, HCI.

[6]  Indu P. Bodala,et al.  Eye tracking and EEG synchronization to analyze microsaccades during a workload task , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  H. Jasper Report of the committee on methods of clinical examination in electroencephalography , 1958 .

[8]  Hasan Ayaz,et al.  Optical brain monitoring for operator training and mental workload assessment , 2012, NeuroImage.

[9]  David E. Kieras,et al.  Computational Modeling of Human Multiple-Task Performance , 2005 .

[10]  Robert Oostenveld,et al.  Estimating workload using EEG spectral power and ERPs in the n-back task , 2012, Journal of neural engineering.

[11]  M. Just,et al.  Neuroindices of cognitive workload: Neuroimaging, pupillometric and event-related potential studies of brain work , 2003 .

[12]  M. Stella Atkins,et al.  Workload assessment of surgeons: correlation between NASA TLX and blinks , 2012, Surgical Endoscopy.

[13]  Jacques Hugo,et al.  The Use of Computational Human Performance Modeling as Task Analysis Tool , 2012 .

[14]  Xin Zhao,et al.  An EEG-based mental workload estimator trained on working memory task can work well under simulated multi-attribute task , 2014, Front. Hum. Neurosci..

[15]  Brian A. Coffman,et al.  Transcranial Direct Current Stimulation Modulates Neuronal Activity and Learning in Pilot Training , 2016, Front. Hum. Neurosci..