GSR and Blink Features for Cognitive Load Classification

A system capable of monitoring its user’s mental workload can evaluate the suitability of its interface and interactions for user’s current cognitive status and properly change them when necessary. Galvanic skin response (GSR) and eye blinks are cognitive load measures which can be captured conveniently and at low cost. The present study has assessed multiple features of these two signals in classification of cognitive workload level. The experiment included arithmetic tasks with four difficulty levels and two types of machine learning algorithms have been applied for classification. Obtained results show that the studied features of blink and GSR can reasonably discriminate workload levels and combining features of the two modalities improves the accuracy of cognitive load classification. We have achieved around 75% for binary classification and more than 50% for four-class classification.

[1]  M. Holland,et al.  Blinking and Mental Load , 1972, Psychological reports.

[2]  J. Stern,et al.  Eye movements and blinks: their relationship to higher cognitive processes. , 1989, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[3]  F. Paas.  Training strategies for attaining transfer of problem-solving skill in statistics: A cognitive-load approach. , 1992 .

[4]  F. Paas,et al.  Variability of Worked Examples and Transfer of Geometrical Problem-Solving Skills: A Cognitive-Load Approach , 1994 .

[5]  F. Paas,et al.  Instructional control of cognitive load in the training of complex cognitive tasks , 1994 .

[6]  P. Chandler,et al.  Cognitive Load While Learning to Use a Computer Program , 1996 .

[7]  A. Bentivoglio,et al.  Analysis of blink rate patterns in normal subjects , 1997, Movement disorders : official journal of the Movement Disorder Society.

[8]  Nicu Sebe,et al.  Emotion recognition using a Cauchy Naive Bayes classifier , 2002, Object recognition supported by user interaction for service robots.

[9]  David L Neumann,et al.  Attentional blink reflex modulation in a continuous performance task is modality specific. , 2004, Psychophysiology.

[10]  H. Prendinger,et al.  Emotion Recognition from Electromyography and Skin Conductance , 2005 .

[11]  Martha E. Crosby,et al.  Assessing Cognitive Load with Physiological Sensors , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[12]  Guillaume Chanel,et al.  Emotion Assessment: Arousal Evaluation Using EEG's and Peripheral Physiological Signals , 2006, MRCS.

[13]  A. Murat Tekalp,et al.  Multimedia Content Representation, Classification and Security, International Workshop, MRCS 2006, Istanbul, Turkey, September 11-13, 2006, Proceedings , 2006, MRCS.

[14]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[15]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[16]  Fang Chen,et al.  Galvanic skin response (GSR) as an index of cognitive load , 2007, CHI Extended Abstracts.

[17]  Fang Chen,et al.  Using pen input features as indices of cognitive load , 2007, ICMI '07.

[18]  Léon J. M. Rothkrantz,et al.  Emotion recognition using brain activity , 2008, CompSysTech.

[19]  Imad H. Elhajj,et al.  Multi level SVM for subject independent agitation detection , 2009, 2009 IEEE/ASME International Conference on Advanced Intelligent Mechatronics.

[20]  Anton Nijholt,et al.  Stress and Cognitive Load in Multimodal Conversational Interactions , 2009, INTERACT 2009.

[21]  Mervyn V. M. Yeo,et al.  Can SVM be used for automatic EEG detection of drowsiness during car driving , 2009 .

[22]  Jodi Forlizzi,et al.  Psycho-physiological measures for assessing cognitive load , 2010, UbiComp.

[23]  Gerhard Tröster,et al.  Discriminating Stress From Cognitive Load Using a Wearable EDA Device , 2010, IEEE Transactions on Information Technology in Biomedicine.

[24]  Fang Chen,et al.  Pupillary Response Based Cognitive Workload Measurement under Luminance Changes , 2011, INTERACT.

[25]  Yang Wang,et al.  Measuring Cognitive Workload with Low-Cost Electroencephalograph , 2011, INTERACT.

[26]  Siyuan Chen,et al.  Eye activity as a measure of human mental effort in HCI , 2011, IUI '11.

[27]  Marco Winckler,et al.  Human-Computer Interaction - INTERACT 2011 - 13th IFIP TC 13 International Conference, Lisbon, Portugal, September 5-9, 2011, Proceedings, Part III , 2011, INTERACT.

[28]  Eero Väyrynen,et al.  Effect of cognitive load on speech prosody in aviation: Evidence from military simulator flights. , 2011, Applied ergonomics.

[29]  Yang Wang,et al.  Using galvanic skin response for cognitive load measurement in arithmetic and reading tasks , 2012, OZCHI.

[30]  Yang Wang,et al.  Indexing cognitive workload based on pupillary response under luminance and emotional changes , 2013, IUI '13.