Cognitive Load Assessment from EEG and Peripheral Biosignals for the Design of Visually Impaired Mobility Aids

Reliable detection of cognitive load would benefit the design of intelligent assistive navigation aids for the visually impaired (VIP). Ten participants with various degrees of sight loss navigated in unfamiliar indoor and outdoor environments, while their electroencephalogram (EEG) and electrodermal activity (EDA) signals were being recorded. In this study, the cognitive load of the tasks was assessed in real time based on a modification of the well-established event-related (de)synchronization (ERD/ERS) index. We present an in-depth analysis of the environments that mostly challenge people from certain categories of sight loss and we present an automatic classification of the perceived difficulty in each time instance, inferred from their biosignals. Given the limited size of our sample, our findings suggest that there are significant differences across the environments for the various categories of sight loss. Moreover, we exploit cross-modal relations predicting the cognitive load in real time inferring on features extracted from the EDA. Such possibility paves the way for the design on less invasive, wearable assistive devices that take into consideration the well-being of the VIP.

[1]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[2]  W. Ray,et al.  EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. , 1985, Science.

[3]  Ramiro Velazquez,et al.  Wearable Assistive Devices for the Blind , 2016, ArXiv.

[4]  Brianna Scott,et al.  Navigational spatial displays: The role of metacognition as cognitive load * , 2007 .

[5]  Loren Terveen,et al.  Speech and Non-Speech Audio: Navigational Information and Cognitive Load , 2007 .

[6]  Anthony J. Ries,et al.  Usability of four commercially-oriented EEG systems , 2014, Journal of neural engineering.

[7]  D. Bates,et al.  Fitting Linear Mixed-Effects Models Using lme4 , 2014, 1406.5823.

[8]  Rosalind W. Picard,et al.  Empatica E3 — A wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition , 2014, 2014 4th International Conference on Wireless Mobile Communication and Healthcare - Transforming Healthcare Through Innovations in Mobile and Wireless Technologies (MOBIHEALTH).

[9]  Sanford Weisberg,et al.  An R Companion to Applied Regression , 2010 .

[10]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[11]  Nikolaos G. Bourbakis,et al.  Wearable Obstacle Avoidance Electronic Travel Aids for Blind: A Survey , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[12]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[13]  Gordon E. Legge,et al.  Blind Navigation and the Role of Technology , 2008 .

[14]  R Quian Quiroga,et al.  Searching for hidden information with Gabor Transform in generalized tonic-clonic seizures. , 1997, Electroencephalography and clinical neurophysiology.

[15]  Tauhid Zaman,et al.  Predicting Performance Under Stressful Conditions Using Galvanic Skin Response , 2016, ArXiv.

[16]  S. Debener,et al.  How about taking a low-cost, small, and wireless EEG for a walk? , 2012, Psychophysiology.

[17]  Simone Spagnol,et al.  MODEL-BASED OBSTACLE SONIFICATION FOR THE NAVIGATION OF VISUALLY IMPAIRED PERSONS , 2016 .

[18]  Xin Liu,et al.  PyEEG: An Open Source Python Module for EEG/MEG Feature Extraction , 2011, Comput. Intell. Neurosci..

[19]  Richard E. Mayer,et al.  The effects of graphic organizers giving cues to the structure of a hypertext document on users' navigation strategies and performance , 2002, Int. J. Hum. Comput. Stud..

[20]  Gerhard Tröster,et al.  Discriminating Stress From Cognitive Load Using a Wearable EDA Device , 2010, IEEE Transactions on Information Technology in Biomedicine.

[21]  Yolaine Bourda,et al.  Electronic Locomotion Aids for the Blind: Towards More Assistive Systems , 2006, Intelligent Paradigms for Assistive and Preventive Healthcare.

[22]  J. Cacioppo,et al.  Inferring psychological significance from physiological signals. , 1990, The American psychologist.

[23]  Pavlo D. Antonenko,et al.  Using Electroencephalography to Measure Cognitive Load , 2010 .

[24]  Xiao-Li Yang,et al.  Designing a personal guidance system to aid navigation without sight: progress on the GIS component , 1991, Int. J. Geogr. Inf. Sci..

[25]  Kyriaki Kalimeri,et al.  Identifying Urban Mobility Challenges for the Visually Impaired with Mobile Monitoring of Multimodal Biosignals , 2016, HCI.

[26]  Kyriaki Kalimeri,et al.  Exploring multimodal biosignal features for stress detection during indoor mobility , 2016, ICMI.

[27]  Matthias M. Müller,et al.  Human Gamma Band Activity and Perception of a Gestalt , 1999, The Journal of Neuroscience.

[28]  Fang Chen,et al.  Galvanic skin response (GSR) as an index of cognitive load , 2007, CHI Extended Abstracts.

[29]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[30]  G. Pfurtscheller,et al.  Event-related cortical desynchronization detected by power measurements of scalp EEG. , 1977, Electroencephalography and clinical neurophysiology.

[31]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[32]  M. Benedek,et al.  A continuous measure of phasic electrodermal activity , 2010, Journal of Neuroscience Methods.

[33]  G. McArthur,et al.  Validation of the Emotiv EPOC® EEG gaming system for measuring research quality auditory ERPs , 2013, PeerJ.

[34]  W. Boucsein Electrodermal activity, 2nd ed. , 2012 .

[35]  J. Lagopoulos Electrodermal activity , 2007, Acta Neuropsychiatrica.

[36]  Russell V. Lenth,et al.  Least-Squares Means: The R Package lsmeans , 2016 .

[37]  Ignacio Alvarez,et al.  Evaluating the ergonomics of BCI devices for research and experimentation , 2012, Ergonomics.