Evaluating Mental Load During Realistic Driving Simulations by Means of Round the Ear Electrodes

Film based round the ear electrodes (cEEGrids) provide both, the accessibility of unobtrusive mobile EEG as well as a rapid EEG application in stationary settings when extended measurements are not possible. In a large-scale evaluation of driving abilities of older adults (N > 350) in a realistic driving simulation, we evaluated to what extent mental demands can be measured using cEEGrids in a completely unrestricted environment. For a first frequency-based analysis, the driving scenario was subdivided into different street segments with respect to their task loads (low, medium, high) that was a priori rated by an expert. Theta activity increased with task load but no change in Alpha power was found. Effects gained clarity after removing pink noise effects, that were potentially high in this data set due to motion artifacts. Theta fraction increased with task load and Alpha fraction decreased. We mapped this effect to specific street segments by applying a track-frequency analysis. Whilst participants drove with constant speed and without high steering wheel activity, Alpha was high and theta low. The reverse was the case in sections that required either high activity or increased attentional allocation to the driving context. When calculating mental demands for different street segments based on EEG, this measure is highly significant correlated with the experts’ rating of task load. Deviances can be explained by specific features within the segments. Thus, modulations in spectral power of the EEG were validly reflected in the cEEGrids data. All findings were in line with the prominent literature in the field. The results clearly demonstrate the usability of this low-density EEG method for application in real-world settings where an increase in ecological validity might outweigh the loss of certain aspects of internal validity.

[1]  M. Falkenstein,et al.  Functional Changes and Driving Performance in Older Drivers: Assessment and Interventions , 2016, Geriatrics.

[2]  Ashley Craig,et al.  Development of an algorithm for an EEG-based driver fatigue countermeasure. , 2003, Journal of safety research.

[3]  Miriam Reiner,et al.  Real Time EEG Based Measurements of Cognitive Load Indicates Mental States During Learning , 2017, EDM 2017.

[4]  Roel Vertegaal,et al.  Using mental load for managing interruptions in physiologically attentive user interfaces , 2004, CHI EA '04.

[5]  David I. Donaldson,et al.  Understanding Minds in Real-World Environments: Toward a Mobile Cognition Approach , 2017, Front. Hum. Neurosci..

[6]  W. Surwillo,et al.  Frequency of the ‘Alpha’ Rhythm, Reaction Time and Age , 1961, Nature.

[7]  Lana M Trick,et al.  Driving in fog: the effects of driving experience and visibility on speed compensation and hazard avoidance. , 2012, Accident; analysis and prevention.

[8]  Stefan Debener,et al.  Machine‐learning‐derived sleep–wake staging from around‐the‐ear electroencephalogram outperforms manual scoring and actigraphy , 2018, Journal of sleep research.

[9]  Tzyy-Ping Jung,et al.  Preventing lapse in performance using a drowsiness monitoring and management system , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  S. Makeig,et al.  Lapses in alertness: coherence of fluctuations in performance and EEG spectrum. , 1993, Electroencephalography and clinical neurophysiology.

[11]  Stephan Getzmann,et al.  Proactive vs. reactive car driving: EEG evidence for different driving strategies of older drivers , 2018, PloS one.

[12]  R. Ogilvie,et al.  Behavioral, event-related potential, and EEG/FFT changes at sleep onset. , 1991, Psychophysiology.

[13]  Chris Berka,et al.  EEG quantification of alertness: methods for early identification of individuals most susceptible to sleep deprivation , 2005, SPIE Defense + Commercial Sensing.

[14]  W. David Hairston,et al.  Effects of Cable Sway, Electrode Surface Area, and Electrode Mass on Electroencephalography Signal Quality during Motion , 2018, Sensors.

[15]  Michelle N. Lumicao,et al.  EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks. , 2007, Aviation, space, and environmental medicine.

[16]  Stuart D Baulk,et al.  Awareness of sleepiness when driving. , 2004, Psychophysiology.

[17]  Sara Lal,et al.  Comparing combinations of EEG activity in train drivers during monotonous driving , 2011, Expert Syst. Appl..

[18]  Nukman Yusoff,et al.  Subjective responses of mental workload during real time driving: A pilot field study , 2017 .

[19]  E. Soetens,et al.  Psychophysiological investigation of vigilance decrement: Boredom or cognitive fatigue? , 2008, Physiology & Behavior.

[20]  Stefan Debener,et al.  Sleep EEG Derived From Behind-the-Ear Electrodes (cEEGrid) Compared to Standard Polysomnography: A Proof of Concept Study , 2018, Front. Hum. Neurosci..

[21]  A. Wirz-Justice,et al.  Power density in theta/alpha frequencies of the waking EEG progressively increases during sustained wakefulness. , 1995, Sleep.

[22]  Marina Schmid,et al.  An Introduction To The Event Related Potential Technique , 2016 .

[23]  Maarten A. S. Boksem,et al.  Absorbed in the task: Personality measures predict engagement during task performance as tracked by error negativity and asymmetrical frontal activity , 2010, Cognitive, affective & behavioral neuroscience.

[24]  Naveen Kumar,et al.  Measurement of Cognitive Load in HCI Systems Using EEG Power Spectrum: An Experimental Study , 2015, IHCI.

[25]  J. Cummings,et al.  The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment , 2005, Journal of the American Geriatrics Society.

[26]  Fuvro Yevloe,et al.  Frontal midline theta rhythm and eyeblinking activity during a VDT task and a video game : useful tools for psychophysiology in ergonomics , 2012 .

[27]  Fotis Foukalas,et al.  Wireless Communication Technologies for Safe Cooperative Cyber Physical Systems , 2018, Sensors.

[28]  Carryl L. Baldwin,et al.  Detecting and Quantifying Mind Wandering during Simulated Driving , 2017, Front. Hum. Neurosci..

[29]  Fabio Babiloni,et al.  EEG-Based Mental Workload Neurometric to Evaluate the Impact of Different Traffic and Road Conditions in Real Driving Settings , 2018, Front. Hum. Neurosci..

[30]  Stephan Getzmann,et al.  Driver state examination--Treading new paths. , 2016, Accident; analysis and prevention.

[31]  Tzyy-Ping Jung,et al.  Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  Chongxun Zheng,et al.  Electroencephalogram and electrocardiograph assessment of mental fatigue in a driving simulator. , 2012, Accident; analysis and prevention.

[33]  Gerhard Rinkenauer,et al.  The interconnection of mental fatigue and aging: An EEG study. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[34]  T. Jung,et al.  Changes in alertness are a principal component of variance in the EEG spectrum , 1995, Neuroreport.

[35]  Birger Kollmeier,et al.  Event-Related Potentials Measured From In and Around the Ear Electrodes Integrated in a Live Hearing Device for Monitoring Sound Perception , 2018, Trends in hearing.

[36]  A. Williamson Fatigue and coping with driver distraction , 2007 .

[37]  Daphne N. Yu,et al.  High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. , 1997, Cerebral cortex.

[38]  S. Debener,et al.  Unobtrusive ambulatory EEG using a smartphone and flexible printed electrodes around the ear , 2015, Scientific Reports.

[39]  E. Juratovac,et al.  Age-Related Changes , 2017 .

[40]  Natasha Merat,et al.  Effects of Cognitive Load on Driving Performance: The Cognitive Control Hypothesis , 2017, Hum. Factors.

[41]  Michael X Cohen A better way to define and describe Morlet wavelets for time-frequency analysis , 2018 .

[42]  H. Heuer,et al.  Frontal theta activity reflects distinct aspects of mental fatigue , 2014, Biological Psychology.

[43]  S. Hanslmayr,et al.  Oscillatory power decreases and long-term memory: the information via desynchronization hypothesis , 2012, Front. Hum. Neurosci..

[44]  Kathryn M. Godfrey,et al.  Age and cross-cultural comparison of drivers’ cognitive workload and performance in simulated urban driving , 2010 .

[45]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[46]  J. Horne,et al.  Vehicle accidents related to sleep: a review. , 1999, Occupational and environmental medicine.

[47]  Glenn F. Wilson,et al.  Eeg and Subjective Measures of Private Pilot Workload , 1994 .

[48]  Stefan Debener,et al.  Concealed Around-the-Ear EEG Captures Cognitive Processing in a Visual Simon Task , 2017, Front. Hum. Neurosci..

[49]  M. Falkenstein,et al.  Age-Related Changes of Neural Control Processes and Their Significance for Driving Performance , 2013 .

[50]  Arnaud Delorme,et al.  Frontal midline EEG dynamics during working memory , 2005, NeuroImage.

[51]  F. Yamada Frontal midline theta rhythm and eyeblinking activity during a VDT task and a video game: useful tools for psychophysiology in ergonomics. , 1998, Ergonomics.

[52]  Lana M Trick,et al.  The effects of visibility conditions, traffic density, and navigational challenge on speed compensation and driving performance in older adults. , 2010, Accident; analysis and prevention.

[53]  A. Pauzie,et al.  A method to assess the driver mental workload: The driving activity load index (DALI) , 2008 .

[54]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[55]  E C Andrews,et al.  Age differences in simulated driving performance: compensatory processes. , 2012, Accident; analysis and prevention.

[56]  Tzyy-Ping Jung,et al.  Real-time neuroimaging and cognitive monitoring using wearable dry EEG , 2015, IEEE Transactions on Biomedical Engineering.

[57]  A. Craig,et al.  Reproducibility of the spectral components of the electroencephalogram during driver fatigue. , 2005, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[58]  A. Craig,et al.  Driver fatigue: electroencephalography and psychological assessment. , 2002, Psychophysiology.

[59]  Ashley Martin,et al.  Speed choice and driving performance in simulated foggy conditions. , 2011, Accident; analysis and prevention.

[60]  Aubrey Lewis,et al.  SUBJECTIVE RESPONSES , 1961 .

[61]  J. Pineda The functional significance of mu rhythms: Translating “seeing” and “hearing” into “doing” , 2005, Brain Research Reviews.

[62]  Stefan Debener,et al.  Identifying auditory attention with ear-EEG: cEEGrid versus high-density cap-EEG comparison , 2016, Journal of neural engineering.

[63]  M. Chung,et al.  Electroencephalographic study of drowsiness in simulated driving with sleep deprivation , 2005 .

[64]  S. Debener,et al.  Concealed, Unobtrusive Ear-Centered EEG Acquisition: cEEGrids for Transparent EEG , 2017, Front. Hum. Neurosci..

[65]  Rosa H. M. Chan,et al.  An evaluation of mental workload with frontal EEG , 2017, PloS one.

[66]  Stefan Debener,et al.  Target Speaker Detection with Concealed EEG Around the Ear , 2016, Front. Neurosci..

[67]  E. Wascher,et al.  Age-Related Differences in Pro-active Driving Behavior Revealed by EEG Measures , 2018, Front. Hum. Neurosci..

[68]  Evangelos Bekiaris,et al.  Monitoring Driver's Sleepiness On-Board for Preventing Road Accidents , 2009, MIE.