Can arousing feedback rectify lapses in driving? Prediction from EEG power spectra

Objective. This study explores the neurophysiological changes, measured using an electroencephalogram (EEG), in response to an arousing warning signal delivered to drowsy drivers, and predicts the efficacy of the feedback based on changes in the EEG. Approach. Eleven healthy subjects participated in sustained-attention driving experiments. The driving task required participants to maintain their cruising position and compensate for randomly induced lane deviations using the steering wheel, while their EEG and driving performance were continuously monitored. The arousing warning signal was delivered to participants who experienced momentary behavioral lapses, failing to respond rapidly to lane-departure events (specifically the reaction time exceeded three times the alert reaction time). Main results. The results of our previous studies revealed that arousing feedback immediately reversed deteriorating driving performance, which was accompanied by concurrent EEG theta- and alpha-power suppression in the bilateral occipital areas. This study further proposes a feedback efficacy assessment system to accurately estimate the efficacy of arousing warning signals delivered to drowsy participants by monitoring the changes in their EEG power spectra immediately thereafter. The classification accuracy was up 77.8% for determining the need for triggering additional warning signals. Significance. The findings of this study, in conjunction with previous studies on EEG correlates of behavioral lapses, might lead to a practical closed-loop system to predict, monitor and rectify behavioral lapses of human operators in attention-critical settings.

[1]  William J Tyler,et al.  A quantitative overview of biophysical forces impinging on neural function , 2013, Physical biology.

[2]  Ivan Ho Mien,et al.  Heart rate variability can be used to estimate sleepiness-related decrements in psychomotor vigilance during total sleep deprivation. , 2012, Sleep.

[3]  Chris Berka,et al.  Drowsiness/alertness algorithm development and validation using synchronized EEG and cognitive performance to individualize a generalized model , 2011, Biological Psychology.

[4]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[5]  Min Zhao,et al.  Multivariate autoregressive models and kernel learning algorithms for classifying driving mental fatigue based on electroencephalographic , 2011, Expert Syst. Appl..

[6]  P. R. Davidson,et al.  Detection of lapses in responsiveness from the EEG , 2011, Journal of neural engineering.

[7]  Sara Lal,et al.  Comparing combinations of EEG activity in train drivers during monotonous driving , 2011, Expert Syst. Appl..

[8]  Gamini Dissanayake,et al.  Driver Drowsiness Classification Using Fuzzy Wavelet-Packet-Based Feature-Extraction Algorithm , 2011, IEEE Transactions on Biomedical Engineering.

[9]  Tzyy-Ping Jung,et al.  Arousing feedback rectifies lapse in performance and corresponding EEG power spectrum , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[10]  Tzyy-Ping Jung,et al.  Tonic and phasic EEG and behavioral changes induced by arousing feedback , 2010, NeuroImage.

[11]  Tzyy-Ping Jung,et al.  Tonic Changes in EEG Power Spectra during Simulated Driving , 2009, HCI.

[12]  Chin-Teng Lin,et al.  Assessing Effectiveness of Various Auditory Warning Signals in Maintaining Drivers' Attention in Virtual Reality-Based Driving Environments , 2009, Perceptual and motor skills.

[13]  Mervyn V. M. Yeo,et al.  Can SVM be used for automatic EEG detection of drowsiness during car driving , 2009 .

[14]  Tzyy-Ping Jung,et al.  Tonic and phasic electroencephalographic dynamics during continuous compensatory tracking , 2008, NeuroImage.

[15]  Roman Rosipal,et al.  EEG-Based Drivers' Drowsiness Monitoring Using a Hierarchical Gaussian Mixture Model , 2007, HCI.

[16]  Richard D. Jones,et al.  EEG-Based Lapse Detection With High Temporal Resolution , 2007, IEEE Transactions on Biomedical Engineering.

[17]  Tzyy-Ping Jung,et al.  Adaptive EEG-Based Alertness Estimation System by Using ICA-Based Fuzzy Neural Networks , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[18]  P. R. Davidson,et al.  Frequent lapses of responsiveness during an extended visuomotor tracking task in non‐sleep‐deprived subjects , 2006, Journal of sleep research.

[19]  Pilar Tejero,et al.  Rear-view mirror use, driver alertness and road type: an empirical study using EEG measures , 2006 .

[20]  Hong Z. Tan,et al.  Using spatial vibrotactile cues to direct visual attention in driving scenes , 2005 .

[21]  Wenjiang J. Fu,et al.  Estimating misclassification error with small samples via bootstrap cross-validation , 2005, Bioinform..

[22]  F. Vaca,et al.  National Highway Traffic Safety Administration (NHTSA) notes. Drowsy driving. , 2005, Annals of emergency medicine.

[23]  Tzyy-Ping Jung,et al.  EURASIP Journal on Applied Signal Processing 2005:19, 3165–3174 c ○ 2005 Hindawi Publishing Corporation Estimating Driving Performance Based on EEG Spectrum Analysis , 2005 .

[24]  I. Nelken,et al.  Multiple Time Scales of Adaptation in Auditory Cortex Neurons , 2004, The Journal of Neuroscience.

[25]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[26]  A. Muzet,et al.  Correlation between driving errors and vigilance level: influence of the driver's age , 2004, Physiology & Behavior.

[27]  Stuart D Baulk,et al.  Awareness of sleepiness when driving. , 2004, Psychophysiology.

[28]  V. Somers,et al.  Heart Rate Variability: , 2003, Journal of cardiovascular electrophysiology.

[29]  Ashley Craig,et al.  Development of an algorithm for an EEG-based driver fatigue countermeasure. , 2003, Journal of safety research.

[30]  P. Caffier,et al.  Experimental evaluation of eye-blink parameters as a drowsiness measure , 2003, European Journal of Applied Physiology.

[31]  Richard J Hanowski,et al.  An on-road study to investigate fatigue in local/short haul trucking. , 2003, Accident; analysis and prevention.

[32]  A. Craig,et al.  Driver fatigue: electroencephalography and psychological assessment. , 2002, Psychophysiology.

[33]  M. Ferrara,et al.  How much sleep do we need? , 2001, Sleep Medicine Reviews.

[34]  Y C Liu,et al.  Comparative study of the effects of auditory, visual and multimodality displays on drivers' performance in advanced traveller information systems , 2001, Ergonomics.

[35]  J. Sexton,et al.  Error, stress, and teamwork in medicine and aviation: cross sectional surveys , 2000, BMJ : British Medical Journal.

[36]  Stephen D. Bay.  Nearest neighbor classification from multiple feature subsets , 1999, Intell. Data Anal..

[37]  Stephen H. Fairclough,et al.  Impairment of Driving Performance Caused by Sleep Deprivation or Alcohol: A Comparative Study , 1999, Hum. Factors.

[38]  Jon Driver,et al.  Inhibition of return following an auditory cue The role of central reorienting events , 1998, Experimental Brain Research.

[39]  S Makeig,et al.  Blind separation of auditory event-related brain responses into independent components. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Thomas A. Dingus,et al.  Human Factors Field Evaluation of Automotive Headway Maintenance/Collision Warning Devices , 1997, Hum. Factors.

[41]  T. Sejnowski,et al.  Estimating alertness from the EEG power spectrum , 1997, IEEE Transactions on Biomedical Engineering.

[42]  T. Jung,et al.  Tonic, phasic, and transient EEG correlates of auditory awareness in drowsiness. , 1996, Brain research. Cognitive brain research.

[43]  David A. Landgrebe,et al.  Covariance Matrix Estimation and Classification With Limited Training Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  T. Jung,et al.  Changes in alertness are a principal component of variance in the EEG spectrum , 1995, Neuroreport.

[45]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[46]  T. Jung,et al.  Predicting failures in auditory detection from changes in the EEG spectrum , 1995, Proceedings of 17th International Conference of the Engineering in Medicine and Biology Society.

[47]  G. Kecklund,et al.  Sleepiness in long distance truck driving: an ambulatory EEG study of night driving. , 1993, Ergonomics.

[48]  S. Makeig,et al.  Lapses in alertness: coherence of fluctuations in performance and EEG spectrum. , 1993, Electroencephalography and clinical neurophysiology.

[49]  R. Homan,et al.  Cerebral location of international 10-20 system electrode placement. , 1987, Electroencephalography and clinical neurophysiology.