Utilization of a combined EEG/NIRS system to predict driver drowsiness

The large number of automobile accidents due to driver drowsiness is a critical concern of many countries. To solve this problem, numerous methods of countermeasure have been proposed. However, the results were unsatisfactory due to inadequate accuracy of drowsiness detection. In this study, we introduce a new approach, a combination of EEG and NIRS, to detect driver drowsiness. EEG, EOG, ECG and NIRS signals have been measured during a simulated driving task, in which subjects underwent both awake and drowsy states. The blinking rate, eye closure, heart rate, alpha and beta band power were used to identify subject’s condition. Statistical tests were performed on EEG and NIRS signals to find the most informative parameters. Fisher’s linear discriminant analysis method was employed to classify awake and drowsy states. Time series analysis was used to predict drowsiness. The oxy-hemoglobin concentration change and the beta band power in the frontal lobe were found to differ the most between the two states. In addition, these two parameters correspond well to an awake to drowsy state transition. A sharp increase of the oxy-hemoglobin concentration change, together with a dramatic decrease of the beta band power, happened several seconds before the first eye closure.

[1]  Wei-Dong Dang,et al.  Multiscale limited penetrable horizontal visibility graph for analyzing nonlinear time series , 2016, Scientific Reports.

[2]  Zhong-Ke Gao,et al.  Multiscale complex network for analyzing experimental multivariate time series , 2015 .

[3]  R. Vlek,et al.  Combined EEG-fNIRS Decoding of Motor Attempt and Imagery for Brain Switch Control: An Offline Study in Patients With Tetraplegia , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[4]  Evangelos Bekiaris,et al.  Using EEG spectral components to assess algorithms for detecting fatigue , 2009, Expert Syst. Appl..

[5]  Tzyy-Ping Jung,et al.  EEG-based drowsiness estimation for safety driving using independent component analysis , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[6]  Sangtae Ahn,et al.  Exploring Neuro-Physiological Correlates of Drivers' Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data , 2016, Front. Hum. Neurosci..

[7]  Andrew C. N. Chen,et al.  Automatic recognition of alertness and drowsiness from EEG by an artificial neural network. , 2002, Medical engineering & physics.

[8]  Peter Rossiter,et al.  Applying neural network analysis on heart rate variability data to assess driver fatigue , 2011, Expert Syst. Appl..

[9]  Chrysoula Kourtidou-Papadeli,et al.  Monitoring sleepiness with on-board electrophysiological recordings for preventing sleep-deprived traffic accidents , 2007, Clinical Neurophysiology.

[10]  Sung Chan Jun,et al.  High Theta and Low Alpha Powers May Be Indicative of BCI-Illiteracy in Motor Imagery , 2013, PloS one.

[11]  Rónán Collins,et al.  Combining fNIRS and EEG to Improve Motor Cortex Activity Classification during an Imagined Movement-Based Task , 2011, HCI.

[12]  Zhong-Ke Gao,et al.  Multi-frequency complex network from time series for uncovering oil-water flow structure , 2015, Scientific Reports.

[13]  Qiang Ji,et al.  Real-Time Eye, Gaze, and Face Pose Tracking for Monitoring Driver Vigilance , 2002, Real Time Imaging.

[14]  F. Wallois,et al.  EEG-NIRS in epilepsy in children and neonates , 2010, Neurophysiologie Clinique/Clinical Neurophysiology.

[15]  M. Rizzo,et al.  Driver Performance in the Moments Surrounding a Microsleep. , 2008, Transportation research. Part F, Traffic psychology and behaviour.

[16]  Michael Schrauf,et al.  EEG alpha spindle measures as indicators of driver fatigue under real traffic conditions , 2011, Clinical Neurophysiology.

[17]  Simon G Hosking,et al.  Predicting driver drowsiness using vehicle measures: recent insights and future challenges. , 2009, Journal of safety research.

[18]  Zhongke Gao,et al.  A directed weighted complex network for characterizing chaotic dynamics from time series , 2012 .

[19]  M. Chung,et al.  Electroencephalographic study of drowsiness in simulated driving with sleep deprivation , 2005 .

[20]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[21]  Zhong-Ke Gao,et al.  Multivariate weighted complex network analysis for characterizing nonlinear dynamic behavior in two-phase flow , 2015 .

[22]  C. Grova,et al.  Detection of hemodynamic responses to epileptic activity using simultaneous Electro-EncephaloGraphy (EEG)/Near Infra Red Spectroscopy (NIRS) acquisitions , 2011, NeuroImage.

[23]  Ashley Craig,et al.  Development of an algorithm for an EEG-based driver fatigue countermeasure. , 2003, Journal of safety research.

[24]  Sangtae Ahn,et al.  Achieving a hybrid brain–computer interface with tactile selective attention and motor imagery , 2014, Journal of neural engineering.

[25]  J Krieger.  The encyclopedia of sleep and sleep disorders, Thorpy MJ, Yager J. (1991), 298 p , 1991 .

[26]  Jens Steinbrink,et al.  Decoding Vigilance with NIRS , 2014, PloS one.

[27]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[28]  R. Johnson,et al.  Perinatal iron deficiency and neurocognitive development , 2013, Front. Hum. Neurosci..

[29]  M. Sawan,et al.  Non-invasive continuous EEG-fNIRS recording of temporal lobe seizures , 2012, Epilepsy Research.

[30]  J. H. Hong,et al.  Gamma band activity associated with BCI performance: simultaneous MEG/EEG study , 2013, Front. Hum. Neurosci..

[31]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[32]  F. Wallois,et al.  Usefulness of simultaneous EEG–NIRS recording in language studies , 2012, Brain and Language.

[33]  Keum-Shik Hong,et al.  Passive BCI based on drowsiness detection: an fNIRS study. , 2015, Biomedical optics express.

[34]  M A Schier,et al.  Changes in EEG alpha power during simulated driving: a demonstration. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[35]  Shuyan Hu,et al.  Driver drowsiness detection with eyelid related parameters by Support Vector Machine , 2009, Expert Syst. Appl..

[36]  M. Lassonde,et al.  Nonlinear hemodynamic responses in human epilepsy: A multimodal analysis with fNIRS-EEG and fMRI-EEG , 2012, Journal of Neuroscience Methods.

[37]  Yan Wang,et al.  Assessment of cerebral oxygenation during prolonged simulated driving using near infrared spectroscopy: its implications for fatigue development , 2009, European Journal of Applied Physiology.

[38]  Toshinori Kato,et al.  Functional brain imaging using near-infrared spectroscopy during actual driving on an expressway , 2013, Front. Hum. Neurosci..