Exploring the Brain Responses to Driving Fatigue Through Simultaneous EEG and fNIRS Measurements

Fatigue is one problem with driving as it can lead to difficulties with sustaining attention, behavioral lapses, and a tendency to ignore vital information or operations. In this research, we explore multimodal physiological phenomena in response to driving fatigue through simultaneous functional near-infrared spectroscopy (fNIRS) and electroencephalography (EEG) recordings with the aim of investigating the relationships between hemodynamic and electrical features and driving performance. Sixteen subjects participated in an event-related lane-deviation driving task while measuring their brain dynamics through fNIRS and EEGs. Three performance groups, classified as Optimal, Suboptimal, and Poor, were defined for comparison. From our analysis, we find that tonic variations occur before a deviation, and phasic variations occur afterward. The tonic results show an increased concentration of oxygenated hemoglobin (HbO2) and power changes in the EEG theta, alpha, and beta bands. Both dynamics are significantly correlated with deteriorated driving performance. The phasic EEG results demonstrate event-related desynchronization associated with the onset of steering vehicle in all power bands. The concentration of phasic HbO2 decreased as performance worsened. Further, the negative correlations between tonic EEG delta and alpha power and HbO2 oscillations suggest that activations in HbO2 are related to mental fatigue. In summary, combined hemodynamic and electrodynamic activities can provide complete knowledge of the brain's responses as evidence of state changes during fatigue driving.

[1]  Xu Cui,et al.  Functional near infrared spectroscopy (NIRS) signal improvement based on negative correlation between oxygenated and deoxygenated hemoglobin dynamics , 2010, NeuroImage.

[2]  T. Jung,et al.  Tonic, phasic, and transient EEG correlates of auditory awareness in drowsiness. , 1996, Brain research. Cognitive brain research.

[3]  Tzyy-Ping Jung,et al.  Kinesthesia in a sustained-attention driving task , 2014, NeuroImage.

[4]  Nobumasa Kato,et al.  Effects of creatine on mental fatigue and cerebral hemoglobin oxygenation , 2002, Neuroscience Research.

[5]  M. Fukuda,et al.  Subjective feeling of psychological fatigue is related to decreased reactivity in ventrolateral prefrontal cortex , 2009, Brain Research.

[6]  M. Tamura,et al.  Dynamic multichannel near-infrared optical imaging of human brain activity. , 1993, Journal of applied physiology.

[7]  M. J. Meloy,et al.  The neural basis of the psychomotor vigilance task. , 2005, Sleep.

[8]  Chun-Hsiang Chuang,et al.  Brain Electrodynamic and Hemodynamic Signatures Against Fatigue During Driving , 2018, Front. Neurosci..

[9]  Chin-Teng Lin,et al.  An EEG-based brain-computer interface for dual task driving detection , 2014, Neurocomputing.

[10]  Paul Eling,et al.  Mental fatigue disturbs local processing more than global processing , 2006, Psychological research.

[11]  G. Pfurtscheller,et al.  Event-related synchronization (ERS) in the alpha band--an electrophysiological correlate of cortical idling: a review. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[12]  A. Craig,et al.  Driver fatigue: electroencephalography and psychological assessment. , 2002, Psychophysiology.

[13]  A. Villringer,et al.  Simultaneous EEG–fMRI , 2006, Neuroscience & Biobehavioral Reviews.

[14]  Tao Liu,et al.  Near-infrared spectroscopy as a tool for driving research , 2016, Ergonomics.

[15]  Jason Steffener,et al.  Functional neuroimaging correlates of mental fatigue induced by cognition among chronic fatigue syndrome patients and controls , 2007, NeuroImage.

[16]  Keum-Shik Hong,et al.  fNIRS-based brain-computer interfaces: a review , 2015, Front. Hum. Neurosci..

[17]  Chin-Teng Lin,et al.  Task-related EEG and HRV entropy factors under different real-world fatigue scenarios , 2018, Neurocomputing.

[18]  Jens Steinbrink,et al.  Decoding Vigilance with NIRS , 2014, PloS one.

[19]  Sangtae Ahn,et al.  Multi-Modal Integration of EEG-fNIRS for Brain-Computer Interfaces – Current Limitations and Future Directions , 2017, Front. Hum. Neurosci..

[20]  Keum-Shik Hong,et al.  Passive BCI based on drowsiness detection: an fNIRS study. , 2015, Biomedical optics express.

[21]  Natasha M. Maurits,et al.  Correlating the alpha rhythm to BOLD using simultaneous EEG/fMRI: Inter-subject variability , 2006, NeuroImage.

[22]  John A. Detre,et al.  Imaging brain fatigue from sustained mental workload: An ASL perfusion study of the time-on-task effect , 2010, NeuroImage.

[23]  Yan Wang,et al.  Assessment of cerebral oxygenation during prolonged simulated driving using near infrared spectroscopy: its implications for fatigue development , 2009, European Journal of Applied Physiology.

[24]  M. Fukunaga,et al.  Low frequency BOLD fluctuations during resting wakefulness and light sleep: A simultaneous EEG‐fMRI study , 2008, Human brain mapping.

[25]  Yuan-Pin Lin,et al.  A subject-transfer framework for obviating inter- and intra-subject variability in EEG-based drowsiness detection , 2018, NeuroImage.

[26]  Jae Gwan Kim,et al.  Utilization of a combined EEG/NIRS system to predict driver drowsiness , 2017, Scientific Reports.

[27]  Tzyy-Ping Jung,et al.  Mind-Wandering Tends to Occur under Low Perceptual Demands during Driving , 2016, Scientific Reports.

[28]  Jason Steffener,et al.  Objective evidence of cognitive complaints in Chronic Fatigue Syndrome: A BOLD fMRI study of verbal working memory , 2005, NeuroImage.

[29]  H. Endo,et al.  Mental fatigue and impaired response processes: event-related brain potentials in a Go/NoGo task. , 2009, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[30]  Hellmuth Obrig,et al.  A wearable multi-channel fNIRS system for brain imaging in freely moving subjects , 2014, NeuroImage.

[31]  Akiko Noda,et al.  Insufficient sleep impairs driving performance and cognitive function , 2010, Neuroscience Letters.

[32]  David A. Boas,et al.  Assessing infants' cortical response to speech using near-infrared spectroscopy , 2007, NeuroImage.

[33]  A. Eke,et al.  The modified Beer–Lambert law revisited , 2006, Physics in medicine and biology.

[34]  René J. Huster,et al.  Methods for Simultaneous EEG-fMRI: An Introductory Review , 2012, The Journal of Neuroscience.

[35]  Weiqi Wang,et al.  Functional connectivity analysis using fNIRS in healthy subjects during prolonged simulated driving , 2017, Neuroscience Letters.

[36]  Tzyy-Ping Jung,et al.  EEG-Based Attention Tracking During Distracted Driving , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  Robi Polikar,et al.  Functional Near-Infrared Spectroscopy and Electroencephalography: A Multimodal Imaging Approach , 2009, HCI.

[38]  Chia-Feng Lu,et al.  Maintaining Gait Performance by Cortical Activation during Dual-Task Interference: A Functional Near-Infrared Spectroscopy Study , 2015, PloS one.

[39]  Andreas Kleinschmidt,et al.  EEG-correlated fMRI of human alpha activity , 2003, NeuroImage.

[40]  Maarten A. S. Boksem,et al.  Effects of mental fatigue on attention: an ERP study. , 2005, Brain research. Cognitive brain research.

[41]  Chin-Teng Lin,et al.  Theta and Alpha Oscillations in Attentional Interaction during Distracted Driving , 2018, Front. Behav. Neurosci..

[42]  Tzyy-Ping Jung,et al.  Tonic and phasic EEG and behavioral changes induced by arousing feedback , 2010, NeuroImage.

[43]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[44]  Mickaël Causse,et al.  Why a Comprehensive Understanding of Mental Workload through the Measurement of Neurovascular Coupling Is a Key Issue for Neuroergonomics? , 2016, Front. Hum. Neurosci..

[45]  Chun-Hsiang Chuang,et al.  An EEG-Based Fatigue Detection and Mitigation System , 2016, Int. J. Neural Syst..