Monitoring alert and drowsy states by modeling EEG source nonstationarity

OBJECTIVE As a human brain performs various cognitive functions within ever-changing environments, states of the brain characterized by recorded brain activities such as electroencephalogram (EEG) are inevitably nonstationary. The challenges of analyzing the nonstationary EEG signals include finding neurocognitive sources that underlie different brain states and using EEG data to quantitatively assess the state changes. APPROACH This study hypothesizes that brain activities under different states, e.g. levels of alertness, can be modeled as distinct compositions of statistically independent sources using independent component analysis (ICA). This study presents a framework to quantitatively assess the EEG source nonstationarity and estimate levels of alertness. The framework was tested against EEG data collected from 10 subjects performing a sustained-attention task in a driving simulator. MAIN RESULTS Empirical results illustrate that EEG signals under alert versus drowsy states, indexed by reaction speeds to driving challenges, can be characterized by distinct ICA models. By quantifying the goodness-of-fit of each ICA model to the EEG data using the model deviation index (MDI), we found that MDIs were significantly correlated with the reaction speeds (r  =  -0.390 with alertness models and r  =  0.449 with drowsiness models) and the opposite correlations indicated that the two models accounted for sources in the alert and drowsy states, respectively. Based on the observed source nonstationarity, this study also proposes an online framework using a subject-specific ICA model trained with an initial (alert) state to track the level of alertness. For classification of alert against drowsy states, the proposed online framework achieved an averaged area-under-curve of 0.745 and compared favorably with a classic power-based approach. SIGNIFICANCE This ICA-based framework provides a new way to study changes of brain states and can be applied to monitoring cognitive or mental states of human operators in attention-critical settings or in passive brain-computer interfaces.

[1]  Bao-Liang Lu,et al.  EEG-based vigilance estimation using extreme learning machines , 2013, Neurocomputing.

[2]  Kyungmin Su,et al.  The PREP pipeline: standardized preprocessing for large-scale EEG analysis , 2015, Front. Neuroinform..

[3]  Alan Gevins,et al.  Electroencephalography (EEG) in Neuroergonomics , 2006, Neuroergonomics.

[4]  Gert Cauwenberghs,et al.  Tracking non-stationary EEG sources using adaptive online recursive independent component analysis , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  J. S. Barlow,et al.  Methods of Analysis of Nonstationary EEGs, with Emphasis on Segmentation Techniques: A Comparative Review , 1985, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[6]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[7]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[8]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[9]  Bhaskar D. Rao,et al.  Newton method for the ICA mixture model , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  T. Sejnowski,et al.  Estimating alertness from the EEG power spectrum , 1997, IEEE Transactions on Biomedical Engineering.

[11]  E. Micheli-Tzanakou,et al.  Detecting drowsiness while driving using wavelet transform , 2004, IEEE 30th Annual Northeast Bioengineering Conference, 2004. Proceedings of the.

[12]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[13]  Shanbao Tong,et al.  Advances in quantitative electroencephalogram analysis methods. , 2004, Annual review of biomedical engineering.

[14]  Tzyy-Ping Jung,et al.  Tonic and phasic EEG and behavioral changes induced by arousing feedback , 2010, NeuroImage.

[15]  A. J. Bell,et al.  INDEPENDENT COMPONENT ANALYSIS OF BIOMEDICAL SIGNALS , 2000 .

[16]  Y. Harrison,et al.  Frontal lobe function, sleep loss and fragmented sleep. , 2001, Sleep medicine reviews.

[17]  Tzyy-Ping Jung,et al.  Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Mervyn V. M. Yeo,et al.  Can SVM be used for automatic EEG detection of drowsiness during car driving , 2009 .

[19]  S. Makeig,et al.  Lapses in alertness: coherence of fluctuations in performance and EEG spectrum. , 1993, Electroencephalography and clinical neurophysiology.

[20]  Scott Makeig,et al.  Information-based modeling of event-related brain dynamics. , 2006, Progress in brain research.

[21]  R. Oostenveld,et al.  Independent EEG Sources Are Dipolar , 2012, PloS one.

[22]  Tzyy-Ping Jung,et al.  Real-Time Adaptive EEG Source Separation Using Online Recursive Independent Component Analysis , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  P. R. Davidson,et al.  Frequent lapses of responsiveness during an extended visuomotor tracking task in non‐sleep‐deprived subjects , 2006, Journal of sleep research.

[24]  Terrence J. Sejnowski,et al.  ICA Mixture Models for Unsupervised Classification of Non-Gaussian Classes and Automatic Context Switching in Blind Signal Separation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Yuan-Pin Lin,et al.  Transfer learning with large-scale data in brain-computer interfaces , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[26]  Alexander A. Fingelkurts,et al.  Nonstationary nature of the brain activity as revealed by EEG/MEG: Methodological, practical and conceptual challenges , 2005, Signal Process..

[27]  Tzyy-Ping Jung,et al.  Tonic Changes in EEG Power Spectra during Simulated Driving , 2009, HCI.

[28]  Klaus-Robert Muller,et al.  Finding stationary brain sources in EEG data , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[29]  Sylvie Charbonnier,et al.  EEG index for control operators' mental fatigue monitoring using interactions between brain regions , 2016, Expert Syst. Appl..

[30]  A. Craig,et al.  Driver fatigue: electroencephalography and psychological assessment. , 2002, Psychophysiology.

[31]  Christian Kothe,et al.  Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general , 2011, Journal of neural engineering.

[32]  Tzyy-Ping Jung,et al.  EEG-based drowsiness estimation for safety driving using independent component analysis , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[33]  M. Carskadon,et al.  Chapter 2 - Normal Human Sleep : An Overview , 2005 .

[34]  Yuan-Pin Lin,et al.  Independent Component Ensemble of EEG for Brain–Computer Interface , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[36]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[37]  Kenneth Kreutz-Delgado,et al.  AMICA : An Adaptive Mixture of Independent Component Analyzers with Shared Components , 2011 .

[38]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[39]  Max Hirshkowitz,et al.  Normal human sleep: an overview. , 2004, The Medical clinics of North America.

[40]  Christian Jutten,et al.  On the blind source separation of human electroencephalogram by approximate joint diagonalization of second order statistics , 2008, Clinical Neurophysiology.

[41]  Tom Eichele,et al.  Semi-automatic identification of independent components representing EEG artifact , 2009, Clinical Neurophysiology.

[42]  M. Sarter,et al.  The cognitive neuroscience of sustained attention: where top-down meets bottom-up , 2001, Brain Research Reviews.

[43]  Tzyy-Ping Jung,et al.  EEG-Based Subject- and Session-independent Drowsiness Detection: An Unsupervised Approach , 2008, EURASIP J. Adv. Signal Process..

[44]  J. Santamaria,et al.  The EEG of Drowsiness in Normal Adults , 1987, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[45]  Tzyy-Ping Jung,et al.  EURASIP Journal on Applied Signal Processing 2005:19, 3165–3174 c ○ 2005 Hindawi Publishing Corporation Estimating Driving Performance Based on EEG Spectrum Analysis , 2005 .

[46]  Tzyy-Ping Jung,et al.  Modeling and Tracking Brain Nonstationarity in a Sustained Attention Task , 2016, HCI.

[47]  S Bonnet,et al.  Efficient mental workload estimation using task-independent EEG features , 2016, Journal of neural engineering.

[48]  Stéphane Bonnet,et al.  Mental fatigue and working memory load estimation: Interaction and implications for EEG-based passive BCI , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).