Brain Dynamics in Predicting Driving Fatigue Using a Recurrent Self-Evolving Fuzzy Neural Network

This paper proposes a generalized prediction system called a recurrent self-evolving fuzzy neural network (RSEFNN) that employs an on-line gradient descent learning rule to address the electroencephalography (EEG) regression problem in brain dynamics for driving fatigue. The cognitive states of drivers significantly affect driving safety; in particular, fatigue driving, or drowsy driving, endangers both the individual and the public. For this reason, the development of brain-computer interfaces (BCIs) that can identify drowsy driving states is a crucial and urgent topic of study. Many EEG-based BCIs have been developed as artificial auxiliary systems for use in various practical applications because of the benefits of measuring EEG signals. In the literature, the efficacy of EEG-based BCIs in recognition tasks has been limited by low resolutions. The system proposed in this paper represents the first attempt to use the recurrent fuzzy neural network (RFNN) architecture to increase adaptability in realistic EEG applications to overcome this bottleneck. This paper further analyzes brain dynamics in a simulated car driving task in a virtual-reality environment. The proposed RSEFNN model is evaluated using the generalized cross-subject approach, and the results indicate that the RSEFNN is superior to competing models regardless of the use of recurrent or nonrecurrent structures.

[1]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[2]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Peter F. Liddle,et al.  Slow EEG pattern predicts reduced intrinsic functional connectivity in the default mode network: An inter-subject analysis , 2010, NeuroImage.

[4]  Tzyy-Ping Jung,et al.  Adaptive EEG-Based Alertness Estimation System by Using ICA-Based Fuzzy Neural Networks , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[5]  Fayez F. M. El-Sousy,et al.  Intelligent Optimal Recurrent Wavelet Elman Neural Network Control System for Permanent-Magnet Synchronous Motor Servo Drive , 2013, IEEE Transactions on Industrial Informatics.

[6]  John D. Lee,et al.  Fifty Years of Driving Safety Research , 2008, Hum. Factors.

[7]  Chin-Teng Lin,et al.  An online self-constructing neural fuzzy inference network and its applications , 1998, IEEE Trans. Fuzzy Syst..

[8]  Mohammad Reza Mohammadi,et al.  Investigation of mental fatigue through EEG signal processing based on nonlinear analysis: Symbolic dynamics , 2011 .

[9]  Nazan Aksan,et al.  Cognitive Functioning Predicts Driver Safety on Road Tests 1 and 2 Years Later , 2012, Journal of the American Geriatrics Society.

[10]  Desney S. Tan,et al.  Brain-Computer Interfacing for Intelligent Systems , 2008, IEEE Intelligent Systems.

[11]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[12]  Elif Derya Übeyli.  Analysis of EEG signals by implementing eigenvector methods/recurrent neural networks , 2009, Digit. Signal Process..

[13]  T. Martin McGinnity,et al.  Faster Self-Organizing Fuzzy Neural Network Training and a Hyperparameter Analysis for a Brain–Computer Interface , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[14]  Cheng-Jian Lin,et al.  Prediction and identification using wavelet-based recurrent fuzzy neural networks , 2004, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Ryan C. Martin,et al.  Driving anger, sensation seeking, impulsiveness, and boredom proneness in the prediction of unsafe driving. , 2005, Accident; analysis and prevention.

[16]  Michael J. Watts,et al.  IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS Publication Information , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Nicu Sebe,et al.  Multimodal Human Computer Interaction: A Survey , 2005, ICCV-HCI.

[18]  Zhiwei Zhu,et al.  Real-time nonintrusive monitoring and prediction of driver fatigue , 2004, IEEE Transactions on Vehicular Technology.

[19]  Berthold Färber,et al.  Driving Behavior and Simulator Sickness While Driving the Vehicle in the Loop: Validation of Longitudinal Driving Behavior , 2013, IEEE Intelligent Transportation Systems Magazine.

[20]  William Z Rymer,et al.  Guest Editorial Brain–Computer Interface Technology: A Review of the Second International Meeting , 2001 .

[21]  Yusuf Oysal,et al.  Fuzzy Wavelet Neural Network Models for Prediction and Identification of Dynamical Systems , 2010, IEEE Transactions on Neural Networks.

[22]  Tzyy-Ping Jung,et al.  Kinesthesia in a sustained-attention driving task , 2014, NeuroImage.

[23]  P. R. Davidson,et al.  Detecting Behavioral Microsleeps using EEG and LSTM Recurrent Neural Networks , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[24]  Daniel W. C. Ho,et al.  Fuzzy wavelet networks for function learning , 2001, IEEE Trans. Fuzzy Syst..

[25]  Hojjat Adeli,et al.  Principal Component Analysis-Enhanced Cosine Radial Basis Function Neural Network for Robust Epilepsy and Seizure Detection , 2008, IEEE Transactions on Biomedical Engineering.

[26]  Wei-Yen Hsu,et al.  Fuzzy Hopfield neural network clustering for single-trial motor imagery EEG classification , 2012, Expert Syst. Appl..

[27]  Chin-Teng Lin,et al.  EEG-Based Learning System for Online Motion Sickness Level Estimation in a Dynamic Vehicle Environment , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[28]  K.-R. Muller,et al.  The Berlin brain-computer interface: EEG-based communication without subject training , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Chin-Teng Lin,et al.  Generalized EEG-Based Drowsiness Prediction System by Using a Self-Organizing Neural Fuzzy System , 2012, IEEE Transactions on Circuits and Systems I: Regular Papers.

[30]  Mahmut Ozer,et al.  EEG signals classification using the K-means clustering and a multilayer perceptron neural network model , 2011, Expert Syst. Appl..

[31]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[32]  Tzyy-Ping Jung,et al.  Tonic and phasic electroencephalographic dynamics during continuous compensatory tracking , 2008, NeuroImage.

[33]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[34]  Nurettin Acir,et al.  Automatic detection of epileptiform events in EEG by a three-stage procedure based on artificial neural networks , 2005, IEEE Transactions on Biomedical Engineering.

[35]  M. Jeng,et al.  Driver fatigue and highway driving: A simulator study , 2008, Physiology & Behavior.

[36]  Yang-Yin Lin,et al.  A recurrent self-evolving fuzzy neural network with local feedbacks and its application to dynamic system processing , 2010, Fuzzy Sets Syst..

[37]  Elif Derya Übeyli,et al.  Recurrent neural networks employing Lyapunov exponents for EEG signals classification , 2005, Expert Syst. Appl..

[38]  Zhan Li,et al.  Muscle Fatigue Tracking with Evoked EMG via Recurrent Neural Network: Toward Personalized Neuroprosthetics , 2014, IEEE Computational Intelligence Magazine.

[39]  E Donchin,et al.  Brain-computer interface technology: a review of the first international meeting. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[40]  Chia-Feng Juang,et al.  A TSK-type recurrent fuzzy network for dynamic systems processing by neural network and genetic algorithms , 2002, IEEE Trans. Fuzzy Syst..

[41]  Babak Mahmoudi,et al.  Real-time ocular artifact suppression using recurrent neural network for electro-encephalogram based brain-computer interface , 2005, Medical and Biological Engineering and Computing.