Evaluation of mental fatigue based on multipsychophysiological parameters and kernel learning algorithms

Mental fatigue is an extremely sophisticated phenomenon, which is influenced by the environment, the state of health, vitality and the capability of recovery. A single parameter cannot fully describe it. In this paper, the effects of long time sustained low-workload visual display terminal (VDT) task on psychology are investigated by subjective self-reporting measures. Then power spectral indices of HRV, the P300 components based on visual oddball and wavelet packet parameters of EEG are combined to analyze the impacts of prolonged visual display terminal (VDT) activity on autonomic nervous system and central nervous system. Finally, wavelet packet parameters of EEG are extracted as the features of brain activity in different mental fatigue states. Kernel principal component analysis (KPCA) and support vector machine (SVM) are jointly applied to differentiate two states. The statistic results show that the level of both subjective sleepiness and fatigue increase significantly from pre-task to post-task, which indicate that the long time VDT task induces the mental fatigue to the subjects. The predominant activity of autonomic nervous system of subjects turns to the sympathetic activity from parasympathetic activity after the task. The P300 components and wavelet packet parameters of EEG are strongly related with mental fatigue. Moreover, the joint KPCA-SVM method is able to effectively reduce the dimensionality of the feature vectors, speed up the convergence in the training of SVM and achieve a high recognition accuracy (87%) of mental fatigue state. Multipsychophysiological measures and KPCA-SVM method could be a promising tool for the evaluation of mental fatigue.

[1]  Tomio Andoh,et al.  Spectral analyses of electroencephalography and heart rate variability during sleep in normal subjects , 2003, Autonomic Neuroscience.

[2]  W. Dement,et al.  Quantification of sleepiness: a new approach. , 1973, Psychophysiology.

[3]  D. Schroeder,et al.  Blink Rate: A Possible Measure of Fatigue , 1994, Human factors.

[4]  W. Boucsein Engineering Psychophysiology: Issues and Applications , 2009 .

[5]  John L. Andreassi Psychophysiology: Human behavior and physiological response, 3rd ed. , 1995 .

[6]  Maarten A. S. Boksem,et al.  Effects of mental fatigue on attention: an ERP study. , 2005, Brain research. Cognitive brain research.

[7]  L R Hartley,et al.  Indicators of fatigue in truck drivers. , 1994, Applied ergonomics.

[8]  Alejandra Figliola,et al.  Time-frequency analysis of electroencephalogram series. III. Wavelet packets and information cost function , 1998 .

[9]  M. Turiel,et al.  Power Spectral Analysis of Heart Rate and Arterial Pressure Variabilities as a Marker of Sympatho‐Vagal Interaction in Man and Conscious Dog , 1986, Circulation research.

[10]  E. Basar,et al.  Wavelet entropy: a new tool for analysis of short duration brain electrical signals , 2001, Journal of Neuroscience Methods.

[11]  E Grandjean,et al.  Fatigue in industry. , 1979, British journal of industrial medicine.

[12]  Andrzej Cichocki,et al.  Kernel PCA for Feature Extraction and De-Noising in Nonlinear Regression , 2001, Neural Computing & Applications.

[13]  T. Åkerstedt,et al.  Subjective and objective sleepiness in the active individual. , 1990, The International journal of neuroscience.

[14]  M. Chung,et al.  Electroencephalographic study of drowsiness in simulated driving with sleep deprivation , 2005 .

[15]  Stephan Konz,et al.  Work/rest: Part II The scientific basis (knowledge base) for the guide 1 The recommendations provi , 1998 .

[16]  A. Craig,et al.  Electroencephalography Activity Associated with Driver Fatigue: Implications for a Fatigue Countermeasure Device , 2001 .

[17]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[18]  D. J. Mascord,et al.  Behavioral and physiological indices of fatigue in a visual tracking task , 1992 .

[19]  Gunnar Rätsch,et al.  An introduction to kernel-based learning algorithms , 2001, IEEE Trans. Neural Networks.

[20]  J. Stern,et al.  The endogenous eyeblink. , 1984, Psychophysiology.

[21]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[22]  A. Porta,et al.  Power spectrum analysis of heart rate variability to assess the changes in sympathovagal balance during graded orthostatic tilt. , 1994, Circulation.

[23]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[24]  Atsuo Murata,et al.  Evaluation of mental fatigue using feature parameter extracted from event-related potential , 2002 .

[25]  G. Borg Borg's Perceived Exertion and Pain Scales , 1998 .

[26]  J. Andreassi Psychophysiology: Human Behavior and Physiological Response , 1980 .

[27]  Markad V. Kamath,et al.  A comparison of algorithms for detection of spikes in the electroencephalogram , 2003, IEEE Transactions on Biomedical Engineering.

[28]  Osvaldo A. Rosso,et al.  Brain electrical activity analysis using wavelet-based informational tools , 2002 .

[29]  C.W. Anderson,et al.  Comparison of linear, nonlinear, and feature selection methods for EEG signal classification , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  N Egelund,et al.  Spectral analysis of heart rate variability as an indicator of driver fatigue. , 1982, Ergonomics.

[31]  Arthur F. T. Mak,et al.  Effects of acupuncture on heart rate variability in normal subjects under fatigue and non-fatigue state , 2005, European Journal of Applied Physiology.

[32]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[33]  Li Zhang,et al.  Wavelet support vector machine , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[34]  Kun Jiao,et al.  Effect of magnitopuncture on sympathetic and parasympathetic nerve activities in healthy drivers – assessment by power spectrum analysis of heart rate variability , 2002, European Journal of Applied Physiology.

[35]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[36]  G. Kecklund,et al.  Sleepiness in long distance truck driving: an ambulatory EEG study of night driving. , 1993, Ergonomics.

[37]  K Baker,et al.  Work Practices, Fatigue, and Nuclear Power Plant Safety Performance , 1994, Human factors.