The effects of day-to-day variability of physiological data on operator functional state classification

The application of pattern classification techniques to physiological data has undergone rapid expansion. Tasks as varied as the diagnosis of disease from magnetic resonance images, brain-computer interfaces for the disabled, and the decoding of brain functioning based on electrical activity have been accomplished quite successfully with pattern classification. These classifiers have been further applied in complex cognitive tasks to improve performance, in one example as an input to adaptive automation. In order to produce generalizable results and facilitate the development of practical systems, these techniques should be stable across repeated sessions. This paper describes the application of three popular pattern classification techniques to EEG data obtained from asymptotically trained subjects performing a complex multitask across five days in one month. All three classifiers performed well above chance levels. The performance of all three was significantly negatively impacted by classifying across days; however two modifications are presented that substantially reduce misclassifications. The results demonstrate that with proper methods, pattern classification is stable enough across days and weeks to be a valid, useful approach.

[1]  Glenn F. Wilson,et al.  Operator Functional State Classification Using Multiple Psychophysiological Features in an Air Traffic Control Task , 2003, Hum. Factors.

[2]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[3]  Nick C Fox,et al.  Automatic classification of MR scans in Alzheimer's disease. , 2008, Brain : a journal of neurology.

[4]  R. Parasuraman,et al.  Psychophysiology and adaptive automation , 1996, Biological Psychology.

[5]  F. Tong,et al.  Decoding the visual and subjective contents of the human brain , 2005, Nature Neuroscience.

[6]  Bernhard Schölkopf,et al.  Support vector channel selection in BCI , 2004, IEEE Transactions on Biomedical Engineering.

[7]  Misha Pavel,et al.  A framework for rapid visual image search using single-trial brain evoked responses , 2011, Neurocomputing.

[8]  Gert Cauwenberghs,et al.  Incremental and Decremental Support Vector Machine Learning , 2000, NIPS.

[9]  Girijesh Prasad,et al.  A Covariate Shift Minimisation Method to Alleviate Non-stationarity Effects for an Adaptive Brain-Computer Interface , 2010, 2010 20th International Conference on Pattern Recognition.

[10]  A Gevins,et al.  Test–retest reliability of cognitive EEG , 2000, Clinical Neurophysiology.

[11]  Karl J. Friston,et al.  Variability in fMRI: An Examination of Intersession Differences , 2000, NeuroImage.

[12]  N. Birbaumer Breaking the silence: brain-computer interfaces (BCI) for communication and motor control. , 2006, Psychophysiology.

[13]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[14]  B. Oken,et al.  Test-retest reliability in EEG frequency analysis. , 1991, Electroencephalography and clinical neurophysiology.

[15]  Justin A. Blanco,et al.  Unsupervised classification of high-frequency oscillations in human neocortical epilepsy and control patients. , 2010, Journal of neurophysiology.

[16]  T. Poggio,et al.  General conditions for predictivity in learning theory , 2004, Nature.

[17]  Glenn F. Wilson,et al.  Putting the Brain to Work: Neuroergonomics Past, Present, and Future , 2008, Hum. Factors.

[18]  R. Lippmann,et al.  An introduction to computing with neural nets , 1987, IEEE ASSP Magazine.

[19]  Moritz Grosse-Wentrup,et al.  Critical issues in state-of-the-art brain–computer interface signal processing , 2011, Journal of neural engineering.

[20]  J. Haynes Brain Reading: Decoding Mental States From Brain Activity In Humans , 2011 .

[21]  Rainer Goebel,et al.  Classification of fMRI independent components using IC-fingerprints and support vector machine classifiers , 2007, NeuroImage.

[22]  W. K. Simmons,et al.  Circular analysis in systems neuroscience: the dangers of double dipping , 2009, Nature Neuroscience.

[23]  J. R. Comstock MAT - MULTI-ATTRIBUTE TASK BATTERY FOR HUMAN OPERATOR WORKLOAD AND STRATEGIC BEHAVIOR RESEARCH , 1994 .

[24]  Stephen M Smith,et al.  Variability in fMRI: A re‐examination of inter‐session differences , 2005, Human brain mapping.

[25]  A Burgess,et al.  Individual reliability of amplitude distribution in topographical mapping of EEG. , 1993, Electroencephalography and clinical neurophysiology.

[26]  Michael E. Smith,et al.  Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods , 1998, Hum. Factors.

[27]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[28]  Nadine B. Sarter,et al.  Supporting Trust Calibration and the Effective Use of Decision Aids by Presenting Dynamic System Confidence Information , 2006, Hum. Factors.

[29]  Glenn F. Wilson,et al.  Performance Enhancement in an Uninhabited Air Vehicle Task Using Psychophysiologically Determined Adaptive Aiding , 2007, Hum. Factors.

[30]  F. Freeman,et al.  Evaluation of an adaptive automation system using three EEG indices with a visual tracking task , 1999, Biological Psychology.

[31]  Glenn F. Wilson,et al.  A new EOG-based eyeblink detection algorithm , 1998 .

[32]  Glenn F. Wilson,et al.  Real-Time Assessment of Mental Workload Using Psychophysiological Measures and Artificial Neural Networks , 2003, Hum. Factors.

[33]  Chris Berka,et al.  Real-Time Analysis of EEG Indexes of Alertness, Cognition, and Memory Acquired With a Wireless EEG Headset , 2004, Int. J. Hum. Comput. Interact..

[34]  Christopher W. Pleydell-Pearce,et al.  Multivariate analysis of EEG: predicting cognition on the basis of frequency decomposition, inter-electrode correlation, coherence, cross phase and cross power , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[35]  L. Schneider,et al.  Reliability of topographic quantitative EEG amplitude in healthy late-middle-aged and elderly subjects. , 1991, Electroencephalography and clinical neurophysiology.

[36]  H. Jasper Report of the committee on methods of clinical examination in electroencephalography , 1958 .

[37]  K. Coburn,et al.  The value of quantitative electroencephalography in clinical psychiatry: a report by the Committee on Research of the American Neuropsychiatric Association. , 2006, The Journal of neuropsychiatry and clinical neurosciences.

[38]  Bernard Widrow,et al.  30 years of adaptive neural networks: perceptron, Madaline, and backpropagation , 1990, Proc. IEEE.

[39]  G F Wilson,et al.  The use of cardiac and eye blink measures to determine flight segment in F4 crews. , 1991, Aviation, space, and environmental medicine.

[40]  C.W. Anderson,et al.  Comparison of linear, nonlinear, and feature selection methods for EEG signal classification , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.