Structural health monitoring (SHM) techniques have traditionally been applied to mechanical, aerospace, and civil structures to identify loading and damage patterns. However, human operators in the loop play an important role in the operational performance of aircraft and other structural systems. The increased availability of sensors such as EEG, skin conductance, and eye-tracking systems are creating an opportunity to develop SHM techniques for assessing neuro-physiological factors that influence human decision-making. The parallels between the structural dynamic response of a system to an excitation source and the response of a human to the presentation of a scenario suggests that SHM algorithms can be used to interpret neurophysiological signals. As in traditional SHM, where the system’s dynamic response is measured to characterize the system’s state of health, the measured response of a human during decision-making can capture information about the human’s mental state, including levels of fatigue, engagement, workload, and other human factors. The ability to monitor the human’s mental state in real-time could also enable predictions of human susceptibility to poor decision-making and to trigger an appropriate intervention to prevent human errors. In this work, EEG, eye-tracking, and skin conductance data are acquired from multiple subjects while performing the Stroop test, a standard test designed to induce errors, under varying degrees of time pressure. Time pressure is induced by progressively reducing the time-to-answer allowed for each set of questions. The data is then analyzed using pattern recognition techniques including principal component analysis and the least squares complex exponential (LSCE) parameter estimation algorithm. Results from the principal component analysis identify the modes which dominate the response during decision-making. These modes are compared to the modes identified while the subject is at rest. Next, LSCE is applied to identify model parameters that can be used to perform a one-step-ahead prediction of the neurophysiological variables. The LSCE approach allows data from the different sensor types to be analyzed simultaneously. Results show that model error is reduced as the time pressure is increased. doi: 10.12783/SHM2015/145
[1]
D. L. Brown,et al.
Unified Matrix Polynomial Approach for Operational Modal Analysis
,
2006
.
[2]
Christian Kothe,et al.
Towards passive brain–computer interfaces: applying brain–computer interface technology to human–machine systems in general
,
2011,
Journal of neural engineering.
[3]
T. Lagerlund,et al.
Spatial filtering of multichannel electroencephalographic recordings through principal component analysis by singular value decomposition.
,
1997,
Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.
[4]
David L. Brown,et al.
Parameter Estimation Techniques for Modal Analysis
,
1979
.
[5]
Michelle N. Lumicao,et al.
EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks.
,
2007,
Aviation, space, and environmental medicine.
[6]
P. Sajda,et al.
Response error correction-a demonstration of improved human-machine performance using real-time EEG monitoring
,
2003,
IEEE Transactions on Neural Systems and Rehabilitation Engineering.
[7]
Scott Makeig,et al.
Estimation of task workload from EEG data: New and current tools and perspectives
,
2011,
2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.
[8]
Arnaud Delorme,et al.
EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis
,
2004,
Journal of Neuroscience Methods.
[9]
L. Chlan,et al.
Effectiveness of a music therapy intervention on relaxation and anxiety for patients receiving ventilatory assistance.
,
1998,
Heart & lung : the journal of critical care.
[10]
H. Werner,et al.
Interference effects of Stroop color-word test in childhood, adulthood, and aging.
,
1962,
The Journal of genetic psychology.
[11]
J. E. Rose,et al.
Autonomic Nervous System Activity Distinguishes Among Emotions
,
2009
.
[12]
Ashley Craig,et al.
Development of an algorithm for an EEG-based driver fatigue countermeasure.
,
2003,
Journal of safety research.