Effects of a Psychophysiological System for Adaptive Automation on Performance, Workload, and the Event-Related Potential P300 Component

The present study examined the effects of an electroencephalographic- (EEG-) based system for adaptive automation on tracking performance and workload. In addition, event-related potentials (ERPs) to a secondary task were derived to determine whether they would provide an additional degree of workload specificity. Participants were run in an adaptive automation condition, in which the system switched between manual and automatic task modes based on the value of each individual's own EEG engagement index; a yoked control condition; or another control group, in which task mode switches followed a random pattern. Adaptive automation improved performance and resulted in lower levels of workload. Further, the P300 component of the ERP paralleled the sensitivity to task demands of the performance and subjective measures across conditions. These results indicate that it is possible to improve performance with a psychophysiological adaptive automation system and that ERPs may provide an alternative means for distinguishing among levels of cognitive task demand in such systems. Actual or potential applications of this research include improved methods for assessing operator workload and performance.

[1]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[2]  P. Hancock.  Human Factors Psychology , 1987 .

[3]  W. Ritter,et al.  Orienting and habituation to auditory stimuli: a study of short term changes in average evoked responses. , 1968, Electroencephalography and clinical neurophysiology.

[4]  Mark W. Scerbo,et al.  A brain-based system for adaptive automation , 2003 .

[5]  Darryl G. Humphrey,et al.  Toward a Psychophysiological Assessment of Dynamic Changes in Mental Workload , 1994, Human factors.

[6]  E. Sirevaag,et al.  A Psychophysiological Assessment of Operator Workload During Simulated Flight Missions , 1987, Human factors.

[7]  J. M. Peter,et al.  The Efficacy of Psychophysiological Measures for Implementing Adaptive Technology , 2001 .

[8]  William B. Rouse,et al.  Adaptive Allocation of Decision Making Responsibility between Supervisor and Computer , 1976 .

[9]  D. Strayer,et al.  Attentional Requirements of Automatic and Controlled Processing , 1990 .

[10]  F. Freeman,et al.  Evaluation of an adaptive automation system using three EEG indices with a visual tracking task , 1999, Biological Psychology.

[11]  K.-F. Kraiss,et al.  Manned Systems Design , 1981 .

[12]  Mustapha Mouloua,et al.  Automation Technology and Human Performance: Current Research and Trends , 1999 .

[13]  R. Parasuraman,et al.  Psychophysiology and adaptive automation , 1996, Biological Psychology.

[14]  M. Coles,et al.  Event-related brain potentials: An introduction. , 1995 .

[15]  F. Freeman,et al.  A Closed-Loop System for Examining Psychophysiological Measures for Adaptive Task Allocation , 2000, The International journal of aviation psychology.

[16]  J. Lubar.  Discourse on the development of EEG diagnostics and biofeedback for attention-deficit/hyperactivity disorders , 1991, Biofeedback and self-regulation.

[17]  R. Johnson.  A triarchic model of P300 amplitude. , 1986, Psychophysiology.

[18]  A. Kramer,et al.  Physiological metrics of mental workload: A review of recent progress , 1990, Multiple-task performance.

[19]  E. Donchin,et al.  Performance of concurrent tasks: a psychophysiological analysis of the reciprocity of information-processing resources. , 1983, Science.

[20]  Susan G. Hill,et al.  Traditional and raw task load index (TLX) correlations: Are paired comparisons necessary? In A , 1989 .

[21]  A. Pope,et al.  Biocybernetic system evaluates indices of operator engagement in automated task , 1995, Biological Psychology.

[22]  E. Donchin,et al.  P300 and tracking difficulty: evidence for multiple resources in dual-task performance. , 1980, Psychophysiology.

[23]  Andrew Abarbanel,et al.  The Neural Underpinnings of Neurofeedback Training , 1999 .

[24]  D. Damos.  Multiple-task performance , 2020 .

[25]  J. Intriligator,et al.  On the relationship between background EEG and the P300 event-related potential , 1994, Biological Psychology.

[26]  Michael G. H. Coles,et al.  Energetical Issues in Research on Human Information Processing , 1986 .

[27]  A W Gaillard,et al.  Comparing the concepts of mental load and stress. , 1993, Ergonomics.

[28]  Christopher D. Wickens,et al.  A model for types and levels of human interaction with automation , 2000, IEEE Trans. Syst. Man Cybern. Part A.

[29]  Christopher D. Wickens,et al.  The Event Related Cortical Potential as an Index of Task Workload , 1977 .

[30]  Lawrence J. Prinzel,et al.  A Bio-Cybernetic System for Adaptive Automation , 1995 .

[31]  J. Lubar,et al.  Evaluation of the effectiveness of EEG neurofeedback training for ADHD in a clinical setting as measured by changes in T.O.V.A. scores, behavioral ratings, and WISC-R performance , 1995, Biofeedback and self-regulation.

[32]  H. Jasper.  Report of the committee on methods of clinical examination in electroencephalography , 1958 .

[33]  Ray Johnson.  For Distinguished Early Career Contribution to Psychophysiology: Award Address, 1985 , 1986 .

[34]  E. Basar,et al.  P300-response: possible psychophysiological correlates in delta and theta frequency channels. A review. , 1992, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[35]  Thomas B. Sheridan,et al.  Monitoring Behavior and Supervisory Control , 1976 .

[36]  P. Hancock,et al.  Adaptive control in human-machine systems , 1987 .

[37]  J. Yordanova,et al.  Single-sweep analysis of the theta frequency band during an auditory oddball task. , 1998, Psychophysiology.

[38]  Mustapha Mouloua,et al.  Automation and Human Performance : Theory and Applications , 1996 .

[39]  W. Herrmann,et al.  COMSTAT rule for vigilance classification based on spontaneous EEG activity. , 1987, Neuropsychobiology.

[40]  P. Hancock,et al.  A Dynamic Model of Stress and Sustained Attention , 1989, Human factors.

[41]  E. Donchin,et al.  Psychophysiology : systems, processes, and applications , 1987 .

[42]  P A Hancock,et al.  Pilot performance and preference for short cycles of automation in adaptive function allocation. , 1995, Applied ergonomics.

[43]  M. Coles,et al.  Energetics and Human Information Processing , 1986 .

[44]  J. R. Comstock.  MAT - MULTI-ATTRIBUTE TASK BATTERY FOR HUMAN OPERATOR WORKLOAD AND STRATEGIC BEHAVIOR RESEARCH , 1994 .

[45]  Graham Wilson,et al.  Psychophysiological assessment of workload in multi-task environments , 2020 .

[46]  E. Basar,et al.  Theta rhythmicities following expected visual and auditory targets. , 1992, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[47]  W. Karwowski.  International encyclopedia of ergonomics and human factors , 2001 .

[48]  Ray Johnson,et al.  Event-related brain potentials : basic issues and applications , 1990 .

[49]  G. R. J. Hockey.  A State Control Theory of Adaptation and Individual Differences in Stress Management , 1986 .

[50]  Frank E. Gomer,et al.  Physiological Monitoring and the Concept of Adaptive Systems , 1981 .

[51]  Raja Parasuraman,et al.  Event-related brain potentials and human factors research. , 1990 .

[52]  B. Fowler.  P300 as a Measure of Workload during a Simulated Aircraft Landing Task , 1994, Human factors.

[53]  P. Hancock,et al.  Human Mental Workload , 1988 .

[54]  E. Basar,et al.  Does frequency analysis lead to better understanding of human event related potentials. , 1985, The International journal of neuroscience.