/ TM-2001-211016 Empirical Analysis of EEG and ERPs for Psychophysiological Adaptive Task Allocation

The present study was designed to test the efficacy of using Electroencephalogram (EEG) and Event-Related Potentials (ERPs) for making task allocation decisions. Thirty-six participants were randomly assigned to an experimental, yoked, or control group condition. Under the experimental condition, a compensatory tracking task was switched between manual and automatic task modes based upon the participantÕs EEG. ERPs were also gathered to an auditory, oddball task. Participants in the yoked condition performed the same tasks under the exact sequence of task allocations that participants in the experimental group experienced. The control condition consisted of a random sequence of task allocations that was representative of each participant in the experimental group condition. Therefore, the design allowed a test of whether the performance and workload benefits seen in previous studies using the biocybernetic system were due to adaptive aiding or merely to the increase in task mode allocations. The results showed that the use of adaptive aiding improved performance and lowered subjective workload under negative feedback as predicted. Additionally, participants in the adaptive group had significantly lower tracking error scores and NASA-TLX ratings than participants in either the yoked or control group conditions. Furthermore, the amplitudes of the N1 and P3 ERP components were significantly larger under the experimental group condition than under either the yoked or control group conditions. These results are discussed in terms of their implications for adaptive automation design.

[1]  F. T. Eggemeier,et al.  Psychophysiological assessment of workload in multi-task environments , 2020, Multiple-task performance.

[2]  John L. Andreassi,et al.  Psychophysiology: Human Behavior & Physiological Response , 2000 .

[3]  Lawrence J. Prinzel,et al.  A Biocybernetic System for Examining Psychophysiological Correlates for Adaptive Automation , 1997 .

[4]  Raja Parasuraman,et al.  Humans and Automation: Use, Misuse, Disuse, Abuse , 1997, Hum. Factors.

[5]  R. Kakigi,et al.  [Event-related brain potentials]. , 1997, Nihon rinsho. Japanese journal of clinical medicine.

[6]  Mustapha Mouloua,et al.  Effects of Adaptive Task Allocation on Monitoring of Automated Systems , 1996, Hum. Factors.

[7]  R. Parasuraman,et al.  Psychophysiology and adaptive automation , 1996, Biological Psychology.

[8]  P A Hancock,et al.  Pilot performance and preference for short cycles of automation in adaptive function allocation. , 1995, Applied ergonomics.

[9]  Lawrence J. Prinzel,et al.  A Bio-Cybernetic System for Adaptive Automation , 1995 .

[10]  Lawrence J. Prinzel,et al.  Feedback Contingencies and Bio-Cybernetic Regulation of Operator Workload , 1995 .

[11]  A. Pope,et al.  Biocybernetic system evaluates indices of operator engagement in automated task , 1995, Biological Psychology.

[12]  M. Sterman,et al.  Concepts and applications of EEG analysis in aviation performance evaluation , 1995, Biological Psychology.

[13]  B. Fowler.  P300 as a Measure of Workload during a Simulated Aircraft Landing Task , 1994, Human factors.

[14]  R W Backs,et al.  Psychophysiological Measures of Workload during Continuous Manual Performance , 1994, Human factors.

[15]  Darryl G. Humphrey,et al.  Toward a Psychophysiological Assessment of Dynamic Changes in Mental Workload , 1994, Human factors.

[16]  Brandall Y. Suyenobu,et al.  Application of quantitative EEG analysis to workload assessment in an advanced aircraft simulator , 1993 .

[17]  Mary B. Alexander,et al.  Design for success: A human-centered approach to designing successful products and systems : William B. Rouse, a Wiley-Interscience Publication, John Wiley & Sons, Inc., New York, New York, 1991, 270 pp. , 1993 .

[18]  C D Wickens,et al.  Assessment of pilot performance and mental workload in rotary wing aircraft. , 1993, Ergonomics.

[19]  A W Gaillard,et al.  Comparing the concepts of mental load and stress. , 1993, Ergonomics.

[20]  Raja Parasuraman,et al.  Automation- Induced "Complacency": Development of the Complacency-Potential Rating Scale , 1993 .

[21]  Raja Parasuraman,et al.  Operator versus computer control of adaptive automation , 1993 .

[22]  M. Redondo,et al.  Decrements in heart rate variability during memory search. , 1992, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[23]  J. Lubar.  Discourse on the development of EEG diagnostics and biofeedback for attention-deficit/hyperactivity disorders , 1991, Biofeedback and self-regulation.

[24]  P. M. Rossini,et al.  Auditory evoked magnetic fields and electric potentials , 1991 .

[25]  Kurt Offenloch,et al.  Computer Aided Physiological Assessment of the Functional State of Pilots during Simulated Flight , 1990 .

[26]  Jeffrey B. Henriques,et al.  Asymmetrical brain electrical activity discriminates between psychometrically-matched verbal and spatial cognitive tasks. , 1990, Psychophysiology.

[27]  S. Hillyard,et al.  Cross-modal selective attention effects on retinal, myogenic, brainstem, and cerebral evoked potentials. , 1990, Psychophysiology.

[28]  Arthur F. Kramer,et al.  Real-time measurement of mental workload: A feasibility study , 1990 .

[29]  John R. Wilson,et al.  Mental Models: Theory and Application in Human Factors , 1989 .

[30]  M. Scherg,et al.  A Source Analysis of the Late Human Auditory Evoked Potentials , 1989, Journal of Cognitive Neuroscience.

[31]  Earl L. Wiener,et al.  Human factors of advanced technology (glass cockpit) transport aircraft , 1989 .

[32]  K. G. Wilson,et al.  Electrodermal lability and visual information processing. , 1989, Psychophysiology.

[33]  H. Schwilden,et al.  Closed-loop feedback control of propofol anaesthesia by quantitative EEG analysis in humans. , 1989, British journal of anaesthesia.

[34]  E Donchin,et al.  Resource reciprocity: an event-related brain potentials analysis. , 1989, Acta psychologica.

[35]  Bruce Christie,et al.  Psychophysiology and the electronic workplace , 1989 .

[36]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[37]  P. Ullsperger,et al.  The P300 component of the event-related brain potential and mental effort. , 1988, Ergonomics.

[38]  Mark H. Chignell,et al.  Mental workload dynamics in adaptive interface design , 1988, IEEE Trans. Syst. Man Cybern..

[39]  B. Rouse William,et al.  Adaptive Aiding for Human/Computer Control , 1988 .

[40]  Arthur F. Kramer,et al.  Assessing the development of automatic processing: An application of dual-task and event-related brain potential methodologies , 1988, Biological Psychology.

[41]  Richard L. Horst,et al.  An overview of current approaches and future challenges in physiological monitoring , 1988 .

[42]  J. C. Smith,et al.  Electroencephalographic Correlates of Pilot Performance: Simulation and In-Flight Studies , 1988 .

[43]  Donald A. Norman,et al.  Some observations on mental models , 1987 .

[44]  W. Herrmann,et al.  COMSTAT rule for vigilance classification based on spontaneous EEG activity. , 1987, Neuropsychobiology.

[45]  T. Picton,et al.  The N1 wave of the human electric and magnetic response to sound: a review and an analysis of the component structure. , 1987, Psychophysiology.

[46]  K. G. Wilson.  Electrodermal lability and simple reaction time , 1987, Biological Psychology.

[47]  T. Åkerstedt,et al.  Sleepiness on the job: continuously measured EEG changes in train drivers. , 1987, Electroencephalography and clinical neurophysiology.

[48]  J. Beatty,et al.  Contrasting effects of response uncertainty on the task-evoked pupillary response and reaction time. , 1987, Psychophysiology.

[49]  E. Sirevaag,et al.  A Psychophysiological Assessment of Operator Workload During Simulated Flight Missions , 1987, Human factors.

[50]  H. Shibasaki,et al.  Human auditory and somatosensory event-related potentials: effects of response condition and age. , 1987, Electroencephalography and clinical neurophysiology.

[51]  R. Johnson.  A triarchic model of P300 amplitude. , 1986, Psychophysiology.

[52]  L C Walrath,et al.  Blink activity in a discrimination task as a function of stimulus modality and schedule of presentation. , 1985, Psychophysiology.

[53]  M. Rugg.  The effects of semantic priming and work repetition on event-related potentials. , 1985, Psychophysiology.

[54]  J. Beatty,et al.  The pupil and stimulus probability. , 1985, Psychophysiology.

[55]  C D Wickens,et al.  Processing of stimulus properties: evidence for dual-task integrality. , 1985, Journal of experimental psychology. Human perception and performance.

[56]  C. Brunia,et al.  Anticipatory response-relevant muscle activity, CNV amplitude and simple reaction time. , 1985, Electroencephalography and clinical neurophysiology.

[57]  W J Ray,et al.  EEG activity during cognitive processing: influence of attentional factors. , 1985, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[58]  M. A. Biferno.  Mental workload measurement: Event-related potentials and ratings of workload and fatigue , 1985 .

[59]  A F Kramer,et al.  The interpretation of the component structure of event-related brain potentials: an analysis of expert judgments. , 1985, Psychophysiology.

[60]  J. Beatty,et al.  Pupillary dilations in movement preparation and execution. , 1985, Psychophysiology.

[61]  M. R. Houck,et al.  Event-related potentials elicited by automatic targets: a dual-task analysis. , 1985, Journal of experimental psychology. Human perception and performance.

[62]  H. McIlvaine Parsons,et al.  Automation and the Individual: Comprehensive and Comparative Views , 1985 .

[63]  S. Farmer,et al.  The effects of physical and semantic incongruities on auditory event-related potentials. , 1984, Electroencephalography and clinical neurophysiology.

[64]  Thomas M. Longridge,et al.  Physiological Assessment of Aircraft Pilot Workload in Simulated Landing and Simulated Hostile Threat Environments , 1984 .

[65]  R. Ragot,et al.  Perceptual and motor space representation: an event-related potential study. , 1984, Psychophysiology.

[66]  C D Wickens,et al.  An Analysis of the Processing Requirements of a Complex Perceptual-Motor Task , 1983, Human factors.

[67]  E. Donchin,et al.  Performance of concurrent tasks: a psychophysiological analysis of the reciprocity of information-processing resources. , 1983, Science.

[68]  A. Lindqvist,et al.  Heart rate variability, cardiac mechanics, and subjectively evaluated stress during simulator flight. , 1983, Aviation, space, and environmental medicine.

[69]  M. R. Houck,et al.  The role of attentional resources in automatic detection , 1983, Cognitive Psychology.

[70]  J. Beatty,et al.  Response selection and initiation in speeded reactions: a pupillometric analysis. , 1983, Journal of experimental psychology. Human perception and performance.

[71]  E. Lindholm,et al.  Autonomic activity and workload during learning of a simulated aircraft carrier landing task. , 1983, Aviation, space, and environmental medicine.

[72]  J. Beatty.  Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982, Psychological bulletin.

[73]  Frank E. Gomer,et al.  Electrocortical Activity and Operator Workload: A Comparison of Changes in the Electroencephalogram and in Event-Related Potentials , 1981 .

[74]  E Donchin,et al.  A metric for thought: a comparison of P300 latency and reaction time. , 1981, Science.

[75]  Renwick E. Curry,et al.  Flight-deck automation: promises and problems , 1980 .

[76]  E Donchin,et al.  Event-related brain potentials and subjective probability in a learning task , 1980, Memory & cognition.

[77]  E. Donchin,et al.  P300 and tracking difficulty: evidence for multiple resources in dual-task performance. , 1980, Psychophysiology.

[78]  C D Wickens,et al.  The Event-Related Brain Potential as an Index of Display-Monitoring Workload , 1980, Human factors.

[79]  M. Kutas,et al.  Reading senseless sentences: brain potentials reflect semantic incongruity. , 1980, Science.

[80]  中村 道彦,et al.  Contingent Negative Variation〔邦文〕 (脳脊髄誘発電位の基礎と臨床 ) , 1979 .

[81]  C Sekiguchi,et al.  Evaluation method of mental workload under flight conditions. , 1978, Aviation, space, and environmental medicine.

[82]  Christopher D. Wickens,et al.  The Event Related Cortical Potential as an Index of Task Workload , 1977 .

[83]  G. McCarthy,et al.  Augmenting mental chronometry: the P300 as a measure of stimulus evaluation time. , 1977, Science.

[84]  William B. Rouse,et al.  Human-Computer Interaction in Multitask Situations , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[85]  Clare D. McGillem,et al.  Measurements of Signal Components in Single Visualy Evoked Brain Potentials , 1977, IEEE Transactions on Biomedical Engineering.

[86]  Judith M. Ford,et al.  Attention effects on auditory evoked potentials to infrequent events , 1976, Biological Psychology.

[87]  D. Ruchkin,et al.  Emitted and evoked P300 potentials and variation in stimulus probability. , 1975, Psychophysiology.

[88]  N. Squires,et al.  Two varieties of long-latency positive waves evoked by unpredictable auditory stimuli in man. , 1975, Electroencephalography and clinical neurophysiology.

[89]  J F O'Hanlon,et al.  Operant Control of Occipital Theta Rhythm Affects Performance in a Radar Monitoring Task , 1974, Science.

[90]  S. Hillyard,et al.  Electrical Signs of Selective Attention in the Human Brain , 1973, Science.

[91]  D. A. Spyker,et al.  Development of techniques for measuring pilot workload , 1971 .

[92]  R. C. Oldfield.  The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[93]  S Sutton,et al.  Quantitative evoked potential correlates of the probability of events. , 1970, Psychophysiology.

[94]  W. S. Peavler,et al.  Incentive effects and pupillary changes in association learning. , 1969, Journal of experimental psychology.

[95]  W. S. Peavler,et al.  Effects of verbalization and incentive on the pupil response to mental activity. , 1968, Canadian journal of psychology.

[96]  E R John,et al.  Information Delivery and the Sensory Evoked Potential , 1967, Science.

[97]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[98]  D. Lindsley,et al.  Attention, Vigilance, and Cortical Evoked-Potentials in Humans , 1964, Science.

[99]  Norbert Wiener,et al.  Extrapolation, Interpolation, and Smoothing of Stationary Time Series , 1964 .

[100]  S. Geisser,et al.  On methods in the analysis of profile data , 1959 .

[101]  David D. Woods,et al.  Decomposing Automation : Apparent Simplicity , Real Complexity , 2003 .

[102]  Mark A. Morris,et al.  Performing Organization Name(s) and Address(es) , 2001 .

[103]  J. Beatty,et al.  The pupillary system. , 2000 .

[104]  F. Yuan,et al.  SPONSORING / MONITORING AGENCY NAME(S) AND ADDRESS(ES) , 1999 .

[105]  Mustapha Mouloua,et al.  Automation Technology and Human Performance: Current Research and Trends , 1999 .

[106]  M. Mouloua,et al.  Human–automation interaction: Research and practice. , 1997 .

[107]  Mustapha Mouloua,et al.  Automation and Human Performance : Theory and Applications , 1996 .

[108]  Barry H. Kantowitz,et al.  PILOT WORKLOAD AND FLIGHTDECK AUTOMATION. , 1996 .

[109]  M. Coles,et al.  Event-related brain potentials: An introduction. , 1995 .

[110]  William C. Howell,et al.  Human factors in the workplace , 1994 .

[111]  Giacomo Mauro DAriano.  International Perspectives on Self-Regulation and Health. , 1994 .

[112]  G Belenky,et al.  Effects of simulated high altitude exposure on long-latency event-related brain potentials and performance. , 1993, Aviation, space, and environmental medicine.

[113]  Raja Parasuraman,et al.  Performance Consequences of Automation-Induced 'Complacency' , 1993 .

[114]  Rapid Thermal Multiprocessor,et al.  Supervisory Control of a , 1993 .

[115]  C. Wickens.  Engineering psychology and human performance, 2nd ed. , 1992 .

[116]  B. Rockstroh,et al.  Self-Regulation of Slow Cortical Potentials and Its Role in Epileptogenesis , 1991 .

[117]  Christoph Braun,et al.  Auditory and somatosensory event-related potentials: I. Effects of attention , 1991 .

[118]  Raja Parasuraman,et al.  Event-related brain potentials and human factors research. , 1990 .

[119]  Walter W. Surwillo,et al.  Psychophysiology for Clinical Psychologists , 1990 .

[120]  J. Rohrbaugh,et al.  Event-related brain potentials : basic issues and applications , 1990 .

[121]  D. Strayer,et al.  Attentional Requirements of Automatic and Controlled Processing , 1990 .

[122]  Susan G. Hill,et al.  Traditional and raw task load index (TLX) correlations: Are paired comparisons necessary? In A , 1989 .

[123]  R. Davidson.  EEG measures of cerebral asymmetry: conceptual and methodological issues. , 1988, The International journal of neuroscience.

[124]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[125]  F. T. Eggemeier.  Properties of Workload Assessment Techniques , 1988 .

[126]  P. Hancock,et al.  Adaptive control in human-machine systems , 1987 .

[127]  P. Hancock.  Human Factors Psychology , 1987 .

[128]  Richard W. Moss,et al.  2010: The Symbionic Cockpit , 1986, IEEE Aerospace and Electronic Systems Magazine.

[129]  Daniel Gopher,et al.  Workload: An examination of the concept. , 1986 .

[130]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[131]  William B. Rouse,et al.  Adaptive Aiding for Human-Computer Control: Experimental Studies of Dynamic Task Allocation. , 1986 .

[132]  A. D. Fisk,et al.  The effects of practice and task structure on components of the event-related brain potential. , 1986, Psychophysiology.

[133]  G Vossel,et al.  Electrodermal habituation speed and visual monitoring performance. , 1984, Psychophysiology.

[134]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[135]  Marta Kutas,et al.  Event-Related Brain Potentials in the Study of Consciousness , 1983 .

[136]  Frank E. Gomer,et al.  Physiological Monitoring and the Concept of Adaptive Systems , 1981 .

[137]  C W Sem-Jacobsen,et al.  Brain/computer communication to reduce human error: a perspective. , 1981, Aviation, space, and environmental medicine.

[138]  E. Donchin.  Event-related Brain Potentials: A Tool in the Study of Human Information Processing , 1979 .

[139]  E. Donchin,et al.  COGNITIVE PSYCHOPHYSIOLOGY: THE ENDOGENOUS COMPONENTS OF THE ERP , 1978 .

[140]  E. Donchin.  Multivariate analysis of event-related potential data: A tutorial review , 1978 .

[141]  James F. O'Hanlon,et al.  Concurrence of Electroencephalographic and Performance Changes During a Simulated Radar Watch and Some Implications for the Arousal Theory of Vigilance , 1977 .

[142]  Earl A. Alluisi,et al.  Effects of Temporal Stressors on Vigilance and Information Processing , 1977 .

[143]  E C Beck,et al.  Electrophysiology and behavior. , 1975, Annual review of psychology.

[144]  J P Krol,et al.  Towards an objective assessment of cockpit workload. I. Physiological variables during different flight phases. , 1973, Aerospace medicine.

[145]  D. Kahneman,et al.  Attention and Effort , 1973 .

[146]  D. Kahneman,et al.  Pupillary, heart rate, and skin resistance changes during a mental task. , 1969, Journal of experimental psychology.

[147]  K. Nakajima.  The electroencephalogram. , 1968, Developmental medicine and child neurology.

[148]  H. Jasper.  Report of the committee on methods of clinical examination in electroencephalography , 1958 .