Eye Activity Correlates of Workload during a Visuospatial Memory Task

Changes in six measures of eye activity were assessed as a function of task workload in a target identification memory task. Eleven participants completed four 2hr blocks of a mock anti-air-warfare task, in which they were required to examine and remember target classifications (friend/enemy) for subsequent prosecution (fire upon/allow to pass), while targets moved steadily toward two centrally located ship icons. Target density served as the task workload variable; between one and nine targets were simultaneously present on the display. For each participant, moving estimates of blink frequency and duration, fixation frequency and dwell time, saccadic extent, and mean pupil diameter, integrated over periods of 10 to 20 s, demonstrated systematic changes as a function of target density. Nonlinear regression analyses found blink frequency, fixation frequency, and pupil diameter to be the most predictive variables relating eye activity to target density Participant-specific artificial neural network models, developed through training on two or three sessions and subsequently tested on a different session from the same participant, correlated well with actual target density levels (mean R = 0.66). Results indicate that moving mean estimation and artificial neural network techniques enable information from multiple eye measures to be combined to produce reliable near-real-time indicators of workload in some visuospatial tasks. Potential applications include the monitoring of visual activity of system operators for indications of visual workload and scanning efficiency.

[1]  L. Walrath,et al.  Eye movement and pupillary response indices of mental workload during visual search of symbolic displays. , 1992, Applied ergonomics.

[2]  Karl F. Van Orden,et al.  Assessment of Variable Coded Symbology Using Visual Search Performance and Eye Fixation Measures , 1998 .

[3]  Glenn F. Wilson,et al.  Psychophysiological responses to changes in workload during simulated air traffic control , 1996, Biological Psychology.

[4]  T. Sejnowski,et al.  Estimating alertness from the EEG power spectrum , 1997, IEEE Transactions on Biomedical Engineering.

[5]  Michael E. Smith,et al.  Monitoring Working Memory Load during Computer-Based Tasks with EEG Pattern Recognition Methods , 1998, Hum. Factors.

[6]  Ruth Kanfer,et al.  Improving Problem-Solving and Decision-Making Skills Under Stress: Prediction and Training. , 1994 .

[7]  E. Granholm,et al.  Pupillary responses index cognitive resource limitations. , 1996, Psychophysiology.

[8]  Z Katoh,et al.  Saccade amplitude as a discriminator of flight types. , 1997, Aviation, space, and environmental medicine.

[9]  Daniel J. Callan Eye Movement Relationships to Excessive Performance Error in Aviation , 1998 .

[10]  Y Itoh,et al.  The ergonomic evaluation of eye movement and mental workload in aircraft pilots. , 1990, Ergonomics.

[11]  John E. Deaton,et al.  Theory and Design of Adaptive Automation in Aviation Systems , 1992 .

[12]  Rajesh P. N. Rao,et al.  PSYCHOLOGICAL SCIENCE Research Article EYE MOVEMENTS REVEAL THE SPATIOTEMPORAL DYNAMICS OE VISUAL SEARCH , 2022 .

[13]  R. Parasuraman,et al.  Psychophysiology and adaptive automation , 1996, Biological Psychology.

[14]  J. Beatty,et al.  Pupillometric signs of brain activation vary with level of cognitive processing. , 1978, Science.

[15]  S. Makeig,et al.  Lapses in alertness: coherence of fluctuations in performance and EEG spectrum. , 1993, Electroencephalography and clinical neurophysiology.

[16]  M. Just,et al.  The intensity dimension of thought: pupillometric indices of sentence processing. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[17]  G F Wilson,et al.  Evoked potential, cardiac, blink, and respiration measures of pilot workload in air-to-ground missions. , 1994, Aviation, space, and environmental medicine.

[18]  Hankins Tc,et al.  A comparison of heart rate, eye activity, EEG and subjective measures of pilot mental workload during flight. , 1998, Aviation, space, and environmental medicine.

[19]  J. Stern,et al.  Eye movements and blinks: their relationship to higher cognitive processes. , 1989, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[20]  T. Jung,et al.  Combined eye activity measures accurately estimate changes in sustained visual task performance , 2000, Biological Psychology.

[21]  J. Veltman,et al.  Physiological workload reactions to increasing levels of task difficulty. , 1998, Ergonomics.

[22]  Jin Liu,et al.  An Experimental Multimedia System Allowing 3-D Visualization and Eye-Controlled Interaction Without User-Worn Devices , 1999, IEEE Trans. Multim..