Scheduling mental operations in a multiple-response sequence: Modeling the effects of a strategy to minimise variance in the timing of saccades

Common tasks in daily life are often accomplished by a sequence of actions. For highly practiced tasks, such as reading or piano playing, the eyes routinely move to the next item in sequence before the response to the current item is made (eye hand span), evidence of overlap in the mental processing of successive stimuli. We (Wu & Remington, 2004) have previously presented data from a typing-like task following Pashler (1994) requiring separate choice responses to a series of five stimuli. We found a consistent pattern of results in both motor and ocular timing, and examined behavior under perceptual and central difficulty factors. Here we report a model of that task, which demonstrates how the observed timing of eye movements to successive stimuli could result from attempts to produce regular rhythmic output. The model makes two key assumptions about the generation of an eye movement to the next stimulus in a sequence. The first, dependence on perceptual encoding, asserts that the eyes remain fixated on the current stimulus until perceptual encoding is completed. The second, minimization of inter-movement time variability, asserts that people try to achieve a rhythmic regularity in motor performance, which includes the timing of eye movements. We discuss the conditions under which variance minimization might apply, and the implications for accounts that tie eye movements more directly to internal cognitive, perceptual, and motor operations.

[1]  T. Salthouse,et al.  Determinants of eye-fixation duration. , 1980, The American journal of psychology.

[2]  K. Rayner,et al.  Eye Movement Control during Reading: Evidence for Direct Control , 1981, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[3]  T. Salthouse Anticipatory processing in transcription typing. , 1985, The Journal of applied psychology.

[4]  T. Salthouse Perceptual, cognitive, and motoric aspects of transcription typing. , 1986, Psychological bulletin.

[5]  A. Inhoff,et al.  Encoding of text, manual movement planning, and eye-hand coordination during copytyping. , 1992, Journal of experimental psychology. Human perception and performance.

[6]  J. Vickers Gaze Control in Putting , 1992, Perception.

[7]  H. Pashler Overlapping Mental Operations in Serial Performance with Preview , 1994, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[8]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[9]  H. Collewijn,et al.  The function of visual search and memory in sequential looking tasks , 1995, Vision Research.

[10]  K. Rayner,et al.  Eye Movements, the Eye-Hand Span, and the Perceptual Span During Sight-Reading of Music , 1997 .

[11]  K. Rayner,et al.  The Perceptual Span and the Eye-Hand Span in Sight Reading Music , 1997 .

[12]  A. Gordon,et al.  Eye Movements and Eye-Hand Coordination During Typing , 1997 .

[13]  A. Sanders,et al.  Stimulus control of visual fixation duration in a single saccade paradigm. , 1998, Acta psychologica.

[14]  M. Land,et al.  The effects of skill on the eye–hand span during musical sight–reading , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[15]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[16]  M. Hayhoe,et al.  In what ways do eye movements contribute to everyday activities? , 2001, Vision Research.

[17]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[18]  R. Johansson,et al.  Engagement of gaze in capturing targets for future sequential manual actions. , 2002, Journal of neurophysiology.

[19]  Shu-Chieh Wu,et al.  Coordination of component mental operations in a multiple-response task , 2004, ETRA.

[20]  Michael Freed,et al.  Automating Human-Performance Modeling at the Millisecond Level , 2005, Hum. Comput. Interact..