Freedom and rules in human sequential performance: a refractory period in eye-hand coordination.

In action sequences, the eyes and hands ought to be coordinated in precise ways. The mechanisms governing the architecture of encoding and action of several effectors remain unknown. Here we study hand and eye movements in a sequential task in which letters have to be typed while they move down through the screen. We observe a strict refractory period of about 200 ms between the initiation of manual and eye movements. Subjects do not initiate a saccade just after typing and do not type just after making the saccade. This refractory period is observed ubiquitously in every subject and in each step of the sequential task, even when keystrokes and saccades correspond to different items of the sequence-for instance when a subject types a letter that has been gazed at in a preceding fixation. These results extend classic findings of dual-task paradigms, of a bottleneck tightly locked to the response selection process, to unbounded serial routines. Interestingly, while the bottleneck is seemingly inevitable, better performing subjects can adopt a strategy to minimize the cost of the bottleneck, overlapping the refractory period with the encoding of the next item in the sequence.

[1]  D. Sternad,et al.  Interactions between rhythmic and discrete components in a bimanual task. , 2003, Motor control.

[2]  D. Alan Allport,et al.  SHIFTING INTENTIONAL SET - EXPLORING THE DYNAMIC CONTROL OF TASKS , 1994 .

[3]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[4]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[5]  D. Robinson,et al.  The upper limit of human smooth pursuit velocity , 1985, Vision Research.

[6]  J. C. Johnston,et al.  Attentional limitations in dual-task performance. , 1998 .

[7]  Harold Pashler,et al.  Effects of practice on task architecture: Combined evidence from interference experiments and random-walk models of decision making , 2011, Cognition.

[8]  Shu-Chieh Wu,et al.  Coordination of component mental operations in a multiple-response task , 2004, ETRA.

[9]  Stanislas Dehaene,et al.  Limits on Introspection Distorted Subjective Time During the Dual-Task Bottleneck , 2008 .

[10]  M. Sigman,et al.  Parsing a Cognitive Task: A Characterization of the Mind's Bottleneck , 2005, PLoS biology.

[11]  H. Pashler.  Overlapping Mental Operations in Serial Performance with Preview , 1994, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[12]  M. Sigman,et al.  The human Turing machine: a neural framework for mental programs , 2011, Trends in Cognitive Sciences.

[13]  Lynn Huestegge,et al.  The role of saccades in multitasking: towards an output-related view of eye movements , 2011, Psychological research.

[14]  J. Henderson,et al.  CRISP: a computational model of fixation durations in scene viewing. , 2010, Psychological review.

[15]  J. C. Johnston,et al.  Vanishing dual-task interference after practice: has the bottleneck been eliminated or is it merely latent? , 2003, Journal of experimental psychology. Human perception and performance.

[16]  E. Stuyven,et al.  Parallel visual and memory processes , 1998, Documenta Ophthalmologica.

[17]  Christopher L. Asplund,et al.  A Unified attentional bottleneck in the human brain , 2011, Proceedings of the National Academy of Sciences.

[18]  Christopher L. Asplund,et al.  Isolation of a Central Bottleneck of Information Processing with Time-Resolved fMRI , 2006, Neuron.

[19]  C. W. Telford.  The refractory phase of voluntary and associative responses , 1931 .

[20]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[21]  H. Deubel,et al.  Dual-tasking: Is manual tapping independent of concurrently executed saccades? , 2009, Brain Research.

[22]  M. Sigman,et al.  Dynamics of the Central Bottleneck: Dual-Task and Task Uncertainty , 2006, PLoS biology.

[23]  U. Sailer,et al.  Spatial and temporal aspects of eye-hand coordination across different tasks , 2000, Experimental Brain Research.

[24]  E. Stuyven,et al.  The effect of cognitive load on saccadic eye movements. , 2000, Acta psychologica.

[25]  D E Kieras,et al.  A computational theory of executive cognitive processes and multiple-task performance: Part 1. Basic mechanisms. , 1997, Psychological review.

[26]  H Pashler,et al.  Processing stages in overlapping tasks: evidence for a central bottleneck. , 1984, Journal of experimental psychology. Human perception and performance.

[27]  T. Salthouse.  Perceptual, cognitive, and motoric aspects of transcription typing. , 1986, Psychological bulletin.

[28]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[29]  Eric Ruthruff,et al.  Dual-task performance with ideomotor-compatible tasks: is the central processing bottleneck intact, bypassed, or shifted in locus? , 2005, Journal of experimental psychology. Human perception and performance.

[30]  Carrick C. Williams,et al.  Searching for an O in an array of Cs: Eye movements track moment-to-moment processing in visual search , 2007, Perception & psychophysics.

[31]  H. Pashler,et al.  What determines saccade timing in sequences of coordinated eye and hand movements? , 2011, Psychonomic bulletin & review.

[32]  Mariano Sigman,et al.  From a single decision to a multi-step algorithm , 2012, Current Opinion in Neurobiology.

[33]  J. C. Johnston,et al.  How does practice reduce dual-task interference: Integration, automatization, or just stage-shortening? , 2006, Psychological research.

[34]  H. Pashler.  Dual-task interference in simple tasks: data and theory. , 1994, Psychological bulletin.

[35]  Stanislas Dehaene,et al.  Mapping introspection’s blind spot: Reconstruction of dual-task phenomenology using quantified introspection , 2010, Cognition.

[36]  J. C. Johnston,et al.  Chronometric Evidence for Central Postponement in Temporally Overlapping Tasks , 2003 .

[37]  R. Marois,et al.  Capacity limits of information processing in the brain , 2005, Trends in Cognitive Sciences.

[38]  Roger W. Remington,et al.  Coordination of Component Mental Operations in Sequences of Discrete Responses , 2004 .

[39]  C. J. Erkelens,et al.  PII: S0042-6989(97)00287-3 , 2003 .

[40]  Mariano Sigman,et al.  Looking at Breakout: Urgency and predictability direct eye events , 2011, Vision Research.

[41]  Erik D. Reichle,et al.  Toward a model of eye movement control in reading. , 1998, Psychological review.

[42]  A. Buizza,et al.  Velocity characteristics of smooth pursuit eye movements to different patterns of target motion , 2004, Experimental Brain Research.