Task demands control acquisition and storage of visual information.

Attention and working memory limitations set strict limits on visual representations, yet researchers have little appreciation of how these limits constrain the acquisition of information in ongoing visually guided behavior. Subjects performed a brick sorting task in a virtual environment. A change was made to 1 of the features of the brick being held on about 10% of trials. Rates of change detection for feature changes were generally low and depended on the pick-up and put-down relevance of the feature to the sorting task. Subjects' sorting decision suggests that changes may be missed because of a failure to update the changed feature. The authors also explore how hand and eye behavior are coordinated for strategic acquisition and storage of visual information throughout the task.

[1]  J. O. Urmson,et al.  The William James Lectures , 1963 .

[2]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[3]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[4]  G. E. Alexander,et al.  Neuron Activity Related to Short-Term Memory , 1971, Science.

[5]  R. Shiffrin,et al.  Controlled and automatic human information processing: I , 1977 .

[6]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[7]  Raja Parasuraman,et al.  Varieties of attention , 1984 .

[8]  J. Duncan.  Selective attention and the organization of visual information. , 1984, Journal of experimental psychology. General.

[9]  S. Ullman.  Visual routines , 1984, Cognition.

[10]  A. Treisman.  Features and Objects: The Fourteenth Bartlett Memorial Lecture , 1988, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[11]  A. Newell.  Unified Theories of Cognition , 1990 .

[12]  David E. Irwin.  Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[13]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[14]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[15]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[16]  J. Duncan.  Similarity between concurrent visual discriminations: Dimensions and objects , 1993, Perception & psychophysics.

[17]  K. Nakayama,et al.  Priming of pop-out: I. Role of features , 1994, Memory & cognition.

[18]  S. Yantis,et al.  Stimulus-driven attentional capture: evidence from equiluminant visual objects. , 1994, Journal of experimental psychology. Human perception and performance.

[19]  R. Desimone,et al.  Parallel neuronal mechanisms for short-term memory. , 1994, Science.

[20]  B. C. Motter,et al.  Neural correlates of feature selective memory and pop-out in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[21]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[22]  G. Brelstaff,et al.  Is the Richness of Our Visual World an Illusion? Transsaccadic Memory for Complex Scenes , 1995, Perception.

[23]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[24]  M. Potter,et al.  A two-stage model for multiple target detection in rapid serial visual presentation. , 1995, Journal of experimental psychology. Human perception and performance.

[25]  K. Nakayama,et al.  Priming of pop-out: II. The role of position , 1996, Perception & psychophysics.

[26]  D. E. Irwin,et al.  Integration and accumulation of information across saccadic eye movements. , 1996 .

[27]  J. Grimes.  On the failure to detect changes in scenes across saccades. , 1996 .

[28]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[29]  David E. Irwin,et al.  What’s in an object file? Evidence from priming studies , 1996, Perception & psychophysics.

[30]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[31]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[32]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[33]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[34]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[35]  D. Simons,et al.  Failure to detect changes to people during a real-world interaction , 1998 .

[36]  Sir G. Archaeopteryx.  Object-based attention in the primary visual cortex of the macaque monkey , 1998 .

[37]  E. Miller,et al.  Neural Activity in the Primate Prefrontal Cortex during Associative Learning , 1998, Neuron.

[38]  M. Chun,et al.  Contextual Cueing: Implicit Learning and Memory of Visual Context Guides Spatial Attention , 1998, Cognitive Psychology.

[39]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[40]  C. Gilbert,et al.  Attention Modulates Contextual Influences in the Primary Visual Cortex of Alert Monkeys , 1999, Neuron.

[41]  Ronald A. Rensink,et al.  Change-blindness as a result of ‘mudsplashes’ , 1999, Nature.

[42]  N. P. Bichot,et al.  Visuospatial attention: Beyond a spotlight model , 1999, Psychonomic bulletin & review.

[43]  S. Yantis,et al.  On the distinction between visual salience and stimulus-driven attentional capture. , 1999, Journal of experimental psychology. Human perception and performance.

[44]  J. Maunsell,et al.  Effects of Attention on the Processing of Motion in Macaque Middle Temporal and Medial Superior Temporal Visual Cortical Areas , 1999, The Journal of Neuroscience.

[45]  C. Chabris,et al.  Gorillas in Our Midst: Sustained Inattentional Blindness for Dynamic Events , 1999, Perception.

[46]  Ronald A. Rensink.  The Dynamic Representation of Scenes , 2000 .

[47]  J. Maunsell,et al.  Attention to both space and feature modulates neuronal responses in macaque area V4. , 2000, Journal of neurophysiology.

[48]  Ronald A. Rensink.  Seeing, sensing, and scrutinizing , 2000, Vision Research.

[49]  G. Woodman,et al.  Event-related potential studies of attention , 2000, Trends in Cognitive Sciences.

[50]  M. Hayhoe.  Vision Using Routines: A Functional Account of Vision , 2000 .

[51]  Victor A. F. Lamme,et al.  The implementation of visual routines , 2000, Vision Research.

[52]  D. Heeger,et al.  Task-related modulation of visual cortex. , 2000, Journal of neurophysiology.

[53]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[54]  Daniel J. Simons,et al.  Current Approaches to Change Blindness , 2000 .

[55]  I. Thornton,et al.  An implicit measure of undetected change. , 2000, Spatial vision.

[56]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[57]  M. Hayhoe,et al.  What controls attention in natural environments? , 2001, Vision Research.

[58]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[59]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[60]  J. C. Johnston,et al.  Attention and performance. , 2001, Annual review of psychology.

[61]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[62]  C. Gilbert,et al.  Learning to see: experience and attention in primary visual cortex , 2001, Nature Neuroscience.

[63]  C. Frith,et al.  Neural correlates of change detection and change blindness , 2001, Nature Neuroscience.

[64]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[65]  Steven B. Most,et al.  How not to be Seen: The Contribution of Similarity and Selective Ignoring to Sustained Inattentional Blindness , 2001, Psychological science.

[66]  A. Noë,et al.  A sensorimotor account of vision and visual consciousness. , 2001, The Behavioral and brain sciences.

[67]  Laurence R. Harris,et al.  Vision and Attention , 2001 .

[68]  M. Jenkin,et al.  Change Blindness: Implications for the Nature of Visual Attention , 2001 .

[69]  Stephen R Mitroff,et al.  The siren song of implicit change detection. , 2002, Journal of experimental psychology. Human perception and performance.

[70]  P. Dayan,et al.  Reward, Motivation, and Reinforcement Learning , 2002, Neuron.

[71]  Jochen Triesch,et al.  Saccade contingent updating in virtual reality , 2002, ETRA.

[72]  D. E. Irwin,et al.  Eye movements and scene perception: Memory for things observed , 2002, Perception & psychophysics.

[73]  Bonnie L. Angelone,et al.  Memory for centrally attended changing objects in an incidental real-world change detection paradigm. , 2002, British journal of psychology.

[74]  Ian M Thornton,et al.  Converging evidence for the detection of change without awareness. , 2002, Progress in brain research.

[75]  J. Henderson,et al.  Accurate visual memory for previously attended objects in natural scenes , 2002 .

[76]  Brian J. Scholl.  Objects and attention , 2002 .

[77]  A. Treisman,et al.  Binding in short-term visual memory. , 2002, Journal of experimental psychology. General.

[78]  J. Hoffman,et al.  Spatial breakdown in spatial construction: Evidence from eye fixations in children with Williams syndrome , 2003, Cognitive Psychology.

[79]  D. Ballard,et al.  What you see is what you need. , 2003, Journal of vision.

[80]  Ian M Thornton,et al.  Explicit mechanisms do not account for implicit localization and identification of change: An empirical reply to Mitroff et al. (2002). , 2002, Journal of experimental psychology. Human perception and performance.

[81]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[82]  Pieter R Roelfsema,et al.  Subtask sequencing in the primary visual cortex , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[83]  Derrick J. Parkhurst,et al.  Scene content selected by active vision. , 2003, Spatial vision.

[84]  S. Yantis,et al.  Cortical mechanisms of space-based and object-based attentional control , 2003, Current Opinion in Neurobiology.

[85]  Jun Saiki,et al.  Feature binding in object-file representations of multiple moving items. , 2003, Journal of vision.

[86]  I. Rock,et al.  Inattentional blindness: An overview , 2003 .

[87]  David J. Heeger,et al.  Neuronal correlates of perception in early visual cortex , 2003, Nature Neuroscience.

[88]  M. Chun,et al.  The Neural Fate of Consciously Perceived and Missed Events in the Attentional Blink , 2004, Neuron.

[89]  Smadar Birnboim,et al.  The Automatic and Controlled Information-Processing Dissociation: Is It Still Relevant? , 2003, Neuropsychology Review.

[90]  C. Heywood,et al.  Visual salience in the change detection paradigm: the special role of object onset. , 2004, Journal of experimental psychology. Human perception and performance.

[91]  A. Hollingworth.  Constructing visual representations of natural scenes: the roles of short- and long-term visual memory. , 2004, Journal of experimental psychology. Human perception and performance.

[92]  C. Gilbert,et al.  Perceptual learning and top-down influences in primary visual cortex , 2004, Nature Neuroscience.

[93]  Derrick J. Parkhurst,et al.  Texture contrast attracts overt visual attention in natural scenes , 2004, The European journal of neuroscience.

[94]  B. Hommel.  Event files: feature binding in and across perception and action , 2004, Trends in Cognitive Sciences.

[95]  Steven B. Most,et al.  What you see is what you set: sustained inattentional blindness and the capture of awareness. , 2005, Psychological review.

[96]  D. Ballard,et al.  Modeling Attention with Embodied Visual Behaviors , 2005 .