Vision Using Routines: A Functional Account of Vision

This paper presents the case for a functional account of vision. A variety of studies have consistently revealed “change blindness” or insensitivity to changes in the visual scene during an eye movement. These studies indicate that only a small part of the information in the scene is represented in the brain from moment to moment. It is still unclear, however, exactly what is included in visual representations. This paper reviews experiments using an extended visuo-motor task, showing that display changes affect performance differently depending on the observer's place in the task. These effects are revealed by increases in fixation duration following a change. Different task-dependent increases suggest that the visual system represents only the information that is necessary for the immediate visual task. This allows a principled exploration of the stimulus properties that are included in the internal visual representation. The task specificity also has a more general implication that vision should be conceptualized as an active process executing special purpose “routines” that compute only the currently necessary information. Evidence for this view and its implications for visual representations are discussed. Comparison of the change blindness phenomenon and fixation durations shows that conscious report does not reveal the extent of the representations computed by the routines.

[1]  U. Neisser VISUAL SEARCH. , 1964, Scientific American.

[2]  Daniel G Bobrow,et al.  On data-limited and resource-limited processes , 1975, Cognitive Psychology.

[3]  M. Just,et al.  Eye fixations and cognitive processes , 1976, Cognitive Psychology.

[4]  O'Regan Jk,et al.  Integrating visual information from successive fixations: does trans-saccadic fusion exist? , 1983 .

[5]  J. O'Regan,et al.  Integrating visual information from successive fixations:Does trans-saccadic fusion exist? , 1983, Vision Research.

[6]  S. Ullman Visual routines , 1984, Cognition.

[7]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[8]  R. Bajcsy Active perception , 1988, Proc. IEEE.

[9]  A. Newell Unified Theories of Cognition , 1990 .

[10]  David E. Irwin,et al.  Visual memory and the perception of a stable visual environment , 1990, Perception & psychophysics.

[11]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[12]  Dana H. Ballard,et al.  Animate Vision--An Evolutionary Step in Computational Vision (視覚と画像工学--見る・見せる ) -- (コンピュ-タビジョンの新しい流れ) , 1991 .

[13]  David E. Irwin Information integration across saccadic eye movements , 1991, Cognitive Psychology.

[14]  M. Corbetta,et al.  Selective and divided attention during visual discriminations of shape, color, and speed: functional anatomy by positron emission tomography , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  Alexander Pollatsek,et al.  What Is Integrated Across Fixations , 1992 .

[16]  D H Ballard,et al.  Hand-eye coordination during sequential tasks. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[17]  K. Rayner Eye movements and visual cognition : scene perception and reading , 1992 .

[18]  J. O'Regan,et al.  Solving the "real" mysteries of visual perception: the world as an outside memory. , 1992, Canadian journal of psychology.

[19]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[20]  Rajesh P. N. Rao,et al.  An Active Vision Architecture Based on Iconic Representations , 1995, Artif. Intell..

[21]  J. Palmer Attention in Visual Search: Distinguishing Four Causes of a Set-Size Effect , 1995 .

[22]  W. Geisler,et al.  Separation of low-level and high-level factors in complex tasks: visual search. , 1995, Psychological review.

[23]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[24]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[25]  Ronald A. Rensink,et al.  Mud splashes render picture changes invisible , 1996 .

[26]  Andrew McCallum,et al.  Reinforcement learning with selective perception and hidden state , 1996 .

[27]  M F Land,et al.  The knowledge base of the oculomotor system. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[28]  E. DeYoe,et al.  Graded effects of spatial and featural attention on human area MT and associated motion processing areas. , 1997, Journal of neurophysiology.

[29]  Ronald A. Rensink,et al.  TO SEE OR NOT TO SEE: The Need for Attention to Perceive Changes in Scenes , 1997 .

[30]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[31]  Ken Nakayama,et al.  Attentional requirements in a ‘preattentive’ feature search task , 1997, Nature.

[32]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[33]  Rajesh P. N. Rao,et al.  Dynamic Model of Visual Recognition Predicts Neural Response Properties in the Visual Cortex , 1997, Neural Computation.

[34]  Gregory D. Hager,et al.  The confluence of vision and control, Block Island Workshop on Vision and Control, June 23-27, 1997, Block Island, Rhode Island, USA , 1998, Block Island Workshop on Vision and Control.

[35]  D. Ballard,et al.  Task constraints in visual working memory , 1997, Vision Research.

[36]  Dana H. Ballard,et al.  Visual routines for autonomous driving , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[37]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[38]  G. Hager Visual Routines for Vehicle Control , 1998 .

[39]  C. Gilbert Adult cortical dynamics. , 1998, Physiological reviews.

[40]  G. Wallis,et al.  What's Scene and Not Seen: Influences of Movement and Task Upon What We See , 2000 .

[41]  K. Nakayama,et al.  On the Functional Role of Implicit Visual Memory for the Adaptive Deployment of Attention Across Scenes , 2000 .

[42]  Ronald A. Rensink,et al.  Picture Changes During Blinks: Looking Without Seeing and Seeing Without Looking , 2000 .

[43]  J. Wolfe Inattentional Amnesia , 2000 .

[44]  I. Thornton,et al.  Change Detection Without Awareness: Do Explicit Reports Underestimate the Representation of Change in the Visual System? , 2000 .

[45]  J. Meere The role of attention. , 2002 .