Vision in the natural world.

Historically, the study of visual perception has followed a reductionist strategy, with the goal of understanding complex visually guided behavior by separate analysis of its elemental components. Recent developments in monitoring behavior, such as measurement of eye movements in unconstrained observers, have allowed investigation of the use of vision in the natural world. This has led to a variety of insights that would be difficult to achieve in more constrained experimental contexts. In general, it shifts the focus of vision away from the properties of the stimulus toward a consideration of the behavioral goals of the observer. It appears that behavioral goals are a critical factor in controlling the acquisition of visual information from the world. This insight has been accompanied by a growing understanding of the importance of reward in modulating the underlying neural mechanisms and by theoretical developments using reinforcement learning models of complex behavior. These developments provide us with the tools to understanding how tasks are represented in the brain, and how they control acquisition of information through use of gaze. WIREs Cogni Sci 2011 2 158-166 DOI: 10.1002/wcs.113 For further resources related to this article, please visit the WIREs website.

[1]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[2]  Kae Nakamura,et al.  Basal ganglia orient eyes to reward. , 2006, Journal of neurophysiology.

[3]  M F Land,et al.  The knowledge base of the oculomotor system. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  Alan D. Baddeley,et al.  Attention: Selection, Awareness, and Control , 1993 .

[5]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[6]  W. Schultz.  Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[7]  J. Schall,et al.  Performance monitoring by the supplementary eye ® eld , 2000 .

[8]  A. Baddeley,et al.  Attention : selection, awareness, and control : a tribute to Donald Broadbent , 1996 .

[9]  M. Carrasco,et al.  PSYCHOLOGICAL SCIENCE Research Article Voluntary Attention Enhances Contrast Appearance , 2022 .

[10]  R. Desimone,et al.  Attention Increases Sensitivity of V4 Neurons , 2000, Neuron.

[11]  Mary Hayhoe,et al.  Visually-guided behavior of homonymous hemianopes in a naturalistic task , 2007, Vision Research.

[12]  D. Ballard,et al.  What you see is what you need. , 2003, Journal of vision.

[13]  Michael S Landy,et al.  Combining Priors and Noisy Visual Cues in a Rapid Pointing Task , 2006, The Journal of Neuroscience.

[14]  David C. Knill,et al.  Learning to behave optimally in a probabilistic environment , 2010 .

[15]  J. Todd,et al.  The effects of viewing angle, camera angle, and sign of surface curvature on the perception of three-dimensional shape from texture. , 2007, Journal of vision.

[16]  Yiannis Aloimonos,et al.  Active vision , 2004, International Journal of Computer Vision.

[17]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[18]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[19]  Jason A. Droll,et al.  Task demands control acquisition and storage of visual information. , 2005, Journal of experimental psychology. Human perception and performance.

[20]  Dana H. Ballard,et al.  Modular models of task based visually guided behavior , 2009 .

[21]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[22]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[23]  P. Glimcher,et al.  Activity in Posterior Parietal Cortex Is Correlated with the Relative Subjective Desirability of Action , 2004, Neuron.

[24]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[25]  M. Hayhoe,et al.  Use of multiple preferred retinal loci in Stargardt’s disease during natural tasks: a case study * , 2008, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[26]  J. Pelz,et al.  Oculomotor behavior and perceptual strategies in complex tasks , 2001, Vision Research.

[27]  Kristin C. Scott,et al.  A Heterochromatin Barrier Partitions the Fission Yeast Centromere into Discrete Chromatin Domains , 2006, Current Biology.

[28]  M. Land.  Eye Movements in Daily Life , 2003 .

[29]  Jeff B. Pelz,et al.  Building a lightweight eyetracking headgear , 2004, ETRA.

[30]  G. Underwood,et al.  Visual Search of Dynamic Scenes , 1998 .

[31]  M. Pickering,et al.  Eye guidance in reading and scene perception , 1998 .

[32]  J. Schall,et al.  Executive control of countermanding saccades by the supplementary eye field , 2006, Nature Neuroscience.

[33]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[34]  M. Hayhoe,et al.  Adaptive Gaze Control in Natural Environments , 2009, The Journal of Neuroscience.

[35]  Dana H. Ballard,et al.  Modeling embodied visual behaviors , 2007, TAP.

[36]  Jeff B. Pelz,et al.  Head movement estimation for wearable eye tracker , 2004, ETRA.

[37]  Michael S Landy,et al.  Statistical decision theory and the selection of rapid, goal-directed movements. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[38]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[39]  P. Glimcher.  The neurobiology of visual-saccadic decision making. , 2003, Annual review of neuroscience.

[40]  Michael L. Platt,et al.  Monkeys Pay Per View: Adaptive Valuation of Social Images by Rhesus Macaques , 2005, Current Biology.

[41]  S. Ullman.  Visual routines , 1984, Cognition.

[42]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[43]  L. Chalupa,et al.  The visual neurosciences , 2004 .

[44]  Victor A. F. Lamme,et al.  The implementation of visual routines , 2000, Vision Research.

[45]  R. Johansson,et al.  Eye–Hand Coordination in Object Manipulation , 2001, The Journal of Neuroscience.

[46]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[47]  Stephen V. Shepherd,et al.  Social status gates social attention in monkeys , 2006, Current Biology.

[48]  J. Theeuwes,et al.  Attentional and oculomotor capture , 2001 .

[49]  W. Newsome,et al.  Matching Behavior and the Representation of Value in the Parietal Cortex , 2004, Science.