Control of attention and gaze in complex environments.

In natural behavior, fixation patterns are tightly linked to the ongoing task. However, a critical problem for task-driven systems is dealing with unexpected stimuli. We studied the effect of unexpected potential collisions with pedestrians on the distribution of gaze of subjects walking in a virtual environment. Pedestrians on a collision course with the subject were surprisingly ineffective in evoking fixations, especially when subjects were additionally occupied with another task, suggesting that potential collisions do not automatically attract attention. However, prior fixations on pedestrians did increase collision detection performance. Additionally, the detection of potential collisions led to a short-term change in the strategy of looking at subsequent pedestrians. The overall pattern of results is consistent with the hypothesis that subjects typically rely on mechanisms that are initiated top-down to detect unexpected events such as potential collisions. For this to be effective, subjects must learn an appropriate schedule for initiating search through experience with the probabilities of environmental events.

[1]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[2]  Brian J. Scholl,et al.  PSYCHE an interdisciplinary journal of research on consciousness Sustained Inattentional Blindness : The Role of Location in the Detection of Unexpected Dynamic Events , 2000 .

[3]  C D Frith,et al.  Modulating irrelevant motion perception by varying attentional load in an unrelated task. , 1997, Science.

[4]  Victor A. F. Lamme,et al.  The implementation of visual routines , 2000, Vision Research.

[5]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[6]  P Reinagel,et al.  Natural scene statistics at the centre of gaze. , 1999, Network.

[7]  M. Land,et al.  The Roles of Vision and Eye Movements in the Control of Activities of Daily Living , 1998, Perception.

[8]  B. Gibson,et al.  Visual quality and attentional capture: a challenge to the special role of abrupt onsets. , 1996, Journal of experimental psychology. Human perception and performance.

[9]  O. Hikosaka,et al.  Role of the basal ganglia in the control of purposive saccadic eye movements. , 2000, Physiological reviews.

[10]  Bradley S. Gibson,et al.  Stimulus-Driven Attentional Capture Is Contingent on Attentional Set for Displaywide Visual Features , 1998 .

[11]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[12]  C. Chabris,et al.  Gorillas in Our Midst: Sustained Inattentional Blindness for Dynamic Events , 1999, Perception.

[13]  G. Hauske,et al.  Object and scene analysis by saccadic eye-movements: an investigation with higher-order statistics. , 2000, Spatial vision.

[14]  D. Ballard,et al.  Memory Representations in Natural Tasks , 1995, Journal of Cognitive Neuroscience.

[15]  D. S. Wooding,et al.  Fixation Patterns Made during Brief Examination of Two-Dimensional Images , 1997, Perception.

[16]  Nancy Millette,et al.  How People Look at Pictures , 1935 .

[17]  R. Wurtz,et al.  Response of monkey MST neurons to optic flow stimuli with shifted centers of motion , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[18]  G. Wallis,et al.  What's Scene and Not Seen: Influences of Movement and Task Upon What We See , 2000 .

[19]  S. McKee,et al.  The detection of motion in the peripheral visual field , 1984, Vision Research.

[20]  R W Remington,et al.  The structure of attentional control: contingent attentional capture by apparent motion, abrupt onset, and color. , 1994, Journal of experimental psychology. Human perception and performance.

[21]  Antonio Torralba,et al.  Modeling global scene factors in attention. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[22]  Jason A. Droll,et al.  Task demands control acquisition and storage of visual information. , 2005, Journal of experimental psychology. Human perception and performance.

[23]  J. Theeuwes,et al.  Attentional and oculomotor capture with static singletons , 2003, Perception & psychophysics.

[24]  J. Tresilian.  Visually timed action: time-out for ‘tau’? , 1999, Trends in Cognitive Sciences.

[25]  S. Yantis,et al.  Stimulus-driven attentional capture: evidence from equiluminant visual objects. , 1994, Journal of experimental psychology. Human perception and performance.

[26]  R. Regan,et al.  The detection of , 1973 .

[27]  P. Dean,et al.  Use of a Distracting Task to Obtain Defensive Head Movements to Looming Visual Stimuli by Human Adults in a Laboratory Setting , 1992, Perception.

[28]  D. Ballard,et al.  Eye movements in natural behavior , 2005, Trends in Cognitive Sciences.

[29]  D. Simons,et al.  Moving and looming stimuli capture attention , 2003, Perception & psychophysics.

[30]  E. Viding,et al.  Load theory of selective attention and cognitive control. , 2004, Journal of experimental psychology. General.

[31]  B. Gibson,et al.  Attraction, Distraction and Action: Multiple Perspectives on Attentional Capture. Advances in Psychology , 2001 .

[32]  D. E. Irwin,et al.  Our Eyes do Not Always Go Where we Want Them to Go: Capture of the Eyes by New Objects , 1998 .

[33]  J. Henderson,et al.  Object appearance, disappearance, and attention prioritization in real-world scenes , 2005, Psychonomic bulletin & review.

[34]  J. Akinsanya.  The knowledge base. , 1981, Nursing times.

[35]  Benjamin Y. Hayden,et al.  Temporal Discounting Predicts Risk Sensitivity in Rhesus Macaques , 2007, Current Biology.

[36]  Valentina V. Kuskova,et al.  Inappropriate capture by diversionary dynamic elements , 2002 .

[37]  Dana H. Ballard,et al.  Bayesian modeling of task dependent visual attention strategy in a virtual reality environment , 2005 .

[38]  N. Lavie.  Distracted and confused?: Selective attention under load , 2005, Trends in Cognitive Sciences.

[39]  J. Henderson.  Human gaze control during real-world scene perception , 2003, Trends in Cognitive Sciences.

[40]  Derrick J. Parkhurst,et al.  Scene content selected by active vision. , 2003, Spatial vision.

[41]  Rajesh P. N. Rao,et al.  Eye movements in iconic visual search , 2002, Vision Research.

[42]  I Rock,et al.  Inattentional Blindness as a Function of Proximity to the Focus of Attention , 1998, Perception.

[43]  R. Dolan,et al.  Effects of Attention and Emotion on Face Processing in the Human Brain An Event-Related fMRI Study , 2001, Neuron.

[44]  M F Land,et al.  The knowledge base of the oculomotor system. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[45]  Dana H. Ballard,et al.  Modeling embodied visual behaviors , 2007, TAP.

[46]  Antonio Torralba,et al.  Top-down control of visual attention in object detection , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[47]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[48]  M. Hayhoe.  Vision Using Routines: A Functional Account of Vision , 2000 .

[49]  Bradley S. Gibson,et al.  THE MASKING ACCOUNT OF ATTENTIONAL CAPTURE : A REPLY TO YANTIS AND JONIDES(1996) , 1996 .

[50]  W. Schultz.  Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[51]  J. Findlay,et al.  Active Vision: The Psychology of Looking and Seeing , 2003 .

[52]  B. Gibson,et al.  Stimulus-driven attentional capture is contingent on attentional set for displaywide visual features. , 1998, Journal of experimental psychology. Human perception and performance.

[53]  Michael F. Land,et al.  From eye movements to actions: how batsmen hit the ball , 2000, Nature Neuroscience.

[54]  D. Ballard,et al.  What you see is what you need. , 2003, Journal of vision.

[55]  D. Regan,et al.  Visually guided collision avoidance and collision achievement , 2000, Trends in Cognitive Sciences.

[56]  J. Theeuwes.  Stimulus-driven capture and attentional set: selective search for color and visual abrupt onsets. , 1994, Journal of experimental psychology. Human perception and performance.

[57]  A. L. I︠A︡rbus.  Eye Movements and Vision , 1967 .

[58]  K. Turano,et al.  Direction of Gaze while Walking a Simple Route: Persons with Normal Vision and Persons with Retinitis Pigmentosa , 2001, Optometry and vision science : official publication of the American Academy of Optometry.

[59]  O. Mimura.  [Eye movements]. , 1992, Nippon Ganka Gakkai zasshi.

[60]  G. Woodman,et al.  Neural fate of ignored stimuli: dissociable effects of perceptual and working memory load , 2004, Nature Neuroscience.

[61]  J. Theeuwes.  Perceptual selectivity for color and form , 1992, Perception & psychophysics.

[62]  M. Hayhoe,et al.  What controls attention in natural environments? , 2001, Vision Research.

[63]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[64]  Jonathan D. Cohen,et al.  Computational roles for dopamine in behavioural control , 2004, Nature.

[65]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[66]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[67]  C. Frith,et al.  Inattentional blindness versus inattentional amnesia for fixated but ignored words. , 1999, Science.

[68]  Derrick J. Parkhurst,et al.  Modeling the role of salience in the allocation of overt visual attention , 2002, Vision Research.

[69]  Mary M Hayhoe,et al.  Visual memory and motor planning in a natural task. , 2003, Journal of vision.

[70]  Dana H. Ballard,et al.  Eye Movements for Reward Maximization , 2003, NIPS.

[71]  S. Ullman.  Visual routines , 1984, Cognition.

[72]  D. Ballard,et al.  Modeling Attention with Embodied Visual Behaviors , 2005 .

[73]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[74]  Steven B. Most,et al.  How not to be Seen: The Contribution of Similarity and Selective Ignoring to Sustained Inattentional Blindness , 2001, Psychological science.

[75]  S. Yantis,et al.  Uniqueness of abrupt visual onset in capturing attention , 1988, Perception & psychophysics.

[76]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[77]  Christopher M. Brown,et al.  Control of selective perception using bayes nets and decision theory , 1994, International Journal of Computer Vision.

[78]  P. McCormick.  Orienting attention without awareness. , 1997, Journal of experimental psychology. Human perception and performance.

[79]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[80]  I. Rock,et al.  Inattentional blindness: Perception without attention. , 1998 .

[81]  K. Turano,et al.  Oculomotor strategies for the direction of gaze tested with a real-world activity , 2003, Vision Research.