Feature-based attention and spatial selection in frontal eye fields during natural scene search.

When we search for visual objects, the features of those objects bias our attention across the visual landscape (feature-based attention). The brain uses these top-down cues to select eye movement targets (spatial selection). The frontal eye field (FEF) is a prefrontal brain region implicated in selecting eye movements and is thought to reflect feature-based attention and spatial selection. Here, we study how FEF facilitates attention and selection in complex natural scenes. We ask whether FEF neurons facilitate feature-based attention by representing search-relevant visual features or whether they are primarily involved in selecting eye movement targets in space. We show that search-relevant visual features are weakly predictive of gaze in natural scenes and additionally have no significant influence on FEF activity. Instead, FEF activity appears to primarily correlate with the direction of the upcoming eye movement. Our result demonstrates a concrete need for better models of natural scene search and suggests that FEF activity during natural scene search is explained primarily by spatial selection.

[1]  Ali Borji,et al.  Quantitative Analysis of Human-Model Agreement in Visual Saliency Modeling: A Comparative Study , 2013, IEEE Transactions on Image Processing.

[2]  N. P. Bichot,et al.  Dissociation of visual discrimination from saccade programming in macaque frontal eye field. , 1997, Journal of neurophysiology.

[3]  Jeffrey D. Schall,et al.  Neural basis of saccade target selection in frontal eye field during visual search , 1993, Nature.

[4]  N. P. Bichot,et al.  Visual feature selectivity in frontal eye fields induced by experience in mature macaques , 1996, Nature.

[5]  S. Kennerley,et al.  Evaluating choices by single neurons in the frontal lobe: outcome value encoded across multiple decision variables , 2009, The European journal of neuroscience.

[6]  H. Basford,et al.  Optimal eye movement strategies in visual search , 2005 .

[7]  Pierre-Yves Oudeyer,et al.  Information-seeking, curiosity, and attention: computational and neural mechanisms , 2013, Trends in Cognitive Sciences.

[8]  Adam N. Phillips,et al.  Predictive activity in macaque frontal eye field neurons during natural scene searching. , 2010, Journal of neurophysiology.

[9]  C. Bruce,et al.  Primate frontal eye fields. II. Physiological and anatomical correlates of electrically evoked eye movements. , 1985, Journal of neurophysiology.

[10]  Konrad Kording,et al.  Modeling peripheral visual acuity enables discovery of gaze strategies at multiple time scales during natural scene search. , 2015, Journal of vision.

[11]  N. P. Bichot,et al.  Effects of similarity and history on neural mechanisms of visual selection , 1999, Nature Neuroscience.

[12]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[13]  Jonathan Kennedy,et al.  Adaptation to space and to time , 2010 .

[14]  Eero P. Simoncelli,et al.  Orientation statistics at fixation , 2010 .

[15]  M. Schlag-Rey,et al.  How the frontal eye field can impose a saccade goal on superior colliculus neurons. , 1992, Journal of neurophysiology.

[16]  J. Schall,et al.  Neural selection and control of visually guided eye movements. , 1999, Annual review of neuroscience.

[17]  Lance M. Optican,et al.  Unix-based multiple-process system, for real-time data acquisition and control , 1982 .

[18]  Dorita H. F. Chang,et al.  Characterizing global and local mechanisms in biological motion perception. , 2009, Journal of vision.

[19]  Matthew H Tong,et al.  SUN: Top-down saliency using natural statistics , 2009, Visual cognition.

[20]  Takashi R Sato,et al.  Neuronal Basis of Covert Spatial Attention in the Frontal Eye Field , 2005, The Journal of Neuroscience.

[21]  Robert Desimone,et al.  Feature-Based Attention in the Frontal Eye Field and Area V4 during Visual Search , 2011, Neuron.

[22]  C. Bruce,et al.  Primate frontal eye fields. III. Maintenance of a spatially accurate saccade signal. , 1990, Journal of neurophysiology.

[23]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[24]  Rajesh P. N. Rao,et al.  PSYCHOLOGICAL SCIENCE Research Article EYE MOVEMENTS REVEAL THE SPATIOTEMPORAL DYNAMICS OE VISUAL SEARCH , 2022 .

[25]  T. Moore,et al.  Microstimulation of the frontal eye field and its effects on covert spatial attention. , 2004, Journal of neurophysiology.

[26]  Tirin Moore,et al.  Attention Governs Action in the Primate Frontal Eye Field , 2007, Neuron.

[27]  Hidehiko Komatsu,et al.  A grid system and a microsyringe for single cell recording , 1988, Journal of Neuroscience Methods.

[28]  J. Schall,et al.  Saccade target selection in frontal eye field of macaque. I. Visual and premovement activation , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  M. Segraves,et al.  Primate frontal eye field activity during natural scanning eye movements. , 1994, Journal of neurophysiology.

[30]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[31]  Alan C. Bovik,et al.  Image features that draw fixations , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[32]  Ian H. Stevenson,et al.  Saliency and saccade encoding in the frontal eye field during natural scene search. , 2014, Cerebral cortex.

[33]  N. P. Bichot,et al.  A Source for Feature-Based Attention in the Prefrontal Cortex , 2015, Neuron.

[34]  Wilson S. Geisler,et al.  Real-time foveated multiresolution system for low-bandwidth video communication , 1998, Electronic Imaging.

[35]  J. Wolfe,et al.  Guided Search 2.0 A revised model of visual search , 1994, Psychonomic bulletin & review.

[36]  N. P. Bichot,et al.  A visual salience map in the primate frontal eye field. , 2005, Progress in brain research.

[37]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[38]  J. Findlay Global visual processing for saccadic eye movements , 1982, Vision Research.

[39]  David Ferrier,et al.  The Croonian lecture, experiments on the brain of monkeys (second series) , 1875, Proceedings of the Royal Society of London.

[40]  Takashi R Sato,et al.  Effects of Stimulus-Response Compatibility on Neural Selection in Frontal Eye Field , 2003, Neuron.

[41]  J D Schall,et al.  Dynamic dissociation of visual selection from saccade programming in frontal eye field. , 2001, Journal of neurophysiology.

[42]  Jeffrey D Schall,et al.  On the role of frontal eye field in guiding attention and saccades , 2004, Vision Research.

[43]  G. Zelinsky A theory of eye movements during target acquisition. , 2008, Psychological review.

[44]  E. Miller,et al.  Serial, Covert Shifts of Attention during Visual Search Are Reflected by the Frontal Eye Fields and Correlated with Population Oscillations , 2009, Neuron.

[45]  L. Itti,et al.  Quantifying center bias of observers in free viewing of dynamic natural scenes. , 2009, Journal of vision.

[46]  George L. Malcolm,et al.  The effects of target template specificity on visual search in real-world scenes: evidence from eye movements. , 2009, Journal of vision.

[47]  Trevor Hastie,et al.  Regularization Paths for Generalized Linear Models via Coordinate Descent. , 2010, Journal of statistical software.

[48]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .