Neuronal dynamics of bottom-up and top-down processes in area V4 of macaque monkeys performing a visual search

Visual selection is thought to be guided by both bottom-up intrinsic visual saliency and top-down visual attention. We examined how the relative importance of each of these processes dynamically changes over the course of a visual search in area V4 of two macaque monkeys. The animals were trained to perform a multidimensional visual search task in which a search array that consisted of two singleton stimuli, unique in shape and color, and four nonsingleton stimuli was presented. The task was to select one of the singletons as the saccade target, depending on the instructed search dimension, which was switched between shape and color. The strengths of the neural modulations caused by the bottom-up and top-down factors were, respectively, evaluated by assessing the dependence of the visual responses on the singleton type and the behavioral significance of the receptive field stimulus. We found that the initial visual responses of V4 neurons predominantly specified the singleton type of the receptive field stimulus, while the late presaccadic response primarily specified its behavioral significance. For comparison, recordings were also made from the frontal eye field (FEF) of one monkey and we found that the predominant activity of FEF neurons signaled the behavioral significance of the receptive field stimulus over time. These findings suggest that area V4 might function as an intermediate stage where both sensory- and behavior-based signals are dynamically represented, depending on their online requirements during a visual search, whereas the FEF predominantly represents behavior-based signals for upcoming saccade responses.

[1]  N. P. Bichot,et al.  A visual salience map in the primate frontal eye field. , 2005, Progress in brain research.

[2]  Hidehiko Komatsu,et al.  Target Selection in Area V4 during a Multidimensional Visual Search Task , 2004, The Journal of Neuroscience.

[3]  H. Deubel,et al.  Saccade target selection and object recognition: Evidence for a common attentional mechanism , 1996, Vision Research.

[4]  N. P. Bichot,et al.  Dissociation of visual discrimination from saccade programming in macaque frontal eye field. , 1997, Journal of neurophysiology.

[5]  Robert Tibshirani,et al.  An Introduction to the Bootstrap , 1994 .

[6]  J. Theeuwes Cross-dimensional perceptual selectivity , 1991, Perception & psychophysics.

[7]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[8]  R. Desimone,et al.  Spectral properties of V4 neurons in the macaque , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  R. Desimone,et al.  Competitive Mechanisms Subserve Attention in Macaque Areas V2 and V4 , 1999, The Journal of Neuroscience.

[10]  B. Richmond,et al.  Implantation of magnetic search coils for measurement of eye position: An improved method , 1980, Vision Research.

[11]  J. Maunsell,et al.  Extraretinal representations in area V4 in the macaque monkey , 1991, Visual Neuroscience.

[12]  J. Schall,et al.  Neural selection and control of visually guided eye movements. , 1999, Annual review of neuroscience.

[13]  R. Desimone,et al.  Visual properties of neurons in area V4 of the macaque: sensitivity to stimulus form. , 1987, Journal of neurophysiology.

[14]  B. Motter Neural correlates of attentive selection for color or luminance in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[15]  R. Desimone,et al.  Responses of Neurons in Inferior Temporal Cortex during Memory- Guided Visual Search , 1998 .

[16]  M. Ashburner,et al.  Shape Representations and Visual Guidance of Saccadic Eye Movements , 2022 .

[17]  H. Nothdurft The role of features in preattentive vision: Comparison of orientation, motion and color cues , 1993, Vision Research.

[18]  B. Fischer,et al.  Enhanced activation of neurons in prelunate cortex before visually guided saccades of trained rhesus monkeys , 2004, Experimental Brain Research.

[19]  J. C. Johnston,et al.  Involuntary covert orienting is contingent on attentional control settings. , 1992, Journal of experimental psychology. Human perception and performance.

[20]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[21]  T. Moore,et al.  Microstimulation of the frontal eye field and its effects on covert spatial attention. , 2004, Journal of neurophysiology.

[22]  J. Schall,et al.  Saccade target selection in frontal eye field of macaque. I. Visual and premovement activation , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[23]  F. Hamker A dynamic model of how feature cues guide spatial attention , 2004, Vision Research.

[24]  A. Fuchs,et al.  A method for measuring horizontal and vertical eye movement chronically in the monkey. , 1966, Journal of applied physiology.

[25]  J. Gallant,et al.  Goal-Related Activity in V4 during Free Viewing Visual Search Evidence for a Ventral Stream Visual Salience Map , 2003, Neuron.

[26]  C. Koch,et al.  A saliency-based search mechanism for overt and covert shifts of visual attention , 2000, Vision Research.

[27]  Dominique Lamy,et al.  Attentional capture in singleton-detection and feature-search modes. , 2003, Journal of experimental psychology. Human perception and performance.

[28]  S Ullman,et al.  Shifts in selective visual attention: towards the underlying neural circuitry. , 1985, Human neurobiology.

[29]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[30]  N. P. Bichot,et al.  Frontal eye field activity before visual search errors reveals the integration of bottom-up and top-down salience. , 2005, Journal of neurophysiology.

[31]  C. Bruce,et al.  Primate frontal eye fields. II. Physiological and anatomical correlates of electrically evoked eye movements. , 1985, Journal of neurophysiology.

[32]  Michele A. Basso,et al.  Modulation of neuronal activity by target uncertainty , 1997, Nature.

[33]  Junying Yuan,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2022 .

[34]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[35]  David L. Sheinberg,et al.  Noticing Familiar Objects in Real World Scenes: The Role of Temporal Cortical Neurons in Natural Vision , 2001, The Journal of Neuroscience.

[36]  E. Keller,et al.  Saccade target selection in the superior colliculus during a visual search task. , 2002, Journal of neurophysiology.

[37]  J. Bullier,et al.  Topography of visual cortex connections with frontal eye field in macaque: convergence and segregation of processing streams , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[38]  Leslie G. Ungerleider,et al.  Organization of visual inputs to the inferior temporal and posterior parietal cortex in macaques , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  M. A. Steinmetz,et al.  Neuronal responses in area 7a to multiple-stimulus displays: I. neurons encode the location of the salient stimulus. , 2001, Cerebral cortex.

[40]  H. Egeth,et al.  Overriding stimulus-driven attentional capture , 1994, Perception & psychophysics.

[41]  N. P. Bichot,et al.  Perceptual and motor processing stages identified in the activity of macaque frontal eye field neurons during visual search. , 1996, Journal of neurophysiology.

[42]  P H Schiller,et al.  Visual representations during saccadic eye movements. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[43]  N. P. Bichot,et al.  Continuous processing in macaque frontal cortex during visual search , 2001, Neuropsychologia.

[44]  D. V. van Essen,et al.  Spatial Attention Effects in Macaque Area V4 , 1997, The Journal of Neuroscience.

[45]  S. Yantis,et al.  Visual Attention: Bottom-Up Versus Top-Down , 2004, Current Biology.

[46]  C. Bruce,et al.  Primate frontal eye fields. I. Single neurons discharging before saccades. , 1985, Journal of neurophysiology.

[47]  H. Spitzer,et al.  Increased attention enhances both behavioral and neuronal performance. , 1988, Science.

[48]  J Duncan,et al.  Responses of neurons in macaque area V4 during memory-guided visual search. , 2001, Cerebral cortex.

[49]  A. L. I︠A︡rbus Eye Movements and Vision , 1967 .

[50]  B. Fischer,et al.  Selection of visual targets activates prelunate cortical cells in trained rhesus monkey , 2004, Experimental Brain Research.

[51]  P. H. Schiller,et al.  State dependent activity in monkey visual cortex , 2004, Experimental Brain Research.

[52]  R. Desimone,et al.  Neural mechanisms of spatial selective attention in areas V1, V2, and V4 of macaque visual cortex. , 1997, Journal of neurophysiology.

[53]  J D Schall,et al.  Dynamic dissociation of visual selection from saccade programming in frontal eye field. , 2001, Journal of neurophysiology.

[54]  C. Bruce,et al.  Topography of projections to posterior cortical areas from the macaque frontal eye fields , 1995, The Journal of comparative neurology.

[55]  A. L. Yarbus,et al.  Eye Movements and Vision , 1967, Springer US.

[56]  B. Dosher,et al.  The role of attention in the programming of saccades , 1995, Vision Research.

[57]  D. Mumford,et al.  Neural activity in early visual cortex reflects behavioral experience and higher-order perceptual saliency , 2002, Nature Neuroscience.

[58]  J. Hoffman,et al.  The role of visual attention in saccadic eye movements , 1995, Perception & psychophysics.

[59]  J. Theeuwes,et al.  The role of stimulus-driven and goal-driven control in saccadic visual selection. , 2004, Journal of experimental psychology. Human perception and performance.

[60]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[61]  Robert Desimone,et al.  Parallel and Serial Neural Mechanisms for Visual Search in Macaque Area V4 , 2005, Science.

[62]  Carrie J. McAdams,et al.  Effects of Attention on Orientation-Tuning Functions of Single Neurons in Macaque Cortical Area V4 , 1999, The Journal of Neuroscience.

[63]  K. Cave,et al.  Top-down and bottom-up attentional control: On the nature of interference from a salient distractor , 1999, Perception & psychophysics.

[64]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[65]  James R. Bergen,et al.  Parallel versus serial processing in rapid pattern discrimination , 1983, Nature.

[66]  H Pashler,et al.  Cross-dimensional interaction and texture segregation , 1988, Perception & psychophysics.

[67]  S. Yantis,et al.  Visual attention: control, representation, and time course. , 1997, Annual review of psychology.

[68]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.