Superior colliculus encodes visual saliency during smooth pursuit eye movements

The saliency map has played a long-standing role in models and theories of visual attention, and it is now supported by neurobiological evidence from several cortical and subcortical brain areas. While visual saliency is computed during moments of active fixation, it is not known whether the same is true while engaged in smooth pursuit of a moving stimulus, which is very common in real-world vision. Here, we examined extrafoveal saliency coding in the superior colliculus, a midbrain area associated with attention and gaze, during smooth pursuit eye movements. We found that SC neurons from the superficial visual layers showed a robust representation of peripheral saliency evoked by a conspicuous stimulus embedded in a wide-field array of goal-irrelevant stimuli. In contrast, visuomotor neurons from the intermediate saccade-related layers showed a poor saliency representation, even though most of these neurons were visually responsive during smooth pursuit. These results confirm and extend previous findings that place the SCs in a unique role as a saliency map that monitors peripheral vision during foveation of stationary and now moving objects.

[1]  Ziad M Hafed,et al.  How is visual salience computed in the brain? Insights from behaviour, neurobiology and modelling , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[2]  M. Goldberg,et al.  The representation of visual salience in monkey parietal cortex , 1998, Nature.

[3]  Douglas P. Munoz,et al.  The superior colliculus , 2011 .

[4]  E. Keller,et al.  Saccade target selection in the superior colliculus during a visual search task. , 2002, Journal of neurophysiology.

[5]  J. Douglas Crawford,et al.  Superior Colliculus Responses to Attended, Unattended, and Remembered Saccade Targets during Smooth Pursuit Eye Movements , 2016, Front. Syst. Neurosci..

[6]  Zhaoping Li A saliency map in primary visual cortex , 2002, Trends in Cognitive Sciences.

[7]  C. Gilbert,et al.  Contour Saliency in Primary Visual Cortex , 2006, Neuron.

[8]  A. S. Ramoa,et al.  Intrinsic circuitry of the superior colliculus: pharmacophysiological identification of horizontally oriented inhibitory interneurons. , 1998, Journal of neurophysiology.

[9]  Zhaoping Li,et al.  Bottom-up saliency and top-down learning in the primary visual cortex of monkeys , 2018, Proceedings of the National Academy of Sciences.

[10]  Gunnar Blohm,et al.  The default allocation of attention is broadly ahead of smooth pursuit. , 2010, Journal of vision.

[11]  Richard J Krauzlis,et al.  Inactivation of primate superior colliculus biases target choice for smooth pursuit, saccades, and button press responses. , 2010, Journal of neurophysiology.

[12]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[13]  Laurent Itti,et al.  Superior colliculus encodes visual saliency before the primary visual cortex , 2017, Proceedings of the National Academy of Sciences.

[14]  Robert A. Marino,et al.  Distinct local circuit properties of the superficial and intermediate layers of the rodent superior colliculus , 2014, The European journal of neuroscience.

[15]  L. Itti Author address: , 1999 .

[16]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  S. Yantis,et al.  Selective visual attention and perceptual coherence , 2006, Trends in Cognitive Sciences.

[18]  David C Lyon,et al.  Distribution of cortical neurons projecting to the superior colliculus in macaque monkeys , 2014, Eye and brain.

[19]  D. Munoz,et al.  On the importance of the transient visual response in the superior colliculus , 2008, Current Opinion in Neurobiology.

[20]  Alexandre Zénon,et al.  Attention deficits without cortical neuronal deficits , 2012, Nature.

[21]  Laurent Itti,et al.  Superior colliculus neurons encode a visual saliency map during free viewing of natural dynamic video , 2017, Nature Communications.

[22]  Zhaoping Li,et al.  Neural Activities in V1 Create a Bottom-Up Saliency Map , 2012, Neuron.

[23]  Brian J. White,et al.  Residual Attention Guidance in Blindsight Monkeys Watching Complex Natural Scenes , 2012, Current Biology.

[24]  P. Lennie,et al.  Chromatic mechanisms in lateral geniculate nucleus of macaque. , 1984, The Journal of physiology.

[25]  Margaret A. Johns,et al.  Corrigendum: The OncoPPi network of cancer-focused protein–protein interactions to inform biological insights and therapeutic strategies , 2017, Nature Communications.

[26]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[27]  Braden A. Purcell,et al.  From Salience to Saccades: Multiple-Alternative Gated Stochastic Accumulator Model of Visual Search , 2012, The Journal of Neuroscience.

[28]  N. P. Bichot,et al.  A visual salience map in the primate frontal eye field. , 2005, Progress in brain research.

[29]  Lance M. Optican,et al.  Unix-based multiple-process system, for real-time data acquisition and control , 1982 .

[30]  Aya Takemura,et al.  MST neurons code for visual motion in space independent of pursuit eye movements. , 2007, Journal of neurophysiology.

[31]  D. Munoz,et al.  Lateral inhibitory interactions in the intermediate layers of the monkey superior colliculus. , 1998, Journal of neurophysiology.

[32]  Kelly Shen,et al.  Predictive Saccade Target Selection in Superior Colliculus during Visual Search , 2014, The Journal of Neuroscience.

[33]  R. Wurtz,et al.  Activity of superior colliculus in behaving monkey. II. Effect of attention on neuronal responses. , 1972, Journal of neurophysiology.

[34]  Robert A. Marino,et al.  Free viewing of dynamic stimuli by humans and monkeys. , 2009, Journal of vision.

[35]  John A. Wolf,et al.  Neural Substrate Expansion for the Restoration of Brain Function , 2016, Front. Syst. Neurosci..

[36]  Dirk Kerzel,et al.  Improved visual sensitivity during smooth pursuit eye movements , 2010 .

[37]  R. Krauzlis Recasting the smooth pursuit eye movement system. , 2004, Journal of neurophysiology.

[38]  C. Rashbass,et al.  The relationship between saccadic and smooth tracking eye movements , 1961, The Journal of physiology.

[39]  Peter W Dicke,et al.  Neuron-specific contribution of the superior colliculus to overt and covert shifts of attention , 2004, Nature Neuroscience.

[40]  Matteo Valsecchi,et al.  Attention is allocated closely ahead of the target during smooth pursuit eye movements: Evidence from EEG frequency tagging , 2017, Neuropsychologia.

[41]  P. Thier,et al.  A neuronal correlate of spatial stability during periods of self-induced visual motion , 2004, Experimental Brain Research.

[42]  N. J. Gandhi,et al.  Motor functions of the superior colliculus. , 2011, Annual review of neuroscience.

[43]  Xiaogang Yan,et al.  Continuous Updating of Visuospatial Memory in Superior Colliculus during Slow Eye Movements , 2015, Current Biology.

[44]  Miriam Spering,et al.  Context effects on smooth pursuit and manual interception of a disappearing target. , 2017, Journal of neurophysiology.

[45]  Dirk Kerzel,et al.  Effects of attention shifts to stationary objects during steady-state smooth pursuit eye movements , 2008, Vision Research.

[46]  R. Krauzlis,et al.  Superior colliculus and visual spatial attention. , 2013, Annual review of neuroscience.

[47]  Robert A. Marino,et al.  Spatial relationships of visuomotor transformations in the superior colliculus map. , 2008, Journal of neurophysiology.

[48]  M. Potter,et al.  Temporal constraints on conscious vision: on the ubiquitous nature of the attentional blink. , 2009, Journal of vision.

[49]  Eileen Kowler,et al.  Shared attentional control of smooth eye movement and perception , 1986, Vision Research.

[50]  M. Goldberg,et al.  Attention, intention, and priority in the parietal lobe. , 2010, Annual review of neuroscience.

[51]  J. Movshon,et al.  Modulation of visual signals in macaque MT and MST neurons during pursuit eye movement. , 2009, Journal of Neurophysiology.

[52]  Laurent Itti,et al.  Linking visual response properties in the superior colliculus to saccade behavior , 2012, The European journal of neuroscience.

[53]  Richard J. Krauzlis,et al.  Spatial allocation of attention during smooth pursuit eye movements , 2009, Vision Research.

[54]  Alexander C. Schütz,et al.  Visual sensitivity for luminance and chromatic stimuli during the execution of smooth pursuit and saccadic eye movements , 2017, Vision Research.

[55]  Tirin Moore,et al.  Influence and Limitations of Popout in the Selection of Salient Visual Stimuli by Area V4 Neurons , 2009, The Journal of Neuroscience.

[56]  Ziad M Hafed,et al.  Goal Representations Dominate Superior Colliculus Activity during Extrafoveal Tracking , 2008, The Journal of Neuroscience.

[57]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[58]  D. B. Bender,et al.  Distribution of corticotectal cells in macaque , 2003, Experimental Brain Research.

[59]  Brian J. White,et al.  Separate Visual Signals for Saccade Initiation during Target Selection in the Primate Superior Colliculus , 2011, The Journal of Neuroscience.

[60]  P. Thier,et al.  Inability of Rhesus Monkey Area V1 to Discriminate Between Self‐induced and Externally Induced Retinal Image Slip , 1996, The European journal of neuroscience.

[61]  Karl R Gegenfurtner,et al.  Contextual effects on smooth-pursuit eye movements. , 2007, Journal of neurophysiology.