Spatially-specific working memory activity in the human superior colliculus

Theoretically, working memory (WM) representations are encoded by population activity of neurons with distributed tuning across the stored feature. Here, we leverage computational neuroimaging approaches to map the topographic organization of human superior colliculus (SC) and model how population activity in SC encodes WM representations. We first modeled receptive field properties of voxels in SC, deriving a detailed topographic organization resembling that of the primate SC. Neural activity within male and female human SC persisted throughout a retention interval of several types of modified memory-guided saccade tasks. Assuming an underlying neural architecture of the SC based on its retinotopic organization, we used an encoding model to show that the pattern of activity in human SC represents locations stored in WM. Our tasks and models allowed us to dissociate the locations of visual targets and the motor metrics of memory-guided saccades from the spatial locations stored in WM, thus confirming that human SC represents true WM information. These data have several important implications. They add the SC to a growing number of cortical and subcortical brain areas that form distributed networks supporting WM functions. Moreover, they specify a clear neural mechanism by which topographically organized SC encodes WM representations. Significance Statement Using computational neuroimaging approaches, we mapped the topographic organization of human superior colliculus (SC) and modeled how population activity in SC encodes working memory (WM) representations, rather than simpler visual or motor properties that have been traditionally associated with the laminar maps in the primate SC. Together, these data both position the human SC into a distributed network of brain areas supporting WM and elucidate the neural mechanisms by which the SC supports WM.

[1]  D. Sparks,et al.  Conceptual issues related to the role of the superior colliculus in the control of gaze , 1999, Current Opinion in Neurobiology.

[2]  B. Luna,et al.  The expression of established cognitive brain states stabilizes with working memory development , 2017, eLife.

[3]  Ying Cai,et al.  Overlapping and distinct contributions of stimulus location and of spatial context to nonspatial visual short-term memory. , 2019, Journal of neurophysiology.

[4]  J T McIlwain,et al.  Distributed spatial coding in the superior colliculus: A review , 1991, Visual Neuroscience.

[5]  J. D. Connolly,et al.  Saccade preparation signals in the human frontal and parietal cortices. , 2008, Journal of neurophysiology.

[6]  Jack L. Gallant,et al.  Encoding and decoding in fMRI , 2011, NeuroImage.

[7]  Hans-Jochen Heinze,et al.  High-Field fMRI Reveals Brain Activation Patterns Underlying Saccade Execution in the Human Superior Colliculus , 2010, PloS one.

[8]  Brian J. White,et al.  Spatio‐temporal response properties of local field potentials in the primate superior colliculus , 2015, The European journal of neuroscience.

[9]  N. J. Gandhi,et al.  Motor functions of the superior colliculus. , 2011, Annual review of neuroscience.

[10]  Xiaogang Yan,et al.  Continuous Updating of Visuospatial Memory in Superior Colliculus during Slow Eye Movements , 2015, Current Biology.

[11]  David Ress,et al.  Topography of covert visual attention in human superior colliculus. , 2010, Journal of neurophysiology.

[12]  P. Roelfsema,et al.  The Distributed Nature of Working Memory , 2017, Trends in Cognitive Sciences.

[13]  Stefan Everling,et al.  Control of the superior colliculus by the lateral prefrontal cortex , 2013, Philosophical Transactions of the Royal Society B: Biological Sciences.

[14]  Peter W Dicke,et al.  Neuron-specific contribution of the superior colliculus to overt and covert shifts of attention , 2004, Nature Neuroscience.

[15]  Hao Zhou,et al.  Layer-specific response properties of the human lateral geniculate nucleus and superior colliculus , 2015, NeuroImage.

[16]  Wei Ji Ma,et al.  Bayesian inference with probabilistic population codes , 2006, Nature Neuroscience.

[17]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[18]  Stefan Everling,et al.  Prefrontal Cortex Deactivation in Macaques Alters Activity in the Superior Colliculus and Impairs Voluntary Control of Saccades , 2011, The Journal of Neuroscience.

[19]  Daniel Guitton,et al.  Superior colliculus encodes distance to target, not saccade amplitude, in multi-step gaze shifts , 2003, Nature Neuroscience.

[20]  Sabine Kastner,et al.  Thalamic functions in distributed cognitive control , 2017, Nature Neuroscience.

[21]  P. May The mammalian superior colliculus: laminar structure and connections. , 2006, Progress in brain research.

[22]  R. Walker,et al.  Activity in the human superior colliculus relating to endogenous saccade preparation and execution. , 2015, Journal of neurophysiology.

[23]  David Ress,et al.  Endogenous Attention Signals Evoked by Threshold Contrast Detection in Human Superior Colliculus , 2014, The Journal of Neuroscience.

[24]  Sabine Kastner,et al.  Effects of Sustained Spatial Attention in the Human Lateral Geniculate Nucleus and Superior Colliculus , 2009, The Journal of Neuroscience.

[25]  M. A. Basso,et al.  Circuits for Action and Cognition: A View from the Superior Colliculus. , 2017, Annual review of vision science.

[26]  Jung Hwan Kim,et al.  Polar-angle representation of saccadic eye movements in human superior colliculus , 2017, NeuroImage.

[27]  Clayton E Curtis,et al.  Saccade Planning Evokes Topographically Specific Activity in the Dorsal and Ventral Streams , 2014, The Journal of Neuroscience.

[28]  Ariel Rokem,et al.  Popeye: a Population Receptive Field Estimation Tool , 2016, J. Open Source Softw..

[29]  M. A. Basso,et al.  A Probabilistic Strategy for Understanding Action Selection , 2010, The Journal of Neuroscience.

[30]  Clayton E Curtis,et al.  Prioritized Maps of Space in Human Frontoparietal Cortex , 2012, The Journal of Neuroscience.

[31]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[32]  R. Desimone,et al.  Neural Mechanisms of Visual Working Memory in Prefrontal Cortex of the Macaque , 1996, The Journal of Neuroscience.

[33]  D. Heeger,et al.  Decoding and Reconstructing Color from Responses in Human Visual Cortex , 2009, The Journal of Neuroscience.

[34]  Jon H Kaas,et al.  Topographic Maps are Fundamental to Sensory Processing , 1997, Brain Research Bulletin.

[35]  Tirin Moore,et al.  Selection and Maintenance of Spatial Information by Frontal Eye Field Neurons , 2009, The Journal of Neuroscience.

[36]  Joaquín M. Fuster,et al.  Cortex and Memory: Emergence of a New Paradigm , 2009, Journal of Cognitive Neuroscience.

[37]  Wayne E. Mackey,et al.  Visual field map clusters in human frontoparietal cortex , 2016, bioRxiv.

[38]  A. Song,et al.  The Saccadic Re-Centering Bias is Associated with Activity Changes in the Human Superior Colliculus , 2010, Front. Hum. Neurosci..

[39]  J. E. Albano,et al.  Visual-motor function of the primate superior colliculus. , 1980, Annual review of neuroscience.

[40]  D. Heeger,et al.  Two Retinotopic Visual Areas in Human Lateral Occipital Cortex , 2006, The Journal of Neuroscience.

[41]  Kelly Shen,et al.  Investigating the role of the superior colliculus in active vision with the visual search paradigm , 2011, The European journal of neuroscience.

[42]  Edward F. Ester,et al.  Parietal and Frontal Cortex Encode Stimulus-Specific Mnemonic Representations during Visual Working Memory , 2015, Neuron.

[43]  Jillian H. Fecteau,et al.  Salience, relevance, and firing: a priority map for target selection , 2006, Trends in Cognitive Sciences.

[44]  Edward F. Ester,et al.  Restoring Latent Visual Working Memory Representations in Human Cortex , 2016, Neuron.

[45]  Laurent Itti,et al.  Superior colliculus encodes visual saliency before the primary visual cortex , 2017, Proceedings of the National Academy of Sciences.

[46]  John T. Serences,et al.  Reconstructions of Information in Visual Spatial Working Memory Degrade with Memory Load , 2014, Current Biology.

[47]  Adam C. Riggall,et al.  The Relationship between Working Memory Storage and Elevated Activity as Measured with Functional Magnetic Resonance Imaging , 2012, The Journal of Neuroscience.

[48]  R. Wurtz,et al.  Activity of superior colliculus in behaving monkey. I. Visual receptive fields of single neurons. , 1972, Journal of neurophysiology.

[49]  Richard J Krauzlis,et al.  Inactivation of primate superior colliculus impairs covert selection of signals for perceptual judgments , 2010, Nature Neuroscience.

[50]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[51]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[52]  Alexandre Zénon,et al.  Attention deficits without cortical neuronal deficits , 2012, Nature.

[53]  Laurent Itti,et al.  Superior colliculus neurons encode a visual saliency map during free viewing of natural dynamic video , 2017, Nature Communications.

[54]  Xiaogang Yan,et al.  The Influence of a Memory Delay on Spatial Coding in the Superior Colliculus: Is Visual Always Visual and Motor Always Motor? , 2018, Front. Neural Circuits.

[55]  Ione Fine,et al.  Population receptive field estimates of human auditory cortex , 2015, NeuroImage.

[56]  John-Dylan Haynes,et al.  Decoding the Contents of Visual Short-Term Memory from Human Visual and Parietal Cortex , 2012, The Journal of Neuroscience.

[57]  M. Cynader,et al.  Receptive-field organization of monkey superior colliculus. , 1972, Journal of neurophysiology.

[58]  Masih Rahmati,et al.  Population Dynamics of Early Visual Cortex during Working Memory , 2018, Journal of Cognitive Neuroscience.

[59]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[60]  Kartik K. Sreenivasan,et al.  The what, where and how of delay activity , 2019, Nature Reviews Neuroscience.

[61]  Sabine Kastner,et al.  Visual responses of the human superior colliculus: a high-resolution functional magnetic resonance imaging study. , 2005, Journal of neurophysiology.

[62]  Brian A. Wandell,et al.  Population receptive field estimates in human visual cortex , 2008, NeuroImage.

[63]  Mark D'Esposito,et al.  Distributed and Dynamic Storage of Working Memory Stimulus Information in Extrastriate Cortex , 2014, Journal of Cognitive Neuroscience.

[64]  R. Wurtz,et al.  Progression in neuronal processing for saccadic eye movements from parietal cortex area lip to superior colliculus. , 2001, Journal of neurophysiology.

[65]  Tal Makovski,et al.  The visual attractor illusion. , 2010, Journal of vision.

[66]  Robert H Wurtz,et al.  Enhanced Performance with Brain Stimulation: Attentional Shift or Visual Cue? , 2006, The Journal of Neuroscience.

[67]  Kevin DeSimone,et al.  Population Receptive Field Estimation Reveals New Retinotopic Maps in Human Subcortex , 2015, The Journal of Neuroscience.

[68]  D. Sparks,et al.  Population coding of saccadic eye movements by neurons in the superior colliculus , 1988, Nature.

[69]  Ziad M Hafed,et al.  Neuronal control of fixation and fixational eye movements , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[70]  R. Krauzlis,et al.  Superior colliculus and visual spatial attention. , 2013, Annual review of neuroscience.

[71]  Robert M. McPeek,et al.  Deficits in saccade target selection after inactivation of superior colliculus , 2004, Nature Neuroscience.

[72]  D. Sparks,et al.  Eye-head coordination during head-unrestrained gaze shifts in rhesus monkeys. , 1997, Journal of neurophysiology.

[73]  Robert A. Marino,et al.  Spatial relationships of visuomotor transformations in the superior colliculus map. , 2008, Journal of neurophysiology.

[74]  D. Robinson Eye movements evoked by collicular stimulation in the alert monkey. , 1972, Vision research.

[75]  Matthew W Self,et al.  Layer-specificity in the effects of attention and working memory on activity in primary visual cortex , 2017, Nature Communications.

[76]  R. Wurtz,et al.  Activity of superior colliculus in behaving monkey. II. Effect of attention on neuronal responses. , 1972, Journal of neurophysiology.

[77]  John T. Serences,et al.  Computational advances towards linking BOLD and behavior , 2012, Neuropsychologia.

[78]  R. Wurtz,et al.  Frontal eye field sends delay activity related to movement, memory, and vision to the superior colliculus. , 2001, Journal of neurophysiology.

[79]  Janneke F. M. Jehee,et al.  Sensory uncertainty decoded from visual cortex predicts behavior , 2015, Nature Neuroscience.

[80]  B. Wandell,et al.  Mapping Hv4 and Ventral Occipital Cortex: the Venous Eclipse , 2022 .

[81]  D. Sparks The brainstem control of saccadic eye movements , 2002, Nature Reviews Neuroscience.