Independent working memory resources for egocentric and allocentric spatial information

Visuospatial working memory enables us to maintain access to visual information for processing even when a stimulus is no longer present, due to occlusion, our own movements, or transience of the stimulus. Here we show that, when localizing remembered stimuli, the precision of spatial recall does not rely solely on memory for individual stimuli, but additionally depends on the relative distances between stimuli and visual landmarks in the surroundings. Across three separate experiments, we consistently observed a spatially selective improvement in the precision of recall for items located near a persistent landmark. While the results did not require that the landmark be visible throughout the memory delay period, it was essential that it was visible both during encoding and response. We present a simple model that can accurately capture human performance by considering relative (allocentric) spatial information as an independent localization estimate which degrades with distance and is optimally integrated with egocentric spatial information. Critically, allocentric information was encoded without cost to egocentric estimation, demonstrating independent storage of the two sources of information. Finally, when egocentric and allocentric estimates were put in conflict, the model successfully predicted the resulting localization errors. We suggest that the relative distance between stimuli represents an additional, independent spatial cue for memory recall. This cue information is likely to be critical for spatial localization in natural settings which contain an abundance of visual landmarks.

[1]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[2]  Arne D. Ekstrom,et al.  Human spatial navigation: representations across dimensions and scales , 2017, Current Opinion in Behavioral Sciences.

[3]  Wei Ji Ma,et al.  Variability in encoding precision accounts for visual short-term memory limitations , 2012, Proceedings of the National Academy of Sciences.

[4]  Jörn Diedrichsen,et al.  The time course of spatial memory distortions , 2002, Memory & cognition.

[5]  David C. Plaut,et al.  ‘What’ Is Happening in the Dorsal Visual Pathway , 2016, Trends in Cognitive Sciences.

[6]  J. Douglas Crawford,et al.  Allocentric versus Egocentric Representation of Remembered Reach Targets in Human Cortex , 2014, The Journal of Neuroscience.

[7]  Thomas Schmidt,et al.  Spatial distortions induced by multiple visual landmarks: How local distortions combine to produce complex distortion patterns , 2003, Perception & psychophysics.

[8]  H. Zimmer Spatial information with pictures and words in visual short-term memory , 1998, Psychological research.

[9]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[10]  Sebastian Schneegans,et al.  Neural Architecture for Feature Binding in Visual Working Memory , 2017, The Journal of Neuroscience.

[11]  H. Deubel Localization of targets across saccades: Role of landmark objects , 2004 .

[12]  A. Compte,et al.  Neural circuit basis of visuo-spatial working memory precision: a computational and behavioral study. , 2015, Journal of neurophysiology.

[13]  M. Carandini,et al.  Normalization as a canonical neural computation , 2011, Nature Reviews Neuroscience.

[14]  Matthew Heath,et al.  Background visual cues and memory-guided reaching. , 2004, Human movement science.

[15]  Jason Rajsic,et al.  Asymmetrical access to color and location in visual working memory , 2014, Attention, perception & psychophysics.

[16]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[17]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[18]  R. Andersen,et al.  Intentional maps in posterior parietal cortex. , 2002, Annual review of neuroscience.

[19]  D. E. Irwin,et al.  Causal Inference for Spatial Constancy across Saccades , 2016, PLoS Comput. Biol..

[20]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[21]  T. McNamara,et al.  Egocentric and geocentric frames of reference in memory of large-scale space , 2003, Psychonomic bulletin & review.

[22]  Xiao-Jing Wang,et al.  From Distributed Resources to Limited Slots in Multiple-Item Working Memory: A Spiking Network Model with Normalization , 2012, The Journal of Neuroscience.

[23]  M. Goodale,et al.  Two visual systems re-viewed , 2008, Neuropsychologia.

[24]  Xiaogang Yan,et al.  Effect of allocentric landmarks on primate gaze behavior in a cue conflict task. , 2017, Journal of vision.

[25]  J. Aggleton,et al.  A comparison of egocentric and allocentric spatial memory in a patient with selective hippocampal damage , 2000, Neuropsychologia.

[26]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[27]  W. Ma,et al.  Changing concepts of working memory , 2014, Nature Neuroscience.

[28]  Andrew Hollingworth,et al.  Binding objects to locations: the relationship between object files and visual working memory. , 2010, Journal of experimental psychology. Human perception and performance.

[29]  P. Shah,et al.  Effects of spatial configurations on visual change detection: An account of bias changes , 2009, Memory & cognition.

[30]  T. Schenk,et al.  An allocentric rather than perceptual deficit in patient D.F. , 2006, Nature Neuroscience.

[31]  Dwight J. Kravitz,et al.  A new neural framework for visuospatial processing , 2011, Nature Reviews Neuroscience.

[32]  Sebastian Schneegans,et al.  No fixed item limit in visuospatial working memory , 2016, Cortex.

[33]  M. Goodale,et al.  Pointing to places and spaces in a patient with visual form agnosia , 2006, Neuropsychologia.

[34]  Michael I. Jordan,et al.  Computational models of sensorimotor integration , 1997 .

[35]  Shinsuke Shimojo,et al.  Compression of space in visual memory , 2001, Vision Research.

[36]  N. Burgess Spatial Cognition and the Brain , 2008, Annals of the New York Academy of Sciences.

[37]  M. Goodale,et al.  Separate visual pathways for perception and action , 1992, Trends in Neurosciences.

[38]  N. Burgess,et al.  Spatial memory: how egocentric and allocentric combine , 2006, Trends in Cognitive Sciences.

[39]  E. Spelke,et al.  Human Spatial Representation: Insights from Animals , 2002 .

[40]  D. Kerzel Memory for the position of stationary objects: disentangling foveal bias and memory averaging , 2002, Vision Research.

[41]  Flavia Filimon,et al.  Are All Spatial Reference Frames Egocentric? Reinterpreting Evidence for Allocentric, Object-Centered, or World-Centered Reference Frames , 2015, Front. Hum. Neurosci..

[42]  T. Schenk Visuomotor robustness is based on integration not segregation , 2010, Vision Research.

[43]  T L Hubbard,et al.  Spatial memory averaging, the landmark attraction effect, and representational gravity , 2000, Psychological research.

[44]  D. B. Bender,et al.  Visual properties of neurons in inferotemporal cortex of the Macaque. , 1972, Journal of neurophysiology.

[45]  Katsumi Watanabe,et al.  Attention Can Retrospectively Distort Visual Space , 2011, Psychological science.

[46]  A. Berthoz,et al.  Reference Frames for Spatial Cognition: Different Brain Areas are Involved in Viewer-, Object-, and Landmark-Centered Judgments About Object Location , 2004, Journal of Cognitive Neuroscience.

[47]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[48]  D. Camors,et al.  Allocentric coding: Spatial range and combination rules , 2015, Vision Research.

[49]  Thomas Schmidt,et al.  Spatial Distortions in Visual Short-term Memory: Interplay of Intrinsic and Extrinsic Reference Systems , 2004, Spatial Cogn. Comput..

[50]  J. Crawford,et al.  Cortical Activation during Landmark-Centered vs. Gaze-Centered Memory of Saccade Targets in the Human: An FMRI Study , 2017, Front. Syst. Neurosci..

[51]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[52]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[53]  Paul M Bays,et al.  Noise in Neural Populations Accounts for Errors in Working Memory , 2014, The Journal of Neuroscience.

[54]  J Douglas Crawford,et al.  Cue reliability and a landmark stability heuristic determine relative weighting between egocentric and allocentric visual information in memory-guided reach. , 2010, Journal of neurophysiology.

[55]  Arne D. Ekstrom,et al.  Interacting networks of brain regions underlie human spatial navigation: a review and novel synthesis of the literature. , 2017, Journal of neurophysiology.

[56]  Russell A. Epstein,et al.  Human entorhinal cortex represents visual space using a boundary-anchored grid , 2017, Nature Neuroscience.

[57]  James J Knierim,et al.  Integration of objects and space in perception and memory , 2017, Nature Neuroscience.

[58]  J. O’Keefe,et al.  Space in the brain: how the hippocampal formation supports spatial cognition , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[59]  S. Becker,et al.  Remembering the past and imagining the future: a neural model of spatial memory and imagery. , 2007, Psychological review.

[60]  A. Treisman,et al.  Location and binding in visual working memory , 2006, Memory & cognition.

[61]  Shinsuke Shimojo,et al.  Extrinsic Cues Suppress the Encoding of Intrinsic Cues , 2004, Journal of Cognitive Neuroscience.

[62]  M. Goldberg,et al.  Space and attention in parietal cortex. , 1999, Annual review of neuroscience.

[63]  M. Goodale,et al.  The role of online visual feedback for the control of target-directed and allocentric hand movements. , 2011, Journal of neurophysiology.

[64]  Thomas Schmidt,et al.  Immediate spatial distortions of pointing movements induced by visual landmarks , 2004, Perception & psychophysics.

[65]  B. Bridgeman,et al.  Landmarks facilitate visual space constancy across saccades and during fixation , 2010, Vision Research.

[66]  Gunnar Blohm,et al.  Integration of egocentric and allocentric information during memory-guided reaching to images of a natural environment , 2014, Front. Hum. Neurosci..

[67]  Hubert D Zimmer,et al.  The spatial mismatch effect is based on global configuration and not on perceptual records within the visual cache , 2006, Psychological research.

[68]  P. Cavanagh,et al.  Focused attention distorts visual space: an attentional repulsion effect. , 1997, Journal of experimental psychology. Human perception and performance.

[69]  I. Schütz,et al.  Gaze-centered spatial updating in delayed reaching even in the presence of landmarks , 2013, Vision Research.

[70]  Tobias Navarro Schröder,et al.  Hexadirectional coding of visual space in human entorhinal cortex , 2018, Nature Neuroscience.

[71]  J. Palmer Attentional limits on the perception and memory of visual information. , 1990, Journal of experimental psychology. Human perception and performance.

[72]  Nick F. Ramsey,et al.  Interactions between ego- and allocentric neuronal representations of space , 2006, NeuroImage.

[73]  Roberta L. Klatzky,et al.  Allocentric and Egocentric Spatial Representations: Definitions, Distinctions, and Interconnections , 1998, Spatial Cognition.

[74]  John H. R. Maunsell,et al.  How parallel are the primate visual pathways? , 1993, Annual review of neuroscience.

[75]  Xiao-Jing Wang,et al.  Schizophrenia is associated with a pattern of spatial working memory deficits consistent with cortical disinhibition , 2017, Schizophrenia Research.

[76]  A. Cowey,et al.  Human cortical magnification factor and its relation to visual acuity , 2004, Experimental Brain Research.

[77]  Aiden E. G. F. Arnold,et al.  A critical review of the allocentric spatial representation and its neural underpinnings: toward a network-based perspective , 2014, Front. Hum. Neurosci..

[78]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[79]  M. Ernst,et al.  Humans integrate visual and haptic information in a statistically optimal fashion , 2002, Nature.

[80]  Arvid Herwig,et al.  Breaking Object Correspondence Across Saccadic Eye Movements Deteriorates Object Recognition , 2015, Front. Syst. Neurosci..