Neural Representations Integrate the Current Field of View with the Remembered 360° Panorama in Scene-Selective Cortex

We experience our visual environment as a seamless, immersive panorama. Yet, each view is discrete and fleeting, separated by expansive eye movements and discontinuous views of our spatial surroundings. How are discrete views of a panoramic environment knit together into a broad, unified memory representation? Regions of the brain's "scene network" are well poised to integrate retinal input and memory [1]: they are visually driven [2, 3] but also densely interconnected with memory structures in the medial temporal lobe [4]. Further, these regions harbor memory signals relevant for navigation [5-8] and adapt across overlapping shifts in scene viewpoint [9, 10]. However, it is unknown whether regions of the scene network support visual memory for the panoramic environment outside of the current field of view and, further, how memory for the surrounding environment influences ongoing perception. Here, we demonstrate that specific regions of the scene network-the retrosplenial complex (RSC) and occipital place area (OPA)-unite discrete views of a 360° panoramic environment, both current and out of sight, in a common representational space. Further, individual scene views prime associated representations of the panoramic environment in behavior, facilitating subsequent perceptual judgments. We propose that this dynamic interplay between memory and perception plays an important role in weaving the fabric of continuous visual experience.

[1]  Geoffrey Hall,et al.  Learning about associatively activated stimulus representations: Implications for acquired equivalence and perceptual learning , 1996 .

[2]  Russell A. Epstein,et al.  Abstract Representations of Location and Facing Direction in the Human Brain , 2013, The Journal of Neuroscience.

[3]  Dwight J. Kravitz,et al.  A new neural framework for visuospatial processing , 2011, Nature Reviews Neuroscience.

[4]  Peter C. Holland,et al.  Acquisition of Representation-Mediated Conditioned Food Aversions. , 1981 .

[5]  Margaret L. Schlichting,et al.  Memory integration: neural mechanisms and implications for behavior , 2015, Current Opinion in Behavioral Sciences.

[6]  Soojin Park,et al.  Different roles of the parahippocampal place area (PPA) and retrosplenial cortex (RSC) in panoramic scene perception , 2009, NeuroImage.

[7]  Nancy Kanwisher,et al.  The distribution of category and location information across object-selective regions in human visual cortex , 2008, Proceedings of the National Academy of Sciences.

[8]  Daniel D. Dilks,et al.  The Occipital Place Area Is Causally and Selectively Involved in Scene Perception , 2013, The Journal of Neuroscience.

[9]  Paul E. Downing,et al.  Viewpoint-Specific Scene Representations in Human Parahippocampal Cortex , 2003, Neuron.

[10]  Marvin M Chun,et al.  Eye movements help link different views in scene-selective cortex. , 2011, Cerebral cortex.

[11]  J. Bruner Beyond the Information Given: Studies in the Psychology of Knowing , 1973 .

[12]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[13]  D. Sagi,et al.  Dynamics of Memory Representations in Networks with Novelty-Facilitated Synaptic Plasticity , 2006, Neuron.

[14]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[15]  Dagmar Zeithamova,et al.  Hippocampal and Ventral Medial Prefrontal Activation during Retrieval-Mediated Learning Supports Novel Inference , 2012, Neuron.

[16]  Russell A. Epstein,et al.  Outside Looking In: Landmark Generalization in the Human Navigational System , 2015, The Journal of Neuroscience.

[17]  Lawrence L. Wald,et al.  Accurate prediction of V1 location from cortical folds in a surface coordinate system , 2008, NeuroImage.

[18]  M. D’Esposito,et al.  Topographical disorientation: a synthesis and taxonomy. , 1999, Brain : a journal of neurology.

[19]  Russell A. Epstein,et al.  Position selectivity in scene- and object-responsive occipitotemporal regions. , 2007, Journal of neurophysiology.

[20]  Y. Miyashita,et al.  Neural organization for the long-term memory of paired associates , 1991, Nature.

[21]  N. Burgess,et al.  Evidence for holistic episodic recollection via hippocampal pattern completion , 2015, Nature Communications.

[22]  Russell A. Epstein,et al.  Anchoring the neural compass: Coding of local spatial reference frames in human medial parietal lobe , 2014, Nature Neuroscience.

[23]  Dwight J. Kravitz,et al.  Real-World Scene Representations in High-Level Visual Cortex: It's the Spaces More Than the Places , 2011, The Journal of Neuroscience.

[24]  Soojin Park,et al.  Disentangling Scene Content from Spatial Boundary: Complementary Roles for the Parahippocampal Place Area and Lateral Occipital Complex in Representing Real-World Scenes , 2011, The Journal of Neuroscience.

[25]  A. Dale,et al.  Cortical Surface-Based Analysis II: Inflation, Flattening, and a Surface-Based Coordinate System , 1999, NeuroImage.

[26]  Dwight J. Kravitz,et al.  High-level visual object representations are constrained by position. , 2010, Cerebral cortex.

[27]  H. Eichenbaum,et al.  On the Binding of Associations in Memory: Clues From Studies on the Role of the Hippocampal Region in Paired-Associate Learning , 1995 .

[28]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[29]  J. Kastner Beyond The Information Given Studies In The Psychology Of Knowing , 2016 .

[30]  T. Albright,et al.  Remembering Visual Motion: Neural Correlates of Associative Plasticity and Motion Recall in Cortical Area MT , 2007, Neuron.

[31]  H. Bülthoff,et al.  Effects of temporal association on recognition memory , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Misha Tsodyks,et al.  Mapping dynamic memories of gradually changing objects , 2009, Proceedings of the National Academy of Sciences.

[33]  Gabriele Janzen,et al.  Selective neural representation of objects relevant for navigation , 2004, Nature Neuroscience.