Functional Context Affects Scene Processing

Rapid visual perception is often viewed as a bottom-up process. Category-preferred neural regions are often characterized as automatic, default processing mechanisms for visual inputs of their categorical preference. To explore the sensitivity of such regions to top-down information, we examined three scene-preferring brain regions, the occipital place area (OPA), the parahippocampal place area (PPA), and the retrosplenial complex (RSC), and tested whether the processing of outdoor scenes is influenced by the functional contexts in which they are seen. Context was manipulated by presenting real-world landscape images as if being viewed through a window or within a picture frame; manipulations that do not affect scene content but do affect one’s functional knowledge regarding the scene. This manipulation influences neural scene processing (as measured by fMRI): the OPA and PPA exhibited greater neural activity when participants viewed images as if through a window as compared to within a picture frame, while the RSC did not show this difference. In a separate behavioral experiment, functional context affected scene memory in predictable directions (boundary extension). Our interpretation is that the window context denotes three-dimensionality, therefore rendering the perceptual experience of viewing landscapes as more realistic. Conversely, the frame context denotes a two-dimensional image. As such, more spatially-biased scene representations in the OPA and the PPA are influenced by differences in top-down, perceptual expectations generated from context. In contrast, more semantically-biased scene representations in the RSC are likely to be less affected by top-down signals that carry information about the physical layout of a scene.

[1]  Marius V Peelen,et al.  The Neural Dynamics of Attentional Selection in Natural Scenes , 2016, The Journal of Neuroscience.

[2]  Andrew P. Yonelinas,et al.  Adaptation to cognitive context and item information in the medial temporal lobes , 2012, Neuropsychologia.

[3]  Yaoda Xu,et al.  Goal-Directed Visual Processing Differentially Impacts Human Ventral and Dorsal Visual Representations , 2017, The Journal of Neuroscience.

[4]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[5]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[6]  Alexander G. Huth,et al.  Attention During Natural Vision Warps Semantic Representation Across the Human Brain , 2013, Nature Neuroscience.

[7]  Talma Hendler,et al.  Center–periphery organization of human object areas , 2001, Nature Neuroscience.

[8]  I. Daum,et al.  Associations evoked during memory encoding recruit the context‐network , 2009, Hippocampus.

[9]  Jason P. Gallivan,et al.  Neural representation of geometry and surface properties in object and scene perception , 2017, NeuroImage.

[10]  Li Fei-Fei,et al.  Two distinct scene processing networks connecting vision and memory , 2016, bioRxiv.

[11]  Gabriele Janzen,et al.  Selective neural representation of objects relevant for navigation , 2004, Nature Neuroscience.

[12]  Russell A. Epstein,et al.  Scene Perception in the Human Brain. , 2019, Annual review of vision science.

[13]  Russell A. Epstein,et al.  Multiple object properties drive scene-selective regions. , 2014, Cerebral cortex.

[14]  Aude Oliva,et al.  Parametric Coding of the Size and Clutter of Natural Scenes in the Human Brain. , 2014, Cerebral cortex.

[15]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[16]  M. Bar,et al.  Cortical Analysis of Visual Context , 2003, Neuron.

[17]  Michael J. Tarr,et al.  Associative Processing Is Inherent in Scene Perception , 2015, PloS one.

[18]  M. Bar,et al.  Scenes Unseen: The Parahippocampal Cortex Intrinsically Subserves Contextual Associations, Not Scenes or Places Per Se , 2008, The Journal of Neuroscience.

[19]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[20]  I. Biederman,et al.  Scene perception: Detecting and judging objects undergoing relational violations , 1982, Cognitive Psychology.

[21]  David C. Van Essen,et al.  Application of Information Technology: An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex , 2001, J. Am. Medical Informatics Assoc..

[22]  Jack L. Gallant,et al.  Human Scene-Selective Areas Represent 3D Configurations of Surfaces , 2019, Neuron.

[23]  Albert Postma,et al.  Hemispheric differences in spatial relation processing in a scene perception task: A neuropsychological study , 2011, Neuropsychologia.

[24]  Louise Kauffmann,et al.  The neural bases of spatial frequency processing during scene perception , 2014, Front. Integr. Neurosci..

[25]  Wilma A. Bainbridge,et al.  Boundaries Extend and Contract in Scene Memory Depending on Image Properties , 2019, Current Biology.

[26]  Robert E Kass,et al.  Exploring spatiotemporal neural dynamics of the human visual cortex , 2019, Human brain mapping.

[27]  Soojin Park,et al.  Disentangling Scene Content from Spatial Boundary: Complementary Roles for the Parahippocampal Place Area and Lateral Occipital Complex in Representing Real-World Scenes , 2011, The Journal of Neuroscience.

[28]  F. D. de Lange,et al.  Prior Expectations Bias Sensory Representations in Visual Cortex , 2013, The Journal of Neuroscience.

[29]  John M. Henderson,et al.  Functions of parahippocampal place area and retrosplenial cortex in real-world scene analysis: An fMRI study , 2011 .

[30]  Irving Biederman,et al.  On the Semantics of a Glance at a Scene , 2017 .

[31]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[32]  Roger B. H. Tootell,et al.  A Cardinal Orientation Bias in Scene-Selective Visual Cortex , 2012, The Journal of Neuroscience.

[33]  Alexander G. Huth,et al.  Functional Subdomains within Scene-Selective Cortex: Parahippocampal Place Area, Retrosplenial Complex, and Occipital Place Area , 2016, The Journal of Neuroscience.

[34]  Radoslaw Martin Cichy,et al.  The representational dynamics of task and object processing in humans , 2018, eLife.

[35]  Daniel D. Dilks,et al.  The Occipital Place Area Is Causally and Selectively Involved in Scene Perception , 2013, The Journal of Neuroscience.

[36]  Eleanor A. Maguire,et al.  Retrosplenial Cortex Codes for Permanent Landmarks , 2012, PloS one.

[37]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[38]  D. Kersten,et al.  Attention-Dependent Representation of a Size Illusion in Human V1 , 2008, Current Biology.

[39]  Russell A. Epstein,et al.  The Occipital Place Area Is Causally Involved in Representing Environmental Boundaries during Navigation , 2016, Current Biology.

[40]  Russell A. Epstein,et al.  Outside Looking In: Landmark Generalization in the Human Navigational System , 2015, The Journal of Neuroscience.

[41]  Jonathan S. Cant,et al.  Scratching Beneath the Surface: New Insights into the Functional Properties of the Lateral Occipital Area and Parahippocampal Place Area , 2011, The Journal of Neuroscience.

[42]  Russell A. Epstein,et al.  Coding of navigational affordances in the human visual system , 2017, Proceedings of the National Academy of Sciences.

[43]  C. Schmidt,et al.  Partially segregated neural networks for spatial and contextual memory in virtual navigation , 2008, Hippocampus.

[44]  Michelle R. Greene,et al.  Recognition of natural scenes from global properties: Seeing the forest without representing the trees , 2009, Cognitive Psychology.

[45]  M. Bar,et al.  The role of the parahippocampal cortex in cognition , 2013, Trends in Cognitive Sciences.

[46]  Marius V. Peelen,et al.  Interaction between Scene and Object Processing Revealed by Human fMRI and MEG Decoding , 2017, The Journal of Neuroscience.

[47]  E. Maguire The retrosplenial contribution to human navigation: a review of lesion and neuroimaging findings. , 2001, Scandinavian journal of psychology.

[48]  Dwight J. Kravitz,et al.  Real-World Scene Representations in High-Level Visual Cortex: It's the Spaces More Than the Places , 2011, The Journal of Neuroscience.

[49]  Itamar Kahn,et al.  Hemispheric asymmetry of visual scene processing in the human brain: evidence from repetition priming and intrinsic activity. , 2012, Cerebral cortex.

[50]  Li Fei-Fei,et al.  Two Distinct Scene-Processing Networks Connecting Vision and Memory , 2016, eNeuro.

[51]  Christopher A. Baldassano,et al.  Pinpointing the peripheral bias in neural scene-processing networks during natural viewing. , 2016, Journal of vision.

[52]  M. Chun,et al.  Attentional Modulation of Learning-Related Repetition Attenuation Effects in Human Parahippocampal Cortex , 2005, The Journal of Neuroscience.

[53]  Soojin Park,et al.  Different roles of the parahippocampal place area (PPA) and retrosplenial cortex (RSC) in panoramic scene perception , 2009, NeuroImage.

[54]  Kendrick N Kay,et al.  Bottom-up and top-down computations in word- and face-selective cortex , 2017, eLife.

[55]  Dwight J. Kravitz,et al.  A Retinotopic Basis for the Division of High-Level Scene Processing between Lateral and Ventral Human Occipitotemporal Cortex , 2015, The Journal of Neuroscience.

[56]  Dwight J. Kravitz,et al.  Deconstructing visual scenes in cortex: gradients of object and spatial layout information. , 2013, Cerebral cortex.

[57]  Alain Berthoz,et al.  Selective role of lingual/parahippocampal gyrus and retrosplenial complex in spatial memory across viewpoint changes relative to the environmental reference frame , 2013, Behavioural Brain Research.

[58]  H. Intraub,et al.  Wide-angle memories of close-up scenes. , 1989, Journal of experimental psychology. Learning, memory, and cognition.