Cortical Integration of Contextual Information across Objects

Recognizing objects in the environment and understanding our surroundings often depends on context: the presence of other objects and knowledge about their relations with each other. Such contextual information activates a set of medial lobe brain regions, the parahippocampal cortex and the retrosplenial complex. Both regions are more activated by single objects with a unique contextual association than by objects not associated with any specific context. Similarly they are more activated by spatially coherent arrangements of objects when those are consistent with their known spatial relations. The current study tested how context in multiple-object displays is represented in these regions in the absence of relevant spatial information. Using an fMRI slow-event-related design, we show that the precuneus (a subpart of the retrosplenial complex) is more activated by simultaneously presented contextually related objects than by unrelated objects. This suggests that the representation of context in this region is cumulative, representing integrated information across objects in the display. We discuss these findings in relation to processing of visual information and relate them to previous findings of contextual effects in perception.

[1]  Jason A. Droll,et al.  Expected object position of two hundred fifty observers predicts first fixations of seventy seven separate observers during search , 2010 .

[2]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[3]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[4]  Rafael Malach,et al.  Large-Scale Mirror-Symmetry Organization of Human Occipito-Temporal Object Areas , 2003, Neuron.

[5]  John T. Clark,et al.  Contextually Evoked Object-Specific Responses in Human Visual Cortex , 2004 .

[6]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[7]  M. D’Esposito,et al.  An Area within Human Ventral Cortex Sensitive to “Building” Stimuli Evidence and Implications , 1998, Neuron.

[8]  Yaoda Xu,et al.  Representing connected and disconnected shapes in human inferior intraparietal sulcus , 2008, NeuroImage.

[9]  J. Taylor,et al.  Episodic retrieval activates the precuneus irrespective of the imagery content of word pair associates. A PET study. , 1999, Brain : a journal of neurology.

[10]  Jodi L. Davenport,et al.  Scene Consistency in Object and Background Perception , 2004, Psychological science.

[11]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[12]  Irving Biederman,et al.  Where do objects become scenes? , 2010, Cerebral Cortex.

[13]  N. Kanwisher,et al.  The Human Body , 2001 .

[14]  M. Bar Visual objects in context , 2004, Nature Reviews Neuroscience.

[15]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[16]  Jodi L. Davenport Consistency effects between objects in scenes , 2007, Memory & cognition.

[17]  M. Corbetta,et al.  Episodic Memory Retrieval, Parietal Cortex, and the Default Mode Network: Functional and Topographic Analyses , 2011, The Journal of Neuroscience.

[18]  tephen E. Palmer The effects of contextual scenes on the identification of objects , 1975, Memory & cognition.

[19]  M. Bar,et al.  The parahippocampal cortex mediates spatial and nonspatial associations. , 2007, Cerebral cortex.

[20]  Guillaume A. Rousselet,et al.  Processing scene context: Fast categorization and object interference , 2007, Vision Research.

[21]  L. Deouell,et al.  ERP evidence for context congruity effects during simultaneous object–scene processing , 2010, Neuropsychologia.

[22]  M. Bar,et al.  The units of thought , 2007, Hippocampus.

[23]  Kaia L. Vilberg,et al.  Brain Networks Underlying Episodic Memory Retrieval This Review Comes from a Themed Issue on Macrocircuits Memory Signals within the Mtl , 2022 .

[24]  Russell A. Epstein,et al.  Multiple object properties drive scene-selective regions. , 2014, Cerebral cortex.

[25]  Richard S. J. Frackowiak,et al.  The Mind's Eye—Precuneus Activation in Memory-Related Imagery , 1995, NeuroImage.

[26]  N. Kanwisher,et al.  Mental Imagery of Faces and Places Activates Corresponding Stimulus-Specific Brain Regions , 2000, Journal of Cognitive Neuroscience.

[27]  Russell A. Epstein Parahippocampal and retrosplenial contributions to human spatial navigation , 2008, Trends in Cognitive Sciences.

[28]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[29]  Moshe Bar,et al.  Integrated Contextual Representation for Objects' Identities and Their Locations , 2008, Journal of Cognitive Neuroscience.

[30]  Ashley M. Sherman,et al.  Visual search for arbitrary objects in real scenes , 2011, Attention, perception & psychophysics.

[31]  G L Shulman,et al.  INAUGURAL ARTICLE by a Recently Elected Academy Member:A default mode of brain function , 2001 .

[32]  D. Schacter,et al.  The Brain's Default Network , 2008, Annals of the New York Academy of Sciences.

[33]  A. Oliva,et al.  A Real-World Size Organization of Object Responses in Occipitotemporal Cortex , 2012, Neuron.

[34]  Soojin Park,et al.  Refreshing and Integrating Visual Scenes in Scene-selective Cortex , 2010, Journal of Cognitive Neuroscience.

[35]  I. Biederman,et al.  Searching for objects in real-world scences. , 1973, Journal of experimental psychology.

[36]  Eleanor A. Maguire,et al.  Assessing the mechanism of response in the retrosplenial cortex of good and poor navigators☆ , 2013, Cortex.

[37]  M. Corbetta,et al.  Common Blood Flow Changes across Visual Tasks: II. Decreases in Cerebral Cortex , 1997, Journal of Cognitive Neuroscience.

[38]  Leslie G. Ungerleider,et al.  The Effect of Face Inversion on Activity in Human Neural Systems for Face and Object Perception , 1999, Neuron.

[39]  Russell A. Epstein,et al.  Where Am I Now? Distinct Roles for Parahippocampal and Retrosplenial Cortices in Place Recognition , 2007, The Journal of Neuroscience.

[40]  M. Kutas,et al.  An electrophysiological study of scene effects on object identification. , 2003, Brain research. Cognitive brain research.

[41]  S. Ullman,et al.  Spatial Context in Recognition , 1996, Perception.

[42]  P. de Graef,et al.  Perceptual effects of scene context on object identification , 1990, Psychological research.

[43]  M. Bar,et al.  Cortical Analysis of Visual Context , 2003, Neuron.

[44]  Moshe Bar,et al.  The resilience of object predictions: Early recognition across viewpoints and exemplars , 2014, Psychonomic bulletin & review.

[45]  Karl Magnus Petersson,et al.  The role of precuneus and left inferior frontal cortex during source memory episodic retrieval , 2005, NeuroImage.

[46]  I. Biederman Perceiving Real-World Scenes , 1972, Science.