Constructing scenes from objects in human occipitotemporal cortex

We used functional magnetic resonance imaging (fMRI) to demonstrate the existence of a mechanism in the human lateral occipital (LO) cortex that supports recognition of real-world visual scenes through parallel analysis of within-scene objects. Neural activity was recorded while subjects viewed four categories of scenes and eight categories of 'signature' objects strongly associated with the scenes in three experiments. Multivoxel patterns evoked by scenes in the LO cortex were well predicted by the average of the patterns elicited by their signature objects. By contrast, there was no relationship between scene and object patterns in the parahippocampal place area (PPA), even though this region responds strongly to scenes and is believed to be crucial for scene identification. By combining information about multiple objects within a scene, the LO cortex may support an object-based channel for scene recognition that complements the processing of global scene properties in the PPA.

[1]  Russell A. Epstein.  Parahippocampal and retrosplenial contributions to human spatial navigation , 2008, Trends in Cognitive Sciences.

[2]  David Rogosa,et al.  Comparing nonparallel regression lines. , 1980 .

[3]  Michelle R. Greene,et al.  Recognition of natural scenes from global properties: Seeing the forest without representing the trees , 2009, Cognitive Psychology.

[4]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Sean P. MacEvoy,et al.  A precise form of divisive suppression supports population coding in primary visual cortex , 2009, Nature Neuroscience.

[6]  Ryan J. Prenger,et al.  Bayesian Reconstruction of Natural Images from Human Brain Activity , 2009, Neuron.

[7]  Ann Allergy,et al.  O R I G I N a L a R T I C L E S , 2022 .

[8]  Dirk B. Walther,et al.  Natural Scene Categories Revealed in Distributed Patterns of Activity in the Human Brain , 2009, The Journal of Neuroscience.

[9]  A. Kleinschmidt,et al.  Graded size sensitivity of object-exemplar-evoked activity patterns within human LOC subregions. , 2008, Journal of neurophysiology.

[10]  I. Biederman,et al.  On the information extracted from a glance at a scene. , 1974, Journal of experimental psychology.

[11]  K. Grill-Spector,et al.  Relating retinotopic and object-selective responses in human lateral occipital cortex. , 2008, Journal of neurophysiology.

[12]  Kalanit Grill-Spector,et al.  The representation of object viewpoint in human visual cortex , 2009, NeuroImage.

[13]  J. Gallant,et al.  Identifying natural images from human brain activity , 2008, Nature.

[14]  R. VanRullen,et al.  Attention and biased competition in multi-voxel object representations , 2009, Proceedings of the National Academy of Sciences.

[15]  James J DiCarlo,et al.  Multiple Object Response Normalization in Monkey Inferotemporal Cortex , 2005, The Journal of Neuroscience.

[16]  Dwight J. Kravitz,et al.  Real-World Scene Representations in High-Level Visual Cortex: It's the Spaces More Than the Places , 2011, The Journal of Neuroscience.

[17]  R. Desimone,et al.  Neural mechanisms of selective visual attention. , 1995, Annual review of neuroscience.

[18]  D. Schacter,et al.  Perceptual specificity in visual object priming: functional magnetic resonance imaging evidence for a laterality difference in fusiform cortex , 2001, Neuropsychologia.

[19]  R. Desimone,et al.  Selective attention gates visual processing in the extrastriate cortex. , 1985, Science.

[20]  M. Bar,et al.  Cortical Analysis of Visual Context , 2003, Neuron.

[21]  G. Aguirre,et al.  Different spatial scales of shape similarity representation in lateral and ventral LOC. , 2009, Cerebral cortex.

[22]  P. Perona,et al.  What do we perceive in a glance of a real-world scene? , 2007, Journal of vision.

[23]  A. Oliva,et al.  From Blobs to Boundary Edges: Evidence for Time- and Spatial-Scale-Dependent Scene Recognition , 1994 .

[24]  M. D’Esposito,et al.  An Area within Human Ventral Cortex Sensitive to “Building” Stimuli Evidence and Implications , 1998, Neuron.

[25]  Rainer Goebel,et al.  Information-based functional brain mapping. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Dwight J. Kravitz,et al.  High-level visual object representations are constrained by position. , 2010, Cerebral cortex.

[27]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[28]  Jitendra Malik,et al.  When is scene identification just texture recognition? , 2004, Vision Research.

[29]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[30]  N. Kanwisher,et al.  How Distributed Is Visual Category Information in Human Occipito-Temporal Cortex? An fMRI Study , 2002, Neuron.

[31]  R. K. Simpson.  Nature Neuroscience , 2022 .

[32]  N. Kanwisher,et al.  Multivariate Patterns in Object-Selective Cortex Dissociate Perceptual and Physical Shape Similarity , 2008, PLoS biology.

[33]  Russell A. Epstein,et al.  Differential parahippocampal and retrosplenial involvement in three types of visual scene recognition. , 2006, Cerebral cortex.

[34]  Rachel A Diana,et al.  High‐resolution multi‐voxel pattern analysis of category selectivity in the medial temporal lobes , 2008, Hippocampus.

[35]  S. Kastner,et al.  Stimulus similarity modulates competitive interactions in human visual cortex. , 2007, Journal of vision.

[36]  M. Potter,et al.  Pictorial and conceptual representation of glimpsed pictures. , 2004, Journal of experimental psychology. Human perception and performance.

[37]  Paul E. Downing,et al.  Viewpoint-Specific Scene Representations in Human Parahippocampal Cortex , 2003, Neuron.

[38]  Nancy Kanwisher,et al.  The distribution of category and location information across object-selective regions in human visual cortex , 2008, Proceedings of the National Academy of Sciences.

[39]  S. Kastner,et al.  Stimulus context modulates competition in human extrastriate cortex , 2005, Nature Neuroscience.

[40]  Kristin Andrews,et al.  Evidence and implications , 2011 .

[41]  Li Fei-Fei,et al.  Neural mechanisms of rapid natural scene categorization in human visual cortex , 2009, Nature.

[42]  Russell A. Epstein,et al.  Where Am I Now? Distinct Roles for Parahippocampal and Retrosplenial Cortices in Place Recognition , 2007, The Journal of Neuroscience.

[43]  M. Potter.  Meaning in visual search. , 1975, Science.

[44]  Geoffrey Karl Aguirre,et al.  Continuous carry-over designs for fMRI , 2007, NeuroImage.

[45]  Russell A. Epstein,et al.  Decoding the Representation of Multiple Simultaneous Objects in Human Occipitotemporal Cortex , 2009, Current Biology.

[46]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[47]  Soojin Park,et al.  Disentangling Scene Content from Spatial Boundary: Complementary Roles for the Parahippocampal Place Area and Lateral Occipital Complex in Representing Real-World Scenes , 2011, The Journal of Neuroscience.

[48]  A. Sirigu,et al.  Pure Topographical Disorientation: A Definition and Anatomical Basis , 1987, Cortex.

[49]  Irving Biederman,et al.  Adaptation to objects in the lateral occipital complex (LOC): Shape or semantics? , 2009, Vision Research.

[50]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[51]  M. D’Esposito,et al.  Topographical disorientation: a synthesis and taxonomy. , 1999, Brain : a journal of neurology.

[52]  Dale D. Murphy,et al.  Evidence and Implications , 2006 .