Concavity as a diagnostic feature of visual scenes

Despite over two decades of research on the neural mechanisms underlying human visual scene, or place, processing, it remains unknown what exactly a “scene” is. Intuitively, we are always inside a scene, while interacting with the outside of objects. Hence, we hypothesize that one diagnostic feature of a scene may be concavity, portraying “inside”, and predict that if concavity is a scene-diagnostic feature, then: 1) images that depict concavity, even non-scene images (e.g., the “inside” of an object – or concave object), will be behaviorally categorized as scenes more often than those that depict convexity, and 2) the cortical scene-processing system will respond more to concave images than to convex images. As predicted, participants categorized concave objects as scenes more often than convex objects, and, using functional magnetic resonance imaging (fMRI), two scene-selective cortical regions (the parahippocampal place area, PPA, and the occipital place area, OPA) responded significantly more to concave than convex objects. Surprisingly, we found no behavioral or neural differences between images of concave versus convex buildings. However, in a follow-up experiment, using tightly-controlled images, we unmasked a selective sensitivity to concavity over convexity of scene boundaries (i.e., walls) in PPA and OPA. Furthermore, we found that even highly impoverished line drawings of concave shapes are behaviorally categorized as scenes more often than convex shapes. Together, these results provide converging behavioral and neural evidence that concavity is a diagnostic feature of visual scenes.

[1]  Louise Kauffmann,et al.  The neural bases of spatial frequency processing during scene perception , 2014, Front. Integr. Neurosci..

[2]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[3]  Stephen M. Smith,et al.  Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference , 2009, NeuroImage.

[4]  Chris I Baker,et al.  Contributions of low- and high-level properties to neural processing of visual scenes in the human brain , 2017, Philosophical Transactions of the Royal Society B: Biological Sciences.

[5]  Roger B. H. Tootell,et al.  A Cardinal Orientation Bias in Scene-Selective Visual Cortex , 2012, The Journal of Neuroscience.

[6]  Fei-Fei Li,et al.  Differential connectivity within the Parahippocampal Place Area , 2013, NeuroImage.

[7]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[8]  Daniel D. Dilks,et al.  Dissociable Neural Systems for Recognizing Places and Navigating through Them , 2018, The Journal of Neuroscience.

[9]  Chris I. Baker,et al.  A Posterior–Anterior Distinction between Scene Perception and Scene Construction in Human Medial Parietal Cortex , 2018, The Journal of Neuroscience.

[10]  Daniel D. Dilks,et al.  Mirror-Image Sensitivity and Invariance in Object and Scene Processing Pathways , 2011, The Journal of Neuroscience.

[11]  Daniel D. Dilks,et al.  The occipital place area represents the local elements of scenes , 2016, NeuroImage.

[12]  R. Tootell,et al.  Thinking Outside the Box: Rectilinear Shapes Selectively Activate Scene-Selective Cortex , 2014, The Journal of Neuroscience.

[13]  Jason P. Gallivan,et al.  Neural representation of geometry and surface properties in object and scene perception , 2017, NeuroImage.

[14]  Katrina Ferrara,et al.  Neural representation of scene boundaries , 2016, Neuropsychologia.

[15]  Dirk B Walther,et al.  Scene content is predominantly conveyed by high spatial frequencies in scene-selective visual cortex , 2017, PloS one.

[16]  Aude Oliva,et al.  A toolbox and sample object perception data for equalization of natural images , 2015, Data in brief.

[17]  Nancy Kanwisher,et al.  Cerebral Cortex doi:10.1093/cercor/bhr357 Higher Level Visual Cortex Represents Retinotopic, Not Spatiotopic, Object Location , 2011 .

[18]  Jonathan S. Cant,et al.  The Contribution of Object Shape and Surface Properties to Object Ensemble Representation in Anterior-medial Ventral Visual Cortex , 2017, Journal of Cognitive Neuroscience.

[19]  Dwight J. Kravitz,et al.  Real-World Scene Representations in High-Level Visual Cortex: It's the Spaces More Than the Places , 2011, The Journal of Neuroscience.

[20]  J W Belliveau,et al.  Borders of multiple visual areas in humans revealed by functional magnetic resonance imaging. , 1995, Science.

[21]  Jack L. Gallant,et al.  Human Scene-Selective Areas Represent 3D Configurations of Surfaces , 2019, Neuron.

[22]  Li Fei-Fei,et al.  Simple line drawings suffice for functional MRI decoding of natural scene categories , 2011, Proceedings of the National Academy of Sciences.

[23]  Soojin Park,et al.  Disentangling Scene Content from Spatial Boundary: Complementary Roles for the Parahippocampal Place Area and Lateral Occipital Complex in Representing Real-World Scenes , 2011, The Journal of Neuroscience.

[24]  Aude Oliva,et al.  Parametric Coding of the Size and Clutter of Natural Scenes in the Human Brain. , 2014, Cerebral cortex.

[25]  M. Bar,et al.  Cortical Analysis of Visual Context , 2003, Neuron.

[26]  M. D’Esposito,et al.  An Area within Human Ventral Cortex Sensitive to “Building” Stimuli Evidence and Implications , 1998, Neuron.

[27]  Daniel D. Dilks,et al.  Distinct representations of spatial and categorical relationships across human scene-selective cortex , 2019, Proceedings of the National Academy of Sciences.

[28]  Michael A. Cohen,et al.  Mid-level perceptual features distinguish objects of different real-world sizes. , 2016, Journal of experimental psychology. General.

[29]  C. Baker,et al.  Scene-Selectivity and Retinotopy in Medial Parietal Cortex , 2016, Front. Hum. Neurosci..

[30]  Talia Konkle,et al.  Mid-level visual features underlie the high-level categorical organization of the ventral stream , 2018, Proceedings of the National Academy of Sciences.

[31]  Soojin Park,et al.  Conjoint representation of texture ensemble and location in the parahippocampal place area. , 2017, Journal of neurophysiology.

[32]  E. Maguire The retrosplenial contribution to human navigation: a review of lesion and neuroimaging findings. , 2001, Scandinavian journal of psychology.

[33]  Russell A. Epstein,et al.  Rectilinear Edge Selectivity Is Insufficient to Explain the Category Selectivity of the Parahippocampal Place Area , 2016, Front. Hum. Neurosci..

[34]  Daniel D. Dilks,et al.  Places in the Brain: Bridging Layout and Object Geometry in Scene-Selective Cortex , 2018, Cerebral cortex.

[35]  Charles E. Connor,et al.  A Channel for 3D Environmental Shape in Anterior Inferotemporal Cortex , 2014, Neuron.

[36]  Michelle R. Greene,et al.  PSYCHOLOGICAL SCIENCE Research Article The Briefest of Glances The Time Course of Natural Scene Understanding , 2022 .

[37]  H. Bülthoff,et al.  Representation of the perceived 3-D object shape in the human lateral occipital complex. , 2003, Cerebral cortex.

[38]  Russell A. Epstein,et al.  Anchoring the neural compass: Coding of local spatial reference frames in human medial parietal lobe , 2014, Nature Neuroscience.

[39]  S. Edelman,et al.  Human Brain Mapping 6:316–328(1998) � A Sequence of Object-Processing Stages Revealed by fMRI in the Human Occipital Lobe , 2022 .

[40]  N. Kanwisher,et al.  How Distributed Is Visual Category Information in Human Occipito-Temporal Cortex? An fMRI Study , 2002, Neuron.

[41]  Dirk B. Walther,et al.  Contour junctions underlie neural representations of scene categories in high-level human visual cortex , 2016, NeuroImage.

[42]  Michelle R. Greene,et al.  The Briefest of Glances: The Time Course of Natural Scene Understanding , 2009 .

[43]  Nikolaus Kriegeskorte,et al.  Rapid Invariant Encoding of Scene Layout in Human OPA , 2019, Neuron.

[44]  Jonathan S. Cant,et al.  Scratching Beneath the Surface: New Insights into the Functional Properties of the Lateral Occipital Area and Parahippocampal Place Area , 2011, The Journal of Neuroscience.

[45]  Nancy Kanwisher,et al.  Privileged coding of convex shapes in human object-selective cortex. , 2008, Journal of neurophysiology.

[46]  Li Fei-Fei,et al.  Two Distinct Scene-Processing Networks Connecting Vision and Memory , 2016, eNeuro.

[47]  Daniel D. Dilks,et al.  Perceived egocentric distance sensitivity and invariance across scene-selective cortex , 2016, Cortex.

[48]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[49]  Nikolaus Kriegeskorte,et al.  Rapid invariant encoding of scene layout in human OPA , 2019 .

[50]  Natalia Y. Bilenko,et al.  The “Parahippocampal Place Area” Responds Preferentially to High Spatial Frequencies in Humans and Monkeys , 2011, PLoS biology.

[51]  Soojin Park,et al.  Different roles of the parahippocampal place area (PPA) and retrosplenial cortex (RSC) in panoramic scene perception , 2009, NeuroImage.

[52]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[53]  Daniel D. Dilks,et al.  The Occipital Place Area Is Causally and Selectively Involved in Scene Perception , 2013, The Journal of Neuroscience.

[54]  Paul E. Downing,et al.  Viewpoint-Specific Scene Representations in Human Parahippocampal Cortex , 2003, Neuron.