Brain Regions Involved in Conceptual Retrieval in Sighted and Blind People

If conceptual retrieval is partially based on the simulation of sensorimotor experience, people with a different sensorimotor experience, such as congenitally blind people, should retrieve concepts in a different way. However, studies investigating the neural basis of several conceptual domains (e.g., actions, objects, places) have shown a very limited impact of early visual deprivation. We approached this problem by investigating brain regions that encode the perceptual similarity of action and color concepts evoked by spoken words in sighted and congenitally blind people. At first, and in line with previous findings, a contrast between action and color concepts (independently of their perceptual similarity) revealed similar activations in sighted and blind people for action concepts and partially different activations for color concepts, but outside visual areas. On the other hand, adaptation analyses based on subjective ratings of perceptual similarity showed compelling differences across groups. Perceptually similar colors and actions induced adaptation in the posterior occipital cortex of sighted people only, overlapping with regions known to represent low-level visual features of those perceptual domains. Early-blind people instead showed a stronger adaptation for perceptually similar concepts in temporal regions, arguably indexing higher reliance on a lexical-semantic code to represent perceptual knowledge. Overall, our results show that visual deprivation does changes the neural bases of conceptual retrieval, but mostly at specific levels of representation supporting perceptual similarity discrimination, reconciling apparently contrasting findings in the field.

[1]  Max M. Louwerse,et al.  A Taste of Words: Linguistic Context and Perceptual Simulation Predict the Modality of Words , 2011, Cogn. Sci..

[2]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[3]  H. P. Op de Beeck,et al.  Dissociations and Associations between Shape and Category Representations in the Two Visual Pathways , 2015, The Journal of Neuroscience.

[4]  R. Malach,et al.  Early ‘visual’ cortex activation correlates with superior verbal memory performance in the blind , 2003, Nature Neuroscience.

[5]  Mark S. Seidenberg,et al.  Concept Representation Reflects Multimodal Abstraction: A Framework for Embodied Semantics. , 2016, Cerebral cortex.

[6]  Falk Huettig,et al.  A Task-Dependent Causal Role for Low-Level Visual Processes in Spoken Word Comprehension , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[7]  A. Caramazza,et al.  Nonvisual and Visual Object Shape Representations in Occipitotemporal Cortex: Evidence from Congenitally Blind and Sighted Adults , 2014, The Journal of Neuroscience.

[8]  M. Kubicki,et al.  Connectivity among semantic associates: An fMRI study of semantic priming , 2006, Brain and Language.

[9]  J. S. Guntupalli,et al.  The Representation of Biological Classes in the Human Brain , 2012, The Journal of Neuroscience.

[10]  Michael S. Beauchamp,et al.  Automatic Priming of Semantically Related Words Reduces Activity in the Fusiform Gyrus , 2005, Journal of Cognitive Neuroscience.

[11]  Karen Emmorey,et al.  Modulation of BOLD Response in Motion-sensitive Lateral Temporal Cortex by Real and Fictive Motion Sentences , 2010, Journal of Cognitive Neuroscience.

[12]  O. Collignon,et al.  Functional selectivity in sensory-deprived cortices. , 2011, Journal of neurophysiology.

[13]  O. Collignon,et al.  Is Red Heavier Than Yellow Even for Blind? , 2018, i-Perception.

[14]  P. Pietrini,et al.  Imagery and spatial processes in blindness and visual impairment , 2008, Neuroscience & Biobehavioral Reviews.

[15]  Rutvik H. Desai,et al.  The neurobiology of semantic memory , 2011, Trends in Cognitive Sciences.

[16]  Daria Proklova,et al.  Disentangling Representations of Object Shape and Object Category in Human Visual Cortex: The Animate–Inanimate Distinction , 2016, Journal of Cognitive Neuroscience.

[17]  G. S. Marmor Age at onset of blindness and the development of the semantics of color names. , 1978, Journal of experimental child psychology.

[18]  Alan C. Evans,et al.  A new anatomical landmark for reliable identification of human area V5/MT: a quantitative analysis of sulcal patterning. , 2000, Cerebral cortex.

[19]  K. Grill-Spector,et al.  The functional architecture of the ventral temporal cortex and its role in categorization , 2014, Nature Reviews Neuroscience.

[20]  Mario Aguilar,et al.  Predicting Neural Activity Patterns Associated with Sentences Using a Neurobiologically Motivated Model of Semantic Representation , 2016, Cerebral cortex.

[21]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[22]  O. Collignon,et al.  Neuronal populations in the occipital cortex of the blind synchronize to the temporal dynamics of speech , 2017, bioRxiv.

[23]  Martin A. Lindquist,et al.  Detection of time-varying signals in event-related fMRI designs , 2008, NeuroImage.

[24]  M. Ptito,et al.  Compensatory plasticity and cross-modal reorganization following early visual deprivation , 2014, Neuroscience & Biobehavioral Reviews.

[25]  Alex Martin GRAPES—Grounding representations in action, perception, and emotion systems: How object properties and categories are represented in the human brain , 2015, Psychonomic Bulletin & Review.

[26]  L. Barsalou On Staying Grounded and Avoiding Quixotic Dead Ends , 2016, Psychonomic Bulletin & Review.

[27]  A. Caramazza,et al.  Neural representation of visual concepts in people born blind , 2018, Nature Communications.

[28]  M. Corballis,et al.  Colour envisioned: concepts of colour in the blind and sighted , 2018 .

[29]  A. Caramazza,et al.  Typical neural representations of action verbs develop without vision. , 2012, Cerebral cortex.

[30]  R. Bottini,et al.  The nature of semantic priming by subliminal spatial words: Embodied or disembodied? , 2016, Journal of experimental psychology. General.

[31]  R. Saxe,et al.  Insights into the origins of knowledge from the cognitive neuroscience of blindness , 2012, Cognitive neuropsychology.

[32]  Ryan J. Prenger,et al.  Bayesian Reconstruction of Natural Images from Human Brain Activity , 2009, Neuron.

[33]  M. Bedny Evidence from Blindness for a Cognitively Pluripotent Cortex , 2017, Trends in Cognitive Sciences.

[34]  Morgan D Barense,et al.  Integrative and distinctive coding of visual and conceptual object features in the ventral visual stream , 2018, eLife.

[35]  O. Collignon,et al.  Early blindness alters the spatial organization of verbal working memory , 2016, Cortex.

[36]  D. Casasanto,et al.  Different Bodies, Different Minds , 2011 .

[37]  A. Caramazza,et al.  For a cognitive neuroscience of concepts: Moving beyond the grounding issue , 2016, Psychonomic bulletin & review.

[38]  William W. Graves,et al.  Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. , 2009, Cerebral cortex.

[39]  Massimo Poesio,et al.  Reading visually embodied meaning from the brain: Visually grounded computational models decode visual-object mental imagery induced by written text , 2015, NeuroImage.

[40]  Karl J. Friston,et al.  A direct demonstration of functional specialization in human visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[41]  Christian Büchel,et al.  Cortical hierarchy turned on its head , 2003, Nature Neuroscience.

[42]  Karl J. Friston,et al.  Slice-timing effects and their correction in functional MRI , 2011, NeuroImage.

[43]  Frank E. Garcea,et al.  When concepts lose their color: A case of object-color knowledge impairment , 2014, Cortex.

[44]  Samuel W Cheadle,et al.  The role of parietal cortex in the formation of color and motion based concepts , 2014, Front. Hum. Neurosci..

[45]  J. Binder In defense of abstract conceptual representations , 2016, Psychonomic Bulletin & Review.

[46]  Sonja A. Kotz,et al.  Modulation of the Lexical–Semantic Network by Auditory Semantic Priming: An Event-Related Functional MRI Study , 2002, NeuroImage.

[47]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[48]  Helen C. Barron,et al.  Repetition suppression: a means to index neural representations using BOLD? , 2016, Philosophical Transactions of the Royal Society B: Biological Sciences.

[49]  F. Lepore,et al.  Crossmodal plasticity in sensory loss. , 2011, Progress in brain research.

[50]  K. Grill-Spector,et al.  Repetition and the brain: neural models of stimulus-specific effects , 2006, Trends in Cognitive Sciences.

[51]  Yaoda Xu The Role of the Superior Intraparietal Sulcus in Supporting Visual Short-Term Memory for Multifeature Objects , 2007, The Journal of Neuroscience.

[52]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[53]  P. Downing,et al.  Category selectivity in human visual cortex: Beyond visual object recognition , 2017, Neuropsychologia.

[54]  J. Haxby,et al.  The effect of visual experience on the development of functional architecture in hMT+. , 2007, Cerebral cortex.

[55]  Amir Amedi,et al.  A Ventral Visual Stream Reading Center Independent of Visual Experience , 2012, Current Biology.

[56]  Rutvik H. Desai,et al.  Toward a brain-based componential semantic representation , 2016, Cognitive neuropsychology.

[57]  Semir Zeki,et al.  Functional specialization and generalization for grouping of stimuli based on colour and motion , 2013, NeuroImage.

[58]  G. Lupyan,et al.  Distributional semantics as a source of visual knowledge , 2019, Proceedings of the National Academy of Sciences.

[59]  Jonathan E. Jennings,et al.  An fMRI version of the Farnsworth-Munsell 100-Hue test reveals multiple color-selective areas in human ventral occipitotemporal cortex. , 1999, Cerebral cortex.

[60]  Alexis Amadon,et al.  Word meaning in the ventral visual path: a perceptual to conceptual gradient of semantic coding , 2016, NeuroImage.

[61]  Karl J. Friston,et al.  Effects of visual deprivation on the organization of the semantic system. , 2003, Brain : a journal of neurology.

[62]  Franco Lepore,et al.  Functional Preference for Object Sounds and Voices in the Brain of Early Blind and Sighted Individuals , 2018, Journal of Cognitive Neuroscience.

[63]  S. Thompson-Schill,et al.  Semantic adaptation and competition during word comprehension. , 2008, Cerebral cortex.

[64]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[65]  Pinglei Bao,et al.  The representation of colored objects in macaque color patches , 2017, bioRxiv.

[66]  Giulia V. Elli,et al.  Knowledge of animal appearance among sighted and blind adults , 2019, Proceedings of the National Academy of Sciences.

[67]  Bradford Z. Mahon,et al.  A critical look at the embodied cognition hypothesis and a new proposal for grounding conceptual content , 2008, Journal of Physiology-Paris.

[68]  Alfonso Caramazza,et al.  Tool Selectivity in Left Occipitotemporal Cortex Develops without Vision , 2013, Journal of Cognitive Neuroscience.

[69]  Alfonso Caramazza,et al.  Selectivity for large nonmanipulable objects in scene-selective visual cortex does not require visual experience , 2013, NeuroImage.

[70]  K. Grill-Spector The neural basis of object perception , 2003, Current Opinion in Neurobiology.

[71]  Hans P. Op de Beeck,et al.  Development of visual category selectivity in ventral visual cortex does not require visual experience , 2017, Proceedings of the National Academy of Sciences.

[72]  A. Caramazza,et al.  How Visual Is the Visual Cortex? Comparing Connectional and Functional Fingerprints between Congenitally Blind and Sighted Individuals , 2015, The Journal of Neuroscience.

[73]  Lotfi B Merabet,et al.  Visual Topography of Human Intraparietal Sulcus , 2007, The Journal of Neuroscience.

[74]  Bevil R. Conway,et al.  Color-Biased Regions of the Ventral Visual Pathway Lie between Face- and Place-Selective Regions in Humans, as in Macaques , 2016, The Journal of Neuroscience.

[75]  Emiliano Ricciardi,et al.  Modality-independent encoding of individual concepts in the left parietal cortex , 2017, Neuropsychologia.

[76]  A. Caramazza,et al.  Object Domain and Modality in the Ventral Visual Pathway , 2016, Trends in Cognitive Sciences.