Distinct and shared cortical regions of the human brain activated by pictorial depictions versus verbal descriptions: an fMRI study

Using fMRI, we observed that there were functionally disjunctive regions in the human brain that were specifically activated during the silent reading of sentences (i.e., the symbolical representation at the propositional level) but not during the perception of arranged objects (i.e., analogical representation), or vice versa: Parts of the left and right lingual gyri, the left fusiform gyrus, the left and right inferior occipital gyri, the right cuneus, and the left middle occipital gyrus were activated exclusively during the silent reading of sentences, whereas perception of the arranged objects activated distinct regions in the lingual gyrus, the declive, the fusiform gyrus, and the cuneus in the right hemisphere. A large proportion (86% in cortical volume) of the occipito-temporal regions was functionally conjunctive: these neural structures were activated during both silent reading of sentences and perception of arranged objects. We observed a similar trend of functional disjunction and conjunction between single words (the symbolical mode at the lexical level) and single objects (analogical mode): the degree of functional conjunction in the latter case was about 96%. These results suggest that the degree of functional disjunction between the pictorial depictions and the verbal descriptions tended to increase as the complexity of mental representation increased from the single word (lexical) level (4%) to the sentence (propositional) level (14%).

[1]  M. Tarr,et al.  Can Face Recognition Really be Dissociated from Object Recognition? , 1999, Journal of Cognitive Neuroscience.

[2]  S. Petersen,et al.  Activation of extrastriate and frontal cortical areas by visual words and word-like stimuli. , 1990, Science.

[3]  Karl J. Friston,et al.  Anatomic Constraints on Cognitive Theories of Category Specificity , 2002, NeuroImage.

[4]  R W Cox,et al.  AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. , 1996, Computers and biomedical research, an international journal.

[5]  Ravi S. Menon,et al.  Repetition priming and the time course of object recognition: an fMRI study. , 1999, Neuroreport.

[6]  J. Hirsch,et al.  Distinct cortical areas associated with native and second languages , 1997, Nature.

[7]  A. Syrota,et al.  The Cortical Representation of Speech , 1993, Journal of Cognitive Neuroscience.

[8]  S. Bookheimer,et al.  Regional cerebral blood flow during object naming and word reading , 1995 .

[9]  M. Tarr,et al.  Visual Object Recognition , 1996, ISTCS.

[10]  N. Alpert,et al.  Localization of Syntactic Comprehension by Positron Emission Tomography , 1996, Brain and Language.

[11]  D. Bub,et al.  The Neural Substrate for Concrete, Abstract, and Emotional Word Lexica A Positron Emission Tomography Study , 1997, Journal of Cognitive Neuroscience.

[12]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[13]  Joy Hirsch,et al.  Interconnected Large-Scale Systems for Three Fundamental Cognitive Tasks Revealed by Functional MRI , 2001, Journal of Cognitive Neuroscience.

[14]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[15]  Keiji Tanaka,et al.  Inferotemporal cortex and object vision. , 1996, Annual review of neuroscience.

[16]  S. Edelman,et al.  Cue-Invariant Activation in Object-Related Areas of the Human Occipital Lobe , 1998, Neuron.

[17]  A. Dale,et al.  The Representation of Illusory and Real Contours in Human Cortical Visual Areas Revealed by Functional Magnetic Resonance Imaging , 1999, The Journal of Neuroscience.

[18]  Nancy Kanwisher,et al.  A cortical representation of the local visual environment , 1998, Nature.

[19]  David Caplan,et al.  Localization of Syntactic Comprehension by Positron Emission Tomography , 1998, NeuroImage.

[20]  Herbert H. Clark,et al.  On the process of comparing sentences against pictures , 1972 .

[21]  C. Connor,et al.  Responses to contour features in macaque area V4. , 1999, Journal of neurophysiology.

[22]  M. Just,et al.  Brain Activation Modulated by Sentence Comprehension , 1996, Science.

[23]  N. Kanwisher,et al.  Cortical Regions Involved in Perceiving Object Shape , 2000, The Journal of Neuroscience.

[24]  B. Gordon,et al.  Object shape processing in the visual system evaluated using functional MRI , 1997, Neurology.

[25]  D. V. van Essen,et al.  Selectivity for polar, hyperbolic, and Cartesian gratings in macaque visual cortex. , 1993, Science.

[26]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[27]  Barry Horwitz,et al.  fMRI study comparing names versus pictures of objects , 2002, Human brain mapping.

[28]  E. Bullmore,et al.  Common and Distinct Neural Substrates for Pragmatic, Semantic, and Syntactic Processing of Spoken Sentences: An fMRI Study , 2000, Journal of Cognitive Neuroscience.

[29]  R. Turner,et al.  Sentence Reading: A Functional MRI Study at 4 Tesla , 1997, Journal of Cognitive Neuroscience.

[30]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[31]  M. Posner,et al.  Positron Emission Tomographic Studies of the Processing of Singe Words , 1989, Journal of Cognitive Neuroscience.

[32]  M. Tarr,et al.  Levels of categorization in visual recognition studied using functional magnetic resonance imaging , 1997, Current Biology.

[33]  S. Edelman,et al.  Rapid Shape Adaptation Reveals Position and Size Invariance in the Object-Related Lateral Occipital (LO) Complex. , 1998, NeuroImage.

[34]  R. Vogels,et al.  Effect of image scrambling on inferior temporal cortical responses. , 1999, Neuroreport.

[35]  M. Tarr,et al.  The Fusiform Face Area is Part of a Network that Processes Faces at the Individual Level , 2000, Journal of Cognitive Neuroscience.