The physiology of coloured hearing. A PET activation study of colour-word synaesthesia.

In a small proportion of the normal population, stimulation in one modality can lead to perceptual experience in another, a phenomenon known as synaesthesia. In the most common form of synaesthesia, hearing a word can result in the experience of colour. We have used the technique of PET, which detects brain activity as changes of regional cerebral blood flow (rCBF), to study the physiology of colour-word synaesthesia in a group of six synaesthete women. During rCBF measurements synaesthetes and six controls were blindfolded and were presented with spoken words or pure tones. Auditory word, but not tone, stimulation triggered synaesthesia in synaesthetes. In both groups word stimulation compared with tone stimulation activated the classical language areas of the perisylvian regions. In synaesthetes, a number of additional visual associative areas, including the posterior inferior temporal cortex and the parieto-occipital junctions, were activated. The former has been implicated in the integration of colour with shape and in verbal tasks which require attention to visual features of objects to which words refer. Synaesthetes also showed activations in the right prefrontal cortex, insula and superior temporal gyrus. By contrast, no significant activity was detected in relatively lower visual areas, including areas V1, V2 and V4. These results suggest that colour-word synaesthesia may result from the activity of brain areas concerned with language and visual feature integration. In the case of colour-word synaesthesia, conscious visual experience appears to occur without activation of the primary visual cortex.

[1]  S Zeki,et al.  Conscious visual perception without V1. , 1993, Brain : a journal of neurology.

[2]  P E Roland,et al.  Cortical fields participating in form and colour discrimination in the human brain. , 1991, Neuroreport.

[3]  R. Cytowič Synesthesia: A Union of the Senses , 1989 .

[4]  R. C. Oldfield The assessment and analysis of handedness: the Edinburgh inventory. , 1971, Neuropsychologia.

[5]  A. Damasio,et al.  Central achromatopsia , 1980, Neurology.

[6]  F. Plum Handbook of Physiology. , 1960 .

[7]  Karl J. Friston,et al.  The colour centre in the cerebral cortex of man , 1989, Nature.

[8]  S. Zeki,et al.  Colour coding in the superior temporal sulcus of rhesus monkey visual cortex , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  M. Torrens Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[10]  E. Renzi,et al.  The pattern of neuropsychological impairment associated with left posterior cerebral artery infarcts. , 1987, Brain : a journal of neurology.

[11]  Mortimer Mishkin,et al.  Cortical Visual Areas and Their Interactions , 1972 .

[12]  A. Damasio,et al.  The anatomic basis of pure alexia , 1983, Neurology.

[13]  Gerald M. Edelman,et al.  Dynamic aspects of neocortical function , 1984 .

[14]  S. Baron-Cohen,et al.  Coloured Speech Perception: Is Synaesthesia what Happens when Modularity Breaks Down? , 1993, Perception.

[15]  E. Hoffman,et al.  Fully three-dimensional reconstruction for a PET camera with retractable septa , 1991 .

[16]  J. Mazziotta,et al.  MRI‐PET Registration with Automated Algorithm , 1993, Journal of computer assisted tomography.

[17]  Richard A. Robb,et al.  A Software System for Interactive and Quantitative Analysis of Biomedical Images , 1990 .

[18]  J. Mazziotta,et al.  A Noninvasive Positron Computed Tomography Technique Using Oxygen-15-Labeled Water for the Evaluation of Neurobehavioral Task Batteries , 1985, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[19]  J. Mazziotta,et al.  Rapid Automated Algorithm for Aligning and Reslicing PET Images , 1992, Journal of computer assisted tomography.

[20]  R. Desimone,et al.  Prestriate afferents to inferior temporal cortex: an HRP study , 1980, Brain Research.

[21]  H. Komatsu,et al.  Relationships between color, shape, and pattern selectivities of neurons in the inferior temporal cortex of the monkey. , 1993, Journal of neurophysiology.

[22]  S. Zeki,et al.  The Organization of Connections between Areas V5 and V1 in Macaque Monkey Visual Cortex , 1989, The European journal of neuroscience.

[23]  Richard S. J. Frackowiak,et al.  Area V5 of the human brain: evidence from a combined study using positron emission tomography and magnetic resonance imaging. , 1993, Cerebral cortex.

[24]  V. Mountcastle The visual functions of the parietal lobe , 1984, Behavioural Brain Research.

[25]  Karl J. Friston,et al.  Functional neuroanatomy of the human brain: positron emission tomography--a new neuroanatomical technique. , 1994, Journal of anatomy.

[26]  F. Galton Inquiries into Human Faculty and Its Development , 1883 .

[27]  Karl J. Friston,et al.  Investigating a network model of word generation with positron emission tomography , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[28]  G K Morley,et al.  Neurolinguistic analysis of the language abilities of a patient with a "double disconnection syndrome": a case of subangular alexia in the presence of mixed transcortical aphasia. , 1981, Journal of neurology, neurosurgery, and psychiatry.

[29]  Henry Fuchs,et al.  3D imaging in medicine : algorithms, systems, applications , 1990 .

[30]  Karl J. Friston,et al.  A direct demonstration of functional specialization in human visual cortex , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Karl J. Friston,et al.  The Relationship between Global and Local Changes in PET Scans , 1990, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[32]  D. Brooks,et al.  Motor sequence learning: a study with positron emission tomography , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[33]  M. Jeannerod,et al.  In search for the egocentric reference. A neurophysiological hypothesis , 1984, Neuropsychologia.

[34]  E. Renzi,et al.  Impaired Performance on Color Tasks in Patients with Hemispheric Damage , 1967 .

[35]  Color “Amnesia” Without Aphasia , 1983, Cortex.

[36]  Karl J. Friston,et al.  Distribution of cortical neural networks involved in word comprehension and word retrieval. , 1991, Brain : a journal of neurology.

[37]  J. C. Meadows Disturbed perception of colours associated with localized cerebral lesions. , 1974, Brain : a journal of neurology.

[38]  T J Spinks,et al.  Physical performance of a positron tomograph for brain imaging with retractable septa. , 1992, Physics in medicine and biology.

[39]  J. Horton,et al.  Quadrantic visual field defects. A hallmark of lesions in extrastriate (V2/V3) cortex. , 1991, Brain : a journal of neurology.

[40]  J. W. Bernard,et al.  Messiaen's Synaesthesia: The Correspondence between Color and Sound Structure in His Music , 1986 .

[41]  J. Pokorny,et al.  Color perception profiles in central achromatopsia , 1993, Neurology.

[42]  M. J. Eacott,et al.  The role of monkey inferior parietal cortex in visual discrimination of identity and orientation of shapes , 1991, Behavioural Brain Research.

[43]  A. Cowey,et al.  Reflections on Blindsight , 1992 .

[44]  P. T. Fox,et al.  Positron emission tomographic studies of the cortical anatomy of single-word processing , 1988, Nature.

[45]  Richard S. J. Frackowiak,et al.  The anatomy of phonological and semantic processing in normal subjects. , 1992, Brain : a journal of neurology.

[46]  Richard S. J. Frackowiak,et al.  The neural correlates of the verbal component of working memory , 1993, Nature.

[47]  F. Wood,et al.  Synesthesia I. A review of major theories and their brain basis , 1982, Brain and Cognition.

[48]  M Corbetta,et al.  Selective attention modulates extrastriate visual regions in humans during visual feature discrimination and recognition. , 1991, Ciba Foundation symposium.

[49]  B. C. Motter,et al.  Functional properties of parietal visual neurons: mechanisms of directionality along a single axis , 1987, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[50]  S. Shipp,et al.  The functional logic of cortical connections , 1988, Nature.

[51]  S Zeki,et al.  Going beyond the information given: the relation of illusory visual motion to brain activity , 1993, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[52]  S Zeki,et al.  THE LAMINAR ORIGIN OF THE CORTICAL INPUTS TO THE 4TH VISUAL COMPLEX OF MACAQUE MONKEY CORTEX , 1983 .

[53]  S. Zeki A vision of the brain , 1993 .

[54]  S. Baron-Cohen,et al.  Hearing Words and Seeing Colours: An Experimental Investigation of a Case of Synaesthesia , 1987, Perception.

[55]  M. Coltheart,et al.  Surface dyslexia. , 1983, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[56]  L. Marks On colored-hearing synesthesia: cross-modal translations of sensory dimensions. , 1975, Psychological bulletin.

[57]  S. Zeki,et al.  A century of cerebral achromatopsia. , 1990, Brain : a journal of neurology.

[58]  D. Ts'o,et al.  Functional organization of primate visual cortex revealed by high resolution optical imaging. , 1990, Science.

[59]  M. Corbetta,et al.  Selective and divided attention during visual discriminations of shape, color, and speed: functional anatomy by positron emission tomography , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[60]  S. Zeki,et al.  The Organization of Connections between Areas V5 and V2 in Macaque Monkey Visual Cortex , 1989, The European journal of neuroscience.

[61]  P E Roland,et al.  Processing and Analysis of Form, Colour and Binocular Disparity in the Human Brain: Functional Anatomy by Positron Emission Tomography , 1994, The European journal of neuroscience.

[62]  S Yamane,et al.  Color selectivity of neurons in the inferior temporal cortex of the awake macaque monkey , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[63]  H. Spinnler,et al.  Colour imperception in patients with focal excisions of the cerebral hemispheres , 1978, Neuropsychologia.

[64]  P E Roland,et al.  Visual form discrimination from color or motion cues: functional anatomy by positron emission tomography. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[65]  J. Locke An Essay concerning Human Understanding , 1924, Nature.

[66]  S. Zeki Functional specialisation in the visual cortex of the rhesus monkey , 1978, Nature.

[67]  Karl J. Friston,et al.  Plastic transformation of PET images. , 1991, Journal of computer assisted tomography.

[68]  Karl J. Friston,et al.  Comparing Functional (PET) Images: The Assessment of Significant Change , 1991, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[69]  Mark S. Seidenberg,et al.  Orthographic effects on rhyme monitoring. , 1979 .

[70]  S. Clarke,et al.  Occipital cortex in man: Organization of callosal connections, related myelo‐ and cytoarchitecture, and putative boundaries of functional visual areas , 1990, The Journal of comparative neurology.

[71]  Karl J. Friston,et al.  A PET study of word finding , 1991, Neuropsychologia.

[72]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[73]  Karl J. Friston,et al.  Functional Connectivity: The Principal-Component Analysis of Large (PET) Data Sets , 1993, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[74]  D. Pandya,et al.  Converging visual and somatic sensory cortical input to the intraparietal sulcus of the rhesus monkey , 1980, Brain Research.

[75]  P. Goldman-Rakic Modular organization of prefrontal cortex , 1984, Trends in Neurosciences.