The neural correlates of coloured music: A functional MRI investigation of auditory–visual synaesthesia

In auditory-visual synaesthesia, all kinds of sound can induce additional visual experiences. To identify the brain regions mainly involved in this form of synaesthesia, functional magnetic resonance imaging (fMRI) has been used during non-linguistic sound perception (chords and pure tones) in synaesthetes and non-synaesthetes. Synaesthetes showed increased activation in the left inferior parietal cortex (IPC), an area involved in multimodal integration, feature binding and attention guidance. No significant group-differences could be detected in area V4, which is known to be related to colour vision and form processing. The results support the idea of the parietal cortex acting as sensory nexus area in auditory-visual synaesthesia, and as a common neural correlate for different types of synaesthesia.

[1]  Jamie Ward,et al.  Is Synaesthesia an X-Linked Dominant Trait with Lethality in Males? , 2005, Perception.

[2]  S. Zeki,et al.  The architecture of the colour centre in the human visual brain: new results and a review * , 2000, The European journal of neuroscience.

[3]  Gereon R Fink,et al.  Grapheme-colour synaesthetes show increased grey matter volumes of parietal and fusiform cortex. , 2009, Brain : a journal of neurology.

[4]  E. Bullmore,et al.  Functional magnetic resonance imaging of synesthesia : activation of V 4 / V 8 by spoken words , 2002 .

[5]  S. Baron-Cohen,et al.  Hearing Words and Seeing Colours: An Experimental Investigation of a Case of Synaesthesia , 1987, Perception.

[6]  Julia Simner,et al.  Synaesthetic Consistency Spans Decades in a Lexical–Gustatory Synaesthete , 2007, Neurocase.

[7]  R. Cytowič.  Synesthesia: A Union of the Senses , 1989 .

[8]  Romke Rouw,et al.  Neural Basis of Individual Differences in Synesthetic Experiences , 2010, The Journal of Neuroscience.

[9]  L. Marks.  On colored-hearing synesthesia: cross-modal translations of sensory dimensions. , 1975, Psychological bulletin.

[10]  V. Ramachandran,et al.  Synaesthesia? A window into perception, thought and language , 2001 .

[11]  K. Zilles,et al.  Crossmodal Processing of Object Features in Human Anterior Intraparietal Cortex An fMRI Study Implies Equivalencies between Humans and Monkeys , 2002, Neuron.

[12]  N F Ramsey,et al.  Activation of striate cortex in the absence of visual stimulation: an fMRI study of synesthesia , 2001, Neuroreport.

[13]  D. Eagleman,et al.  A standardized test battery for the study of synesthesia , 2007, Journal of Neuroscience Methods.

[14]  S Baron-Cohen,et al.  The physiology of coloured hearing. A PET activation study of colour-word synaesthesia. , 1995, Brain : a journal of neurology.

[15]  Geoffrey M. Boynton,et al.  Individual Differences among Grapheme-Color Synesthetes: Brain-Behavior Correlations , 2005, Neuron.

[16]  Joy Ollen,et al.  A criterion-related validity test of selected indicators of musical sophistication using expert ratings , 2006 .

[17]  Juan Lupiáñez,et al.  Automatic Perception and Synaesthesia: Evidence from Colour and Photism Naming in a Stroop-Negative Priming Task , 2006, Cortex.

[18]  Lutz Jäncke,et al.  The neuroanatomy of grapheme–color synesthesia , 2009, The European journal of neuroscience.

[19]  M. Corbetta,et al.  Functional Organization of Human Intraparietal and Frontal Cortex for Attending, Looking, and Pointing , 2003, The Journal of Neuroscience.

[20]  Brian Butterworth,et al.  Number Forms in the Brain , 2008, Journal of Cognitive Neuroscience.

[21]  M. Corbetta,et al.  Control of goal-directed and stimulus-driven attention in the brain , 2002, Nature Reviews Neuroscience.

[22]  L. Robertson.  Binding, spatial attention and perceptual awareness , 2003, Nature Reviews Neuroscience.

[23]  J. Gallant,et al.  A Human Extrastriate Area Functionally Homologous to Macaque V4 , 2000, Neuron.

[24]  G. Calvert.  Crossmodal processing in the human brain: insights from functional neuroimaging studies. , 2001, Cerebral cortex.

[25]  E. T. Bullmore,et al.  Functional magnetic resonance imaging of synesthesia: activation of V4/V8 by spoken words , 2002, Nature Neuroscience.

[26]  Jean-Luc Anton,et al.  Region of interest analysis using an SPM toolbox , 2010 .

[27]  Gereon R. Fink,et al.  When visual perception causes feeling: Enhanced cross-modal processing in grapheme-color synesthesia , 2005, NeuroImage.

[28]  S. Zeki,et al.  The position and topography of the human colour centre as revealed by functional magnetic resonance imaging. , 1997, Brain : a journal of neurology.

[29]  Jamie Ward,et al.  Sound-Colour Synaesthesia: to What Extent Does it Use Cross-Modal Mechanisms Common to us All? , 2006, Cortex.

[30]  Seana Coulson,et al.  Magnetoencephalography reveals early activation of V4 in grapheme-color synesthesia , 2010, NeuroImage.

[31]  Pascal Belin,et al.  Stimulus Complexity and Categorical Effects in Human Auditory Cortex: An Activation Likelihood Estimation Meta-Analysis , 2011, Front. Psychology.

[32]  Jack L. Gallant,et al.  Shape Perception: Complex Contour Representation in Visual Area V4 , 2003, Current Biology.

[33]  Gereon R. Fink,et al.  Human medial intraparietal cortex subserves visuomotor coordinate transformation , 2004, NeuroImage.

[34]  H. Scholte,et al.  Increased structural connectivity in grapheme-color synesthesia , 2007, Nature Neuroscience.

[35]  Christopher T. Lovelace,et al.  Mechanisms of synesthesia: cognitive and physiological constraints , 2001, Trends in Cognitive Sciences.

[36]  M. Greenlee,et al.  Cortical activation evoked by visual mental imagery as measured by fMRI , 2000, Neuroreport.

[37]  Matthew Rizzo,et al.  Synesthesia , 1989, Neurology.

[38]  Vincent Walsh,et al.  Disruption of synaesthesia following TMS of the right posterior parietal cortex , 2007, Neuropsychologia.

[39]  J L Lancaster,et al.  Automated Talairach Atlas labels for functional brain mapping , 2000, Human brain mapping.

[40]  Peter Hagoort,et al.  Synaesthetic Colour in the Brain: Beyond Colour Areas. A Functional Magnetic Resonance Imaging Study of Synaesthetes and Matched Controls , 2010, PloS one.

[41]  B. Rossion,et al.  Fixation Patterns During Recognition of Personally Familiar and Unfamiliar Faces , 2010, Front. Psychology.

[42]  C. Mills,et al.  DIGIT SYNAESTHESIA: A CASE STUDY USING A STROOP-TYPE TEST , 1999 .

[43]  Richard B. Ivry,et al.  Coming Unbound: Disrupting Automatic Integration of Synesthetic Color and Graphemes by Transcranial Magnetic Stimulation of the Right Parietal Lobe , 2006, Journal of Cognitive Neuroscience.

[44]  Edward M. Hubbard,et al.  Neurophysiology of synesthesia , 2007, Current psychiatry reports.

[45]  S. Kosslyn,et al.  Brain areas underlying visual mental imagery and visual perception: an fMRI study. , 2004, Brain research. Cognitive brain research.

[46]  P. Hagoort,et al.  Behavioral/systems/cognitive Effective Connectivity Determines the Nature of Subjective Experience in Grapheme-color Synesthesia , 2022 .

[47]  Beat Meier,et al.  Parieto-occipital suppression eliminates implicit bidirectionality in grapheme-colour synaesthesia , 2010, Neuropsychologia.

[48]  K. Uğurbil,et al.  Neural correlates of visual form and visual spatial processing , 1999, Human brain mapping.

[49]  Jamie Ward,et al.  Seeing Sounds and Hearing Colors: An Event-related Potential Study of Auditory–Visual Synesthesia , 2009, Journal of Cognitive Neuroscience.

[50]  Anina N. Rich,et al.  Neural correlates of imagined and synaesthetic colours , 2006, Neuropsychologia.

[51]  W. Singer,et al.  Neuronal Correlates of Colour-Graphemic Synaesthesia: Afmri Study , 2006, Cortex.

[52]  C. Blakemore,et al.  Activation of Color-Selective areas of the Visual Cortex in a Blind Synesthete , 2006, Cortex.

[53]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.