Disinhibited feedback as a cause of synesthesia: Evidence from a functional connectivity study on auditory-visual synesthetes

In synesthesia, certain stimuli to one sensory modality lead to sensory perception in another unstimulated modality. In addition to other models, a two-stage model is discussed to explain this phenomenon, which combines two previously formulated hypotheses regarding synesthesia: direct cross-activation and hyperbinding. The direct cross-activation model postulates that direct connections between sensory-specific areas are responsible for co-activation and synesthetic perception. The hyperbinding hypothesis suggests that the inducing stimulus and the synesthetic sensation are coupled by a sensory nexus area, which may be located in the parietal cortex. This latter hypothesis is compatible with the disinhibited feedback model, which suggests unusual feedback from multimodal convergence areas as the cause of synesthesia. In this study, the relevance of these models was tested in a group (n=14) of auditory-visual synesthetes by performing a functional connectivity analysis on functional magnetic resonance imaging (fMRI) data. Different simple and complex sounds were used as stimuli, and functionally defined seed areas in the bilateral auditory cortex (AC) and the left inferior parietal cortex (IPC) were used for the connectivity calculations. We found no differences in the connectivity of the AC and the visual areas between synesthetes and controls. The main finding of the study was stronger connectivity of the left IPC with the left primary auditory and right primary visual cortex in the group of auditory-visual synesthetes. The results support the model of disinhibited feedback as a cause of synesthetic perception but do not suggest direct cross-activation.

[1]  E. Bullmore,et al.  Functional magnetic resonance imaging of synesthesia : activation of V 4 / V 8 by spoken words , 2002 .

[2]  Romke Rouw,et al.  Neural Basis of Individual Differences in Synesthetic Experiences , 2010, The Journal of Neuroscience.

[3]  L. Jäncke,et al.  A strong parietal hub in the small-world network of coloured-hearing synaesthetes during resting state EEG. , 2011, Journal of neuropsychology.

[4]  P. Fonlupt,et al.  Functional and effective connectivity in an fMRI study of an auditory‐related task , 2006, The European journal of neuroscience.

[5]  Jamie Ward,et al.  Seeing Sounds and Hearing Colors: An Event-related Potential Study of Auditory–Visual Synesthesia , 2009, Journal of Cognitive Neuroscience.

[6]  Christopher T. Lovelace,et al.  Mechanisms of synesthesia: cognitive and physiological constraints , 2001, Trends in Cognitive Sciences.

[7]  David Brang,et al.  The cross-activation theory at 10. , 2011, Journal of neuropsychology.

[8]  N F Ramsey,et al.  Activation of striate cortex in the absence of visual stimulation: an fMRI study of synesthesia , 2001, Neuroreport.

[9]  C. Sinke,et al.  The neural correlates of coloured music: A functional MRI investigation of auditory–visual synaesthesia , 2012, Neuropsychologia.

[10]  Lutz Jäncke,et al.  Time course of neural activity correlated with colored-hearing synesthesia. , 2008, Cerebral cortex.

[11]  Lutz Jäncke,et al.  Globally Altered Structural Brain Network Topology in Grapheme-Color Synesthesia , 2011, The Journal of Neuroscience.

[12]  Seana Coulson,et al.  Magnetoencephalography reveals early activation of V4 in grapheme-color synesthesia , 2010, NeuroImage.

[13]  Joy Ollen,et al.  A criterion-related validity test of selected indicators of musical sophistication using expert ratings , 2006 .

[14]  Peter Hagoort,et al.  Synaesthetic Colour in the Brain: Beyond Colour Areas. A Functional Magnetic Resonance Imaging Study of Synaesthetes and Matched Controls , 2010, PloS one.

[15]  B. Argall,et al.  Unraveling multisensory integration: patchy organization within human STS multisensory cortex , 2004, Nature Neuroscience.

[16]  Juan Lupiáñez,et al.  Automatic Perception and Synaesthesia: Evidence from Colour and Photism Naming in a Stroop-Negative Priming Task , 2006, Cortex.

[17]  Michel Dojat,et al.  The neural bases of grapheme-color synesthesia are not localized in real color-sensitive areas. , 2012, Cerebral cortex.

[18]  Jens Frahm,et al.  Functional mapping of color processing by magnetic resonance imaging of responses to selective P- and M-pathway stimulation , 1996, Experimental Brain Research.

[19]  Richard B. Ivry,et al.  Coming Unbound: Disrupting Automatic Integration of Synesthetic Color and Graphemes by Transcranial Magnetic Stimulation of the Right Parietal Lobe , 2006, Journal of Cognitive Neuroscience.

[20]  Vincent Walsh,et al.  Synaesthesia and cortical connections: cause or correlation? , 2008, Trends in Neurosciences.

[21]  Ruth Campbell,et al.  The processing of audio-visual speech: empirical and neural bases , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[22]  G. Bargary,et al.  Synaesthesia and cortical connectivity , 2008, Trends in Neurosciences.

[23]  D. Eagleman,et al.  A standardized test battery for the study of synesthesia , 2007, Journal of Neuroscience Methods.

[24]  Lutz Jäncke,et al.  The multiple synaesthete E.S. — Neuroanatomical basis of interval-taste and tone-colour synaesthesia , 2008, NeuroImage.

[25]  J Driver,et al.  Selective spatial attention in vision and touch: unimodal and multimodal mechanisms revealed by PET. , 2000, Journal of neurophysiology.

[26]  Gereon R. Fink,et al.  When visual perception causes feeling: Enhanced cross-modal processing in grapheme-color synesthesia , 2005, NeuroImage.

[27]  S. Engel,et al.  Colour tuning in human visual cortex measured with functional magnetic resonance imaging , 1997, Nature.

[28]  Gereon R Fink,et al.  Grapheme-colour synaesthetes show increased grey matter volumes of parietal and fusiform cortex. , 2009, Brain : a journal of neurology.

[29]  V. Ramachandran,et al.  Psychophysical investigations into the neural basis of synaesthesia , 2001, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[30]  Julia Simner,et al.  Synaesthetic Consistency Spans Decades in a Lexical–Gustatory Synaesthete , 2007, Neurocase.

[31]  J. Hart,et al.  Distinct prefrontal cortex activity associated with item memory and source memory for visual shapes. , 2003, Brain research. Cognitive brain research.

[32]  Brian Butterworth,et al.  Number Forms in the Brain , 2008, Journal of Cognitive Neuroscience.

[33]  Adam Gazzaley,et al.  Measuring functional connectivity during distinct stages of a cognitive task , 2004, NeuroImage.

[34]  J. Driver,et al.  Multisensory Interplay Reveals Crossmodal Influences on ‘Sensory-Specific’ Brain Regions, Neural Responses, and Judgments , 2008, Neuron.

[35]  E Macaluso,et al.  Spatial and temporal factors during processing of audiovisual speech: a PET study , 2004, NeuroImage.

[36]  P. Hagoort,et al.  Behavioral/systems/cognitive Effective Connectivity Determines the Nature of Subjective Experience in Grapheme-color Synesthesia , 2022 .

[37]  André Brechmann,et al.  Sound-level-dependent representation of frequency modulations in human auditory cortex: a low-noise fMRI study. , 2002, Journal of neurophysiology.

[38]  G. Calvert Crossmodal processing in the human brain: insights from functional neuroimaging studies. , 2001, Cerebral cortex.

[39]  Daniel Smilek,et al.  Not all synaesthetes are created equal: Projector versus associator synaesthetes , 2004, Cognitive, affective & behavioral neuroscience.

[40]  G. A. Calvert,et al.  Auditory-visual processing represented in the human superior temporal gyrus , 2007, Neuroscience.

[41]  Geoffrey M. Boynton,et al.  Individual Differences among Grapheme-Color Synesthetes: Brain-Behavior Correlations , 2005, Neuron.

[42]  Thomas F Münte,et al.  Audiovisual integration during speech comprehension: An fMRI study comparing ROI‐based and whole brain analyses , 2009, Human brain mapping.

[43]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[44]  Edward M. Hubbard,et al.  Neurophysiology of synesthesia , 2007, Current psychiatry reports.

[45]  Shari R. Metzger,et al.  Development of Color-Grapheme Synesthesia and its Effect on Mathematical Operations , 2009, Perception.

[46]  P. Morosan,et al.  Human Primary Auditory Cortex: Cytoarchitectonic Subdivisions and Mapping into a Spatial Reference System , 2001, NeuroImage.

[47]  Lutz Jäncke,et al.  Synaesthesia: When coloured sounds taste sweet , 2005, Nature.

[48]  Jamie Ward,et al.  Synaesthesia: The Prevalence of Atypical Cross-Modal Experiences , 2006, Perception.

[49]  H. Scholte,et al.  Increased structural connectivity in grapheme-color synesthesia , 2007, Nature Neuroscience.

[50]  Peggy Tausche,et al.  A novel approach to study audiovisual integration in speech perception: Localizer fMRI and sparse sampling , 2008, Brain Research.

[51]  Bernard Mazoyer,et al.  Meta-analyzing left hemisphere language areas: Phonology, semantics, and sentence processing , 2006, NeuroImage.

[52]  Daniel Smilek,et al.  Synaesthetic Photisms Influence Visual Perception , 2001, Journal of Cognitive Neuroscience.

[53]  Henning Scheich,et al.  Anomalous Auditory Cortex Activations in Colored Hearing Synaesthetes: An fMRI-Study. , 2011, Seeing and perceiving.

[54]  G. Triebig,et al.  Multiple choice vocabulary test MWT as a valid and short test to estimate premorbid intelligence , 1995, Acta neurologica Scandinavica.

[55]  D. Pandya,et al.  Anatomy of the auditory cortex. , 1995, Revue neurologique.

[56]  M. Hallett,et al.  Neural Correlates of Auditory–Visual Stimulus Onset Asynchrony Detection , 2001, The Journal of Neuroscience.

[57]  Jean-Baptiste Poline,et al.  Analysis of a large fMRI cohort: Statistical and methodological issues for group analyses , 2007, NeuroImage.

[58]  W. Singer,et al.  Neuronal Correlates of Colour-Graphemic Synaesthesia: Afmri Study , 2006, Cortex.

[59]  C. Blakemore,et al.  Activation of Color-Selective areas of the Visual Cortex in a Blind Synesthete , 2006, Cortex.

[60]  Simon B. Eickhoff,et al.  A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data , 2005, NeuroImage.

[61]  Lutz Jäncke,et al.  The neuroanatomy of grapheme–color synesthesia , 2009, The European journal of neuroscience.

[62]  E. T. Bullmore,et al.  Functional magnetic resonance imaging of synesthesia: activation of V4/V8 by spoken words , 2002, Nature Neuroscience.