Multi- and unisensory decoding of words and nonwords result in differential brain responses in dyslexic and nondyslexic adults

The present functional magnetic resonance imaging (fMRI) study was designed, in order to investigate the neural substrates involved in the audiovisual processing of disyllabic German words and pseudowords. Twelve dyslexic and 13 nondyslexic adults performed a lexical decision task while stimuli were presented unimodally (either aurally or visually) or bimodally (audiovisually simultaneously). The behavioral data collected during the experiment evidenced more accurate processing for bimodally than for unimodally presented stimuli irrespective of group. Words were processed faster than pseudowords. Notably, no group differences have been found for either accuracy or for reaction times. With respect to brain responses, nondyslexic compared to dyslexic adults elicited stronger hemodynamic responses in the leftward supramarginal gyrus (SMG), as well as in the right hemispheric superior temporal sulcus (STS). Furthermore, dyslexic compared to nondyslexic adults showed reduced responses to only aurally presented signals and enhanced hemodynamic responses to audiovisual, as well as visual stimulation in the right anterior insula. Our behavioral results evidence that the two groups easily identified the two-syllabic proper nouns that we provided them with. Our fMRI results indicate that dyslexics show less neuronal involvement of heteromodal and extrasylvian regions, namely, the STS, SMG, and insula when decoding phonological information. We posit that dyslexic adults evidence deficient functioning of word processing, which could possibly be attributed to deficits in phoneme to grapheme mapping. This problem may be caused by impaired audiovisual processing in multimodal areas.

[1]  Mark T Wallace,et al.  Dyslexia: Bridging the Gap between Hearing and Reading , 2009, Current Biology.

[2]  J. Dejerine Sur un cas de cécité verbale avec agraphie suivi d’autopsie , 1891 .

[3]  J. Maisog,et al.  A Meta‐analysis of Functional Neuroimaging Studies of Dyslexia , 2008, Annals of the New York Academy of Sciences.

[4]  P. Pietrini,et al.  Conjoint and extended neural networks for the computation of speech codes: the neural basis of selective impairment in reading words and pseudowords. , 2001, Cerebral cortex.

[5]  Hermann Ackermann,et al.  The contribution of the insula to motor aspects of speech production: A review and a hypothesis , 2004, Brain and Language.

[6]  N. Geschwind Disconnexion syndromes in animals and man. II. , 1965, Brain : a journal of neurology.

[7]  F. Ramus,et al.  Theories of developmental dyslexia: insights from a multiple case study of dyslexic adults. , 2003, Brain : a journal of neurology.

[8]  S C Cramer,et al.  Instructional treatment associated with changes in brain activation in children with dyslexia , 2003, Neurology.

[9]  R. Klein,et al.  The evidence for a temporal processing deficit linked to dyslexia: A review , 1995, Psychonomic bulletin & review.

[10]  A. Ghazanfar,et al.  Is neocortex essentially multisensory? , 2006, Trends in Cognitive Sciences.

[11]  Doris-Eva Bamiou,et al.  The insula (Island of Reil) and its role in auditory processing Literature review , 2003, Brain Research Reviews.

[12]  Cristiana Cavina-Pratesi,et al.  Redundant target effect and intersensory facilitation from visual-tactile interactions in simple reaction time , 2002, Experimental Brain Research.

[13]  A. Damasio,et al.  The anatomic basis of pure alexia , 1983, Neurology.

[14]  W. Schneider,et al.  Cross‐cultural effect on the brain revisited: Universal structures plus writing system variation , 2005, Human brain mapping.

[15]  J. Stein,et al.  To see but not to read; the magnocellular theory of dyslexia , 1997, Trends in Neurosciences.

[16]  D. V. von Cramon,et al.  Neurocognition of auditory sentence comprehension: event related fMRI reveals sensitivity to syntactic violations and task demands. , 2000, Brain research. Cognitive brain research.

[17]  B. de Gelder,et al.  Semantic factors influence multisensory pairing: a transcranial magnetic stimulation study , 2002, Neuroreport.

[18]  G Jobard,et al.  Evaluation of the dual route theory of reading: a metanalysis of 35 neuroimaging studies , 2003, NeuroImage.

[19]  Lutz Jäncke,et al.  The Neural Correlate of Speech Rhythm as Evidenced by Metrical Speech Processing , 2008, Journal of Cognitive Neuroscience.

[20]  H. Lyytinen,et al.  Brain sensitivity to print emerges when children learn letter–speech sound correspondences , 2010, Proceedings of the National Academy of Sciences.

[21]  Ulla Richardson,et al.  Early emergence of deviant frontal fMRI activity for phonological processes in poor beginning readers , 2010, NeuroImage.

[22]  L. Katz,et al.  Functional neuroimaging studies of reading and reading disability (developmental dyslexia). , 2000, Mental retardation and developmental disabilities research reviews.

[23]  Richard S. J. Frackowiak,et al.  Is developmental dyslexia a disconnection syndrome? Evidence from PET scanning. , 1996, Brain : a journal of neurology.

[24]  Volkmar Glauche,et al.  Ventral and dorsal pathways for language , 2008, Proceedings of the National Academy of Sciences.

[25]  Gregory Hickok,et al.  The functional neuroanatomy of language. , 2009, Physics of life reviews.

[26]  R F THOMPSON,et al.  Organization of auditory, somatic sensory, and visual projection to association fields of cerebral cortex in the cat. , 1963, Journal of neurophysiology.

[27]  P. Wolff,et al.  Rate variables and automatized naming in developmental dyslexia , 1990, Brain and Language.

[28]  Karen M. Jones,et al.  Neural Changes following Remediation in Adult Developmental Dyslexia , 2004, Neuron.

[29]  A. Friederici,et al.  Functional MR imaging exposes differential brain responses to syntax and prosody during auditory sentence comprehension , 2003, Journal of Neurolinguistics.

[30]  G. Calvert,et al.  Multisensory integration: methodological approaches and emerging principles in the human brain , 2004, Journal of Physiology-Paris.

[31]  B. Horwitz,et al.  Phonological and orthographic components of word recognition. A PET-rCBF study. , 1997, Brain : a journal of neurology.

[32]  John J. Foxe,et al.  Multisensory auditory-visual interactions during early sensory processing in humans: a high-density electrical mapping study. , 2002, Brain research. Cognitive brain research.

[33]  D. Pandya,et al.  Parietal, temporal, and occipita projections to cortex of the superior temporal sulcus in the rhesus monkey: A retrograde tracer study , 1994, The Journal of comparative neurology.

[34]  M. Hallett,et al.  Neural Correlates of Auditory–Visual Stimulus Onset Asynchrony Detection , 2001, The Journal of Neuroscience.

[35]  J. Gabrieli Dyslexia: A New Synergy Between Education and Cognitive Neuroscience , 2009, Science.

[36]  E. DeYoe,et al.  A comparison of visual and auditory motion processing in human cerebral cortex. , 2000, Cerebral cortex.

[37]  A. Boemio,et al.  Hierarchical and asymmetric temporal sensitivity in human auditory cortices , 2005, Nature Neuroscience.

[38]  R. Treiman Phonemic analysis, spelling, and reading. , 1985, New directions for child development.

[39]  Kayoko Okada,et al.  Identification of lexical–phonological networks in the superior temporal sulcus using functional magnetic resonance imaging , 2006, Neuroreport.

[40]  G. Ojemann,et al.  Cortical language localization in left, dominant hemisphere. An electrical stimulation mapping investigation in 117 patients. , 1989, Journal of neurosurgery.

[41]  Eveline Geiser,et al.  Segmental processing in the human auditory dorsal stream , 2008, Brain Research.

[42]  P. Boesiger,et al.  SENSE: Sensitivity encoding for fast MRI , 1999, Magnetic resonance in medicine.

[43]  T. Baldeweg,et al.  Impaired auditory frequency discrimination in dyslexia detected with mismatch evoked potentials , 1999, Annals of neurology.

[44]  M. Annett A classification of hand preference by association analysis. , 1970, British journal of psychology.

[45]  Manuel Carreiras,et al.  Brain Activation for Lexical Decision and Reading Aloud: Two Sides of the Same Coin? , 2007, Journal of Cognitive Neuroscience.

[46]  Jean-François Démonet,et al.  Developmental dyslexia , 2004, The Lancet.

[47]  R. Goebel,et al.  Reduced Neural Integration of Letters and Speech Sounds Links Phonological and Reading Deficits in Adult Dyslexia , 2009, Current Biology.

[48]  P. Bryant,et al.  Categorizing sounds and learning to read—a causal connection , 1983, Nature.

[49]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[50]  Bernard Mazoyer,et al.  What is right-hemisphere contribution to phonological, lexico-semantic, and sentence processing? Insights from a meta-analysis , 2011, NeuroImage.

[51]  F. Duffy,et al.  Dyslexia : a neuroscientific approach to clinical evaluation , 1985 .

[52]  N. Geschwind Disconnexion syndromes in animals and man. I. , 1965, Brain : a journal of neurology.

[53]  S. Nadeau,et al.  Impaired grammar with normal fluency and phonology. Implications for Broca's aphasia. , 1988, Brain : a journal of neurology.

[54]  Robert J Zatorre,et al.  Neural specializations for speech and pitch: moving beyond the dichotomies , 2008, Philosophical Transactions of the Royal Society B: Biological Sciences.

[55]  H. Coslett,et al.  Localization of sublexical speech perception components , 2010, Brain and Language.

[56]  D. V. von Cramon,et al.  FMRI reveals brain regions mediating slow prosodic modulations in spoken sentences , 2002, Human brain mapping.

[57]  A. Schulze-Bonhage,et al.  Functional organization of the human anterior insular cortex , 2009, Neuroscience Letters.

[58]  P. Tallal Auditory temporal perception, phonics, and reading disabilities in children , 1980, Brain and Language.

[59]  B. Katz The Neurology of Thinking , 1996 .

[60]  C. J. Price,et al.  Cortical localisation of the visual and auditory word form areas: A reconsideration of the evidence , 2003, Brain and Language.

[61]  M. Farah,et al.  Parietal lobe mechanisms of spatial attention: Modality-specific or supramodal? , 1989, Neuropsychologia.

[62]  Karl J. Friston,et al.  Statistical parametric maps in functional imaging: A general linear approach , 1994 .

[63]  Barry Horwitz,et al.  A Functional Lesion in Developmental Dyslexia: Left Angular Gyral Blood Flow Predicts Severity , 1999, Brain and Language.

[64]  Kenneth Hugdahl,et al.  Detection of differential speech‐specific processes in the temporal lobe using fMRI and a dynamic “sound morphing” technique , 2009, Human brain mapping.

[65]  Y. Sugita,et al.  Auditory-visual speech perception examined by fMRI and PET , 2003, Neuroscience Research.

[66]  Steven L. Miller,et al.  Neural deficits in children with dyslexia ameliorated by behavioral remediation: Evidence from functional MRI , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[67]  David Poeppel,et al.  The analysis of speech in different temporal integration windows: cerebral lateralization as 'asymmetric sampling in time' , 2003, Speech Commun..

[68]  L. Benevento,et al.  Auditory-visual interaction in single cells in the cortex of the superior temporal sulcus and the orbital frontal cortex of the macaque monkey , 1977, Experimental Neurology.

[69]  Lee M. Miller,et al.  Behavioral/systems/cognitive Perceptual Fusion and Stimulus Coincidence in the Cross- Modal Integration of Speech , 2022 .

[70]  R. Goebel,et al.  Integration of Letters and Speech Sounds in the Human Brain , 2004, Neuron.

[71]  I. Johnsrude,et al.  Spectral and temporal processing in human auditory cortex. , 2002, Cerebral cortex.

[72]  H. Ackermann,et al.  Contribution of the anterior insula to temporal auditory processing deficits in developmental dyslexia , 2009, Human brain mapping.

[73]  Victor W. Henderson,et al.  Anatomy of posterior pathways in reading: A reassessment , 1986, Brain and Language.

[74]  Riitta Hari,et al.  Audiovisual Integration of Letters in the Human Brain , 2000, Neuron.

[75]  Brian Byrne,et al.  The Foundation of Literacy: The Child's Acquisition of the Alphabetic Principle , 1998 .

[76]  Trichur Raman Vidyasagar,et al.  Integration of the visual and auditory networks in dyslexia: a theoretical perspective , 2005 .

[77]  R Todd Constable,et al.  The neurobiology of adaptive learning in reading: A contrast of different training conditions , 2004, Cognitive, affective & behavioral neuroscience.

[78]  V Bosch,et al.  Statistical analysis of multi‐subject fMRI data: Assessment of focal activations , 2000, Journal of magnetic resonance imaging : JMRI.

[79]  A. Fawcett,et al.  Automaticity: A new framework for dyslexia research? , 1990, Cognition.

[80]  Andrew Kertesz,et al.  Localization and neuroimaging in neuropsychology , 1994 .

[81]  D. Poeppel,et al.  The cortical organization of speech processing , 2007, Nature Reviews Neuroscience.

[82]  R. Goebel,et al.  Deviant processing of letters and speech sounds as proximate cause of reading failure: a functional magnetic resonance imaging study of dyslexic children. , 2010, Brain : a journal of neurology.

[83]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[84]  B. Argall,et al.  Unraveling multisensory integration: patchy organization within human STS multisensory cortex , 2004, Nature Neuroscience.

[85]  D. Badcock,et al.  Specific reading disability: differences in contrast sensitivity as a function of spatial frequency. , 1980, Science.

[86]  Paul W. B. Atkins,et al.  Models of reading aloud: Dual-route and parallel-distributed-processing approaches. , 1993 .

[87]  Marlene Behrmann,et al.  Localization in alexia. , 1994 .

[88]  Nadine Gaab,et al.  Dynamic auditory processing, musical experience and language development , 2006, Trends in Neurosciences.

[89]  N Makris,et al.  Analysis of lesions by MRI in stroke patients with acoustic‐phonetic processing deficits , 1995, Neurology.

[90]  C. Fiebach,et al.  fMRI Evidence for Dual Routes to the Mental Lexicon in Visual Word Recognition , 2002, Journal of Cognitive Neuroscience.

[91]  M. Just,et al.  Modifying the brain activation of poor readers during sentence comprehension with extended remedial instruction: A longitudinal study of neuroplasticity , 2008, Neuropsychologia.

[92]  Mikko Sams,et al.  Perception of matching and conflicting audiovisual speech in dyslexic and fluent readers: An fMRI study at 3 T , 2006, NeuroImage.

[93]  Robert T. Knight,et al.  Superior Temporal SulcusIt's My Area: Or Is It? , 2008, Journal of Cognitive Neuroscience.

[94]  Anthony D Wagner,et al.  Assembling and encoding word representations: fMRI subsequent memory effects implicate a role for phonological control , 2003, Neuropsychologia.

[95]  R. Campbell,et al.  Evidence from functional magnetic resonance imaging of crossmodal binding in the human heteromodal cortex , 2000, Current Biology.

[96]  H. Wimmer,et al.  Functional abnormalities in the dyslexic brain: A quantitative meta‐analysis of neuroimaging studies , 2009, Human brain mapping.

[97]  Michael S Beauchamp,et al.  See me, hear me, touch me: multisensory integration in lateral occipital-temporal cortex , 2005, Current Opinion in Neurobiology.