Orthographic dependency in the neural correlates of reading: evidence from audiovisual integration in English readers.

Reading skills are indispensible in modern technological societies. In transparent alphabetic orthographies, such as Dutch, reading skills build on associations between letters and speech sounds (LS pairs). Previously, we showed that the superior temporal cortex (STC) of Dutch readers is sensitive to the congruency of LS pairs. Here, we used functional magnetic resonance imaging to investigate whether a similar congruency sensitivity exists in STC of readers of the more opaque English orthography, where the relation among LS pairs is less reliable. Eighteen subjects passively perceived congruent and incongruent audiovisual pairs of different levels of transparency in English: letters and speech sounds (LS; irregular), letters and letter names (LN; fairly transparent), and numerals and number names (NN; transparent). In STC, we found congruency effects for NN and LN, but no effects in the predicted direction (congruent > incongruent) for LS pairs. These findings contrast with previous results obtained from Dutch readers. These data indicate that, through education, the STC becomes tuned to the congruency of transparent audiovisual pairs, but suggests a different neural processing of irregular mappings. The orthographic dependency of LS integration underscores cross-linguistic differences in the neural basis of reading and potentially has important implications for dyslexia interventions across languages.

[1]  Dries J. W. Froyen,et al.  Cross-modal enhancement of the MMN to speech-sounds indicates early and automatic integration of letters and speech-sounds , 2008, Neuroscience Letters.

[2]  J. Ziegler,et al.  Orthographic Depth and Its Impact on Universal Predictors of Reading , 2010, Psychological science.

[3]  Linnea C. Ehri,et al.  Development of Sight Word Reading: Phases and Findings. , 2008 .

[4]  Leo Blomert,et al.  The neural signature of orthographic–phonological binding in successful and failing reading development , 2011, NeuroImage.

[5]  M. Naumer,et al.  Semantics and the multisensory brain: How meaning modulates processes of audio-visual integration , 2008, Brain Research.

[6]  Kuniyoshi L Sakai,et al.  Learning letters in adulthood: direct visualization of cortical plasticity for forming a new link between orthography and phonology. , 2004, Neuron.

[7]  P. C. Murphy,et al.  Cerebral Cortex , 2017, Cerebral Cortex.

[8]  B. Argall,et al.  Integration of Auditory and Visual Information about Objects in Superior Temporal Sulcus , 2004, Neuron.

[9]  M. Farah,et al.  Neural Specialization for Letter Recognition , 2002, Journal of Cognitive Neuroscience.

[10]  James R. Booth,et al.  Functional Anatomy of Intra- and Cross-Modal Lexical Tasks , 2002, NeuroImage.

[11]  R. Näätänen,et al.  The mismatch negativity (MMN) in basic research of central auditory processing: A review , 2007, Clinical Neurophysiology.

[12]  James A. Reggia,et al.  Empirically derived probabilities for grapheme-to-phoneme correspondences in english , 1987 .

[13]  Dries J. W. Froyen,et al.  Multi-sensory learning and learning to read. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[14]  Rainer Goebel,et al.  Top–down task effects overrule automatic multisensory responses to letter–sound pairs in auditory association cortex , 2006, NeuroImage.

[15]  Rainer Goebel,et al.  fMR-adaptation indicates selectivity to audiovisual content congruency in distributed clusters in human superior temporal cortex , 2010, BMC Neuroscience.

[16]  Lars Muckli,et al.  Cortical Plasticity of Audio–Visual Object Representations , 2008, Cerebral cortex.

[17]  Dries J. W. Froyen,et al.  The Long Road to Automation: Neurocognitive Development of Letter–Speech Sound Processing , 2009, Journal of Cognitive Neuroscience.

[18]  Holger Mitterer,et al.  Auditory cortical tuning to statistical regularities in phonology , 2005, Clinical Neurophysiology.

[19]  Nicholas Burnett Education for all : literacy for life , 2005 .

[20]  Chris McNorgan,et al.  Multimodal lexical processing in auditory cortex is literacy skill dependent. , 2014, Cerebral cortex.

[21]  D. Share On the Anglocentricities of current reading research and practice: the perils of overreliance on an "outlier" orthography. , 2008, Psychological bulletin.

[22]  Rainer Goebel,et al.  Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: From single‐subject to cortically aligned group general linear model analysis and self‐organizing group independent component analysis , 2006, Human brain mapping.

[23]  What does the child bring to the task of learning to read? A summary of the New England reading acquisition projects , 1996 .

[24]  L. Blomert,et al.  Long-term cognitive dynamics of fluent reading development. , 2010, Journal of experimental child psychology.

[25]  James R. Booth,et al.  Reading acquisition reorganizes the phonological awareness network only in alphabetic writing systems , 2013, Human brain mapping.

[26]  C. Perfetti,et al.  Reading optimally builds on spoken language: implications for deaf readers. , 2000, Journal of deaf studies and deaf education.

[27]  Katherine L. Roberts,et al.  Examining a Supramodal Network for Conflict Processing: A Systematic Review and Novel Functional Magnetic Resonance Imaging Data for Related Visual and Auditory Stroop Tasks , 2008, Journal of Cognitive Neuroscience.

[28]  Rainer Goebel,et al.  Interaction of speech and script in human auditory cortex: Insights from neuro-imaging and effective connectivity , 2009, Hearing Research.

[29]  R. Goebel,et al.  Deviant processing of letters and speech sounds as proximate cause of reading failure: a functional magnetic resonance imaging study of dyslexic children. , 2010, Brain : a journal of neurology.

[30]  Jonathan Winawer,et al.  A Brain Area for Visual Numerals , 2013, The Journal of Neuroscience.

[31]  C. A. Weaver,et al.  Psychology of Reading , 2012 .

[32]  Dénes Tóth,et al.  Cognitive Development of Fluent Word Reading Does Not Qualitatively Differ Between Transparent and Opaque Orthographies , 2010 .

[33]  Rainer Goebel,et al.  The effect of temporal asynchrony on the multisensory integration of letters and speech sounds. , 2006, Cerebral cortex.

[34]  R. Goebel,et al.  Reduced Neural Integration of Letters and Speech Sounds Links Phonological and Reading Deficits in Adult Dyslexia , 2009, Current Biology.

[35]  R. Goebel,et al.  Integration of Letters and Speech Sounds in the Human Brain , 2004, Neuron.

[36]  R. Goebel,et al.  Multisensory functional magnetic resonance imaging: a future perspective , 2009, Experimental Brain Research.

[37]  R. Bowtell,et al.  “sparse” temporal sampling in auditory fMRI , 1999, Human brain mapping.

[38]  Jonathan D. Cohen,et al.  Improved Assessment of Significant Activation in Functional Magnetic Resonance Imaging (fMRI): Use of a Cluster‐Size Threshold , 1995, Magnetic resonance in medicine.

[39]  Bruce D. McCandliss,et al.  Development of neural systems for reading. , 2007, Annual review of neuroscience.

[40]  H. Scheich,et al.  Phonetic Perception and the Temporal Cortex , 2002, NeuroImage.

[41]  Usha Goswami,et al.  Becoming literate in different languages: similar problems, different solutions. , 2006, Developmental science.

[42]  S. Dehaene,et al.  Cultural Recycling of Cortical Maps , 2007, Neuron.

[43]  Ulla Richardson,et al.  The effects of spelling consistency on phonological awareness: a comparison of English and German. , 2005, Journal of experimental child psychology.

[44]  T. Whitlock Dyslexia , 1989, The Lancet.

[45]  D. Shankweiler,et al.  Explicit Syllable and Phoneme Segmentation in the Young Child , 1974 .

[46]  D. Share Phonological recoding and self-teaching: sine qua non of reading acquisition , 1995, Cognition.

[47]  Riitta Hari,et al.  Audiovisual Integration of Letters in the Human Brain , 2000, Neuron.

[48]  Charles Hulme,et al.  The science of reading: A handbook. , 2005 .