A computational model of typical and impaired reading: the role of visual processing

Computational modelling has served as a powerful tool to advance our understanding of language processes by making theoretical ideas rigorously specified and testable (a form of “ open science” for theory building). In reading research, one of the most influential computational modelling frameworks is the triangle model of reading that characterises the mappings between orthography, phonology and semantics. Currently, most instantiations of the triangle modelling framework start the processes from orthographic levels which abstract away visual processing. Moreover, without visual processing, most models do not provide an opportunity to investigate visual-related dyslexia. To bridge this crucial gap, the present study extended the existing triangle models by implementing an additional visual input. We trained the model to learn to read from visual input without pre-defined orthographic representations. The model was assessed by reading tasks in both intact and after damage (to mimic acquire alexias). The simulation results demonstrated that the model was able to name word and nonwords as well as make lexical decisions. Damage to the visual, phonological or semantic components of the model resulted in the expected reading impairments associated with pure alexia, phonological dyslexia, and surface dyslexia, respectively. The simulation results demonstrated for the first time that both typical and neurologically-impaired reading including both central and peripheral dyslexia could be addressed in this extended triangle model of reading. The findings are consistent with the primary systems account.

[1]  P. Bittencourt,et al.  [Semantic dementia]. , 2020, Arquivos de neuro-psiquiatria.

[2]  M. L. Lambon Ralph,et al.  Category-selective deficits are the exception and not the rule: Evidence from a case-series of 64 patients with ventral occipito-temporal cortex damage , 2021, Cortex.

[3]  K. Rastle,et al.  The relationships between oral language and reading instruction: Evidence from a computational model of reading , 2019, Cognitive Psychology.

[4]  P. Monaghan,et al.  A computational model of reading across development: Effects of literacy onset on language processing , 2019, Journal of Memory and Language.

[5]  P. Monaghan,et al.  Quantity and Diversity of Preliteracy Language Exposure Both Affect Literacy Development: Evidence from a Computational Model of Reading , 2018, Scientific Studies of Reading.

[6]  D. Balota,et al.  Dynamic adjustment of lexical processing in the lexical decision task: Cross-trial sequence effects , 2018, Quarterly journal of experimental psychology.

[7]  Anna M. Woollams,et al.  Using neurostimulation to understand the impact of pre-morbid individual differences on post-lesion outcomes , 2017, Proceedings of the National Academy of Sciences.

[8]  M. Brysbaert,et al.  Exploring the relations between word frequency, language exposure, and bilingualism in a computational model of reading , 2017 .

[9]  Robert A. I. Davies,et al.  Reading Through the Life Span: Individual Differences in Psycholinguistic Effects , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[10]  T. Rogers,et al.  A unified model of human semantic knowledge and its disorders , 2017, Nature Human Behaviour.

[11]  Ya-Ning Chang,et al.  Exploring orthographic neighborhood size effects in a computational model of Chinese character naming , 2016, Cognitive Psychology.

[12]  M. L. Lambon Ralph,et al.  Do You Read How I Read? Systematic Individual Differences in Semantic Reliance amongst Normal Readers , 2016, Front. Psychol..

[13]  Paul Hoffman,et al.  Triangulation of the neurocomputational architecture underpinning reading aloud , 2015, Proceedings of the National Academy of Sciences.

[14]  Marlene Behrmann,et al.  Bilateral hemispheric processing of words and faces: evidence from word impairments in prosopagnosia and face impairments in pure alexia. , 2014, Cerebral cortex.

[15]  Zachary Estes,et al.  Individual differences in reading aloud: A mega-study, item effects, and some models , 2014, Cognitive Psychology.

[16]  Lisa S. Arduino,et al.  Neglect dyslexia: A matter of “good looking” , 2013, Neuropsychologia.

[17]  Steve Furber,et al.  Modelling normal and impaired letter recognition: Implications for understanding pure alexic reading , 2012, Neuropsychologia.

[18]  Steve Furber,et al.  “Serial” effects in parallel models of reading , 2012, Cognitive Psychology.

[19]  Daragh E. Sibley,et al.  Individual Differences in Visual Word Recognition: Insights from the English Lexicon Project , 2012 .

[20]  M. L. Lambon Ralph,et al.  What’s in a word? A parametric study of semantic influences on visual word recognition , 2012, Psychonomic bulletin & review.

[21]  C. Price,et al.  The Interactive Account of ventral occipitotemporal contributions to reading , 2011, Trends in Cognitive Sciences.

[22]  D. Plaut,et al.  Complementary neural representations for faces and words: A computational exploration , 2011, Cognitive neuropsychology.

[23]  M. L. Lambon Ralph,et al.  More evidence for a continuum between phonological and deep dyslexia: Novel data from three measures of direct orthography-to-phonology translation , 2011 .

[24]  C. L. Cushman,et al.  Age-of-Acquisition Effects in Pure Alexia , 2011, Quarterly journal of experimental psychology.

[25]  M. L. Lambon Ralph,et al.  The role of plasticity-related functional reorganization in the explanation of central dyslexias , 2011, Cognitive neuropsychology.

[26]  Padraic Monaghan,et al.  Modeling reading development: Cumulative, incremental learning in a computational model of word naming , 2010 .

[27]  Cristina Burani,et al.  Neglect dyslexia: a review of the neuropsychological literature , 2010, Experimental Brain Research.

[28]  A. Woollams,et al.  When does less yield more? The impact of severity upon implicit recognition in pure alexia , 2010, Neuropsychologia.

[29]  Sally Andrews,et al.  Lexical precision in skilled readers: Individual differences in masked neighbor priming. , 2010, Journal of experimental psychology. General.

[30]  Hua Shu,et al.  Simulating Language-specific and Language-general Effects in a Statistical Learning Model of Chinese Reading. , 2009, Journal of memory and language.

[31]  Maya L. Henry,et al.  Phonological dyslexia and dysgraphia: Cognitive mechanisms and neural substrates , 2009, Cortex.

[32]  James L. McClelland,et al.  A single-system account of semantic and lexical deficits in five semantic dementia patients , 2008, Cognitive neuropsychology.

[33]  Keith Rayner,et al.  Top-down and bottom-up effects in pure alexia: Evidence from eye movements , 2007, Neuropsychologia.

[34]  Mariano Sigman,et al.  Hierarchical Coding of Letter Strings in the Ventral Stream: Dissecting the Inner Organization of the Visual Word-Form System , 2007, Neuron.

[35]  Matthew A. Lambon Ralph,et al.  Using Parallel Distributed Processing Models to Simulate Phonological Dyslexia: The Key Role of Plasticity-related Recovery , 2007, Journal of Cognitive Neuroscience.

[36]  C. Spence,et al.  Developmental vision determines the reference frame for the multisensory control of action , 2007, Proceedings of the National Academy of Sciences.

[37]  Paul M Matthews,et al.  The Role of the Posterior Fusiform Gyrus in Reading , 2006, Journal of Cognitive Neuroscience.

[38]  Tim D. Fryer,et al.  Declarative memory impairments in Alzheimer's disease and semantic dementia , 2006, NeuroImage.

[39]  Matthew A. Lambon Ralph,et al.  Unlocking the Nature of the Phonological–Deep Dyslexia Continuum: The Keys to Reading Aloud Are in Phonology and Semantics , 2006, Journal of Cognitive Neuroscience.

[40]  Daniel Fiset,et al.  The breakdown of parallel letter processing in letter-by-letter dyslexia , 2006, Cognitive neuropsychology.

[41]  K. Patterson,et al.  ‘Non-semantic’Aspects of Language in Semantic Dementia: As Normal as They’re Said to Be? , 2006, Neurocase.

[42]  Elizabeth Jefferies,et al.  Presemantic Cognition in Semantic Dementia: Six Deficits in Search of an Explanation , 2006, Journal of Cognitive Neuroscience.

[43]  B. J. Casey,et al.  Semantic impairment with and without surface dyslexia: Implications for models of reading , 2005, Cognitive neuropsychology.

[44]  M. Sigman,et al.  Opinion TRENDS in Cognitive Sciences Vol.9 No.7 July 2005 The neural code for written words: a proposal , 2022 .

[45]  Stephen R. Welbourne,et al.  Exploring the impact of plasticity-related recovery after brain damage in a connectionist model of single-word reading , 2005, Cognitive, affective & behavioral neuroscience.

[46]  Max Coltheart,et al.  Are There Lexicons? , 2004, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[47]  Elizabeth Jefferies,et al.  Surface Dyslexia in Semantic Dementia: A Comparison of the Influence of Consistency and Regularity , 2004, Neurocase.

[48]  Michael J Cortese,et al.  Visual word recognition of single-syllable words. , 2004, Journal of experimental psychology. General.

[49]  Timothy T. Rogers,et al.  NATURAL SELECTION: THE IMPACT OF SEMANTIC IMPAIRMENT ON LEXICAL AND OBJECT DECISION , 2004, Cognitive neuropsychology.

[50]  R. Salmelin,et al.  Neural Correlates of Letter-String Length and Lexicality during Reading in a Regular Orthography , 2003, Journal of Cognitive Neuroscience.

[51]  M. Coltheart,et al.  358,534 nonwords: The ARC Nonword Database , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[52]  Martin Arguin,et al.  Sequential and parallel letter processing in letter-by-letter dyslexia , 2002, Cognitive neuropsychology.

[53]  Mark S. Seidenberg,et al.  Age of Acquisition Effects in Word Reading and Other Tasks , 2002 .

[54]  G. Humphreys,et al.  Differential effects of word length and visual contrast in the fusiform and lingual gyri during , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[55]  M. L. Lambon Ralph,et al.  Age of acquisition effects in adult lexical processing reflect loss of plasticity in maturing systems: insights from connectionist networks. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[56]  M. Montant,et al.  Phonological Activation in Pure Alexia , 2001, Cognitive neuropsychology.

[57]  D. Plaut,et al.  A LITERATURE REVIEW AND NEW DATA SUPPORTING AN INTERACTIVE ACCOUNT OF LETTER-BY-LETTER READING. , 1998, Cognitive neuropsychology.

[58]  David C. Plaut,et al.  Structure and Function in the Lexical System: Insights from Distributed Models of Word Reading and Lexical Decision , 1997 .

[59]  B. Weekes Differential Effects of Number of Letters on Word and Nonword Naming Latency , 1997 .

[60]  Barak A. Pearlmutter Gradient calculations for dynamic recurrent neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[61]  T. Shallice,et al.  Deep Dyslexia: A Case Study of , 1993 .

[62]  J. Hodges,et al.  Deterioration of word meaning: Implications for reading , 1992, Neuropsychologia.

[63]  H. Coslett,et al.  Evidence for preserved reading in 'pure alexia'. , 1989, Brain : a journal of neurology.

[64]  E. Warrington,et al.  Phonological Reading: Phenomena and Paradoxes , 1986, Cortex.

[65]  T. Shallice,et al.  Reading without Semantics , 1983 .

[66]  Karalyn Patterson,et al.  Letter-by-letter Reading: Psychological Descriptions of a Neurologial Syndrome , 1982 .

[67]  M. Beauvois,et al.  Phonological alexia: three dissociations. , 1979, Journal of neurology, neurosurgery, and psychiatry.

[68]  R. Glushko The Organization and Activation of Orthographic Knowledge in Reading Aloud. , 1979 .

[69]  J. Baron,et al.  Use of orthographic and word-specific knowledge in reading words aloud. , 1976 .

[70]  H. Bouma Visual recognition of isolated lower-case letters. , 1971, Vision research.

[71]  Derek Besner,et al.  The cross-script length effect: further evidence challenging PDP models of reading aloud. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[72]  D. Plaut,et al.  More modeling but still no stages: Reply to Borowsky and Besner , 2006 .

[73]  Mark S. Seidenberg,et al.  Age-of-acquisition effects in reading aloud: Tests of cumulative frequency and frequency trajectory , 2004, Memory & cognition.