A Connectionist Approach to Word Reading and Acquired Dyslexia: Extension to Sequential Processing

A connectionist approach to word reading, based on the principles of distributed representation, graded learning of statistical structure, and interactivity in processing, has led to the development of explicit computational models which account for a wide range of data on normal skilled reading and on patterns of reading impairment due to brain damage. There have, however, been recent empirical challenges to these models, and the approach in general, relating to the influence of orthographic length on the naming latencies of both normal and dyslexic readers. The current work presents a simulation which generates sequential phonological output in response to written input, and which can refixate the input when encountering difficulty. The normal model reads both words and nonwords accurately, and exhibits an effect of orthographic length and a frequency-by-consistency interaction in its naming latencies. When subject to peripheral damage, the model exhibits an increased length effect that interacts with word frequency, characteristic of letter-by-letter reading in pure alexia. Although the model is far from a fully adequate account of all the relevant phenomena, it suggests how connectionist models may be extended to provide deeper insight into sequential processes in reading.

[1]  R. Glushko The Organization and Activation of Orthographic Knowledge in Reading Aloud. , 1979 .

[2]  Paul W. B. Atkins,et al.  Models of reading aloud: Dual-route and parallel-distributed-processing approaches. , 1993 .

[3]  Nick Chater,et al.  Connectionist natural language processing: the state of the art , 1999 .

[4]  Elizabeth K. Warrington,et al.  Semantic memory and reading abilities: a case report. , 1995 .

[5]  Bruce F. Pennington,et al.  Word identification in reading and the promise of subsymbolic psycholinguistics. , 1990, Psychological review.

[6]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[7]  M. Just,et al.  The psychology of reading and language comprehension , 1986 .

[8]  A. Ellis,et al.  Semantic loss without surface dyslexia , 1995 .

[9]  Joseph P. Levy,et al.  Connectionist models of memory and language , 1995 .

[10]  H. Coslett,et al.  Evidence for preserved reading in 'pure alexia'. , 1989, Brain : a journal of neurology.

[11]  Terrence J. Sejnowski,et al.  Parallel Networks that Learn to Pronounce English Text , 1987, Complex Syst..

[12]  M. Mozer Letter migration in word perception. , 1983, Journal of experimental psychology. Human perception and performance.

[13]  Mark S. Seidenberg,et al.  Semantic effects in single-word naming. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[14]  John C. Marshall,et al.  Deep dyslexia since 1980. , 1987 .

[15]  M. Coltheart,et al.  Whammies and double whammies: The effect of length on nonword reading , 1998 .

[16]  K. Rayner,et al.  Toward a model of eye movement control in reading. , 1998 .

[17]  E. Warrington,et al.  Phonological Reading: Phenomena and Paradoxes , 1986, Cortex.

[18]  M. Farah Neuropsychological inference with an interactive brain: A critique of the "locality" assumption. , 1994 .

[19]  M. Behrmann,et al.  Surface dyslexia and dysgraphia: dual routes, single lexicon , 1992 .

[20]  David C. Plaut,et al.  Evaluating Word-Reading Models at the Item Level: Matching the Grain of Theory and Data , 1998 .

[21]  J. Hodges,et al.  Deterioration of word meaning: Implications for reading , 1992, Neuropsychologia.

[22]  James L. McClelland,et al.  Conspiracy effects in word pronunciation. , 1987 .

[23]  Ja Bullinaria,et al.  DOUBLE DISSOCIATION IN ARTIFICIAL NEURAL NETWORKS - IMPLICATIONS FOR NEUROPSYCHOLOGY , 1993 .

[24]  M. Zorzi,et al.  Two routes or one in reading aloud? A connectionist dual-process model. , 1998 .

[25]  D. F. Fisher,et al.  Eye movements : cognition and visual perception , 1982 .

[26]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[27]  J Dérouesné,et al.  Phonological alexia: three dissociations. , 1979 .

[28]  James A. Reggia,et al.  Competitive Dynamics in a Dual-route Connectionist Model of Print-to-sound Transformation , 1988, Complex Syst..

[29]  Michael W. Harm,et al.  DIVISION OF LABOR IN A COMPUTATIONAL MODEL OF VISUAL WORD RECOGNITION , 1998 .

[30]  J. Bullinaria Modeling Reading, Spelling, and Past Tense Learning with Artificial Neural Networks , 1997, Brain and Language.

[31]  L. Henderson Orthography and Word Recognition in Reading , 1982 .

[32]  Geoffrey E. Hinton,et al.  Lesioning an attractor network: investigations of acquired dyslexia , 1991 .

[33]  James L. McClelland,et al.  On learning the past-tenses of English verbs: implicit rules or parallel distributed processing , 1986 .

[34]  James L. McClelland,et al.  Generalization with Componential Attractors: Word and Nonword Reading in an Attractor Network , 1993 .

[35]  D. Plaut,et al.  A LITERATURE REVIEW AND NEW DATA SUPPORTING AN INTERACTIVE ACCOUNT OF LETTER-BY-LETTER READING. , 1998, Cognitive neuropsychology.

[36]  D. Besner,et al.  The process of lexical decision: More words about a parallel distributed processing model. , 1992 .

[37]  T. Shallice,et al.  Deep Dyslexia: A Case Study of , 1993 .

[38]  James L. McClelland,et al.  Nonword pronunciation and models of word recognition. , 1994, Journal of experimental psychology. Human perception and performance.

[39]  M. Behrmann,et al.  Visual complexity in letter-by-letter reading: Pure alexia is not pure , 1998, Neuropsychologia.

[40]  Tim Shallice,et al.  Single and multiple component central dyslexic syndromes , 1995 .

[41]  Brian MacWhinney,et al.  The emergence of language. , 1999 .

[42]  James L. McClelland,et al.  READING EXCEPTION WORDS AND PSEUDOWORDS - ARE 2 ROUTES REALLY NECESSARY , 1992 .

[43]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[44]  John J. L. Morton,et al.  Interaction of information in word recognition. , 1969 .

[45]  David A. Balota,et al.  The Utility of Item-Level Analyses in Model Evaluation: A Reply to Seidenberg and Plaut , 1998 .

[46]  H. Kucera,et al.  Computational analysis of present-day American English , 1967 .

[47]  D. Plaut Double dissociation without modularity: evidence from connectionist neuropsychology. , 1995, Journal of clinical and experimental neuropsychology.

[48]  David A. Balota,et al.  Visual Word Recognition: The Journey from Features to Meaning (A Travel Update) , 2006 .

[49]  Geoffrey E. Hinton 20 – CONNECTIONIST LEARNING PROCEDURES1 , 1990 .

[50]  David C. Plaut,et al.  Structure and Function in the Lexical System: Insights from Distributed Models of Word Reading and Lexical Decision , 1997 .

[51]  T. Shallice From Neuropsychology to Mental Structure: Converging Operations: Specific Syndromes and Evidence from Normal Subjects , 1988 .

[52]  R. Friedman,et al.  The Continuum of Deep/Phonological Alexia , 1990, Cortex.

[53]  Carsten Peterson,et al.  A Mean Field Theory Learning Algorithm for Neural Networks , 1987, Complex Syst..

[54]  Ken N. Seergobin,et al.  On the association between connectionism and data: Are a few words necessary? , 1990 .

[55]  James L. McClelland,et al.  Parallel Distributed Processing: Explorations in the Microstructure of Cognition : Psychological and Biological Models , 1986 .

[56]  James L. McClelland,et al.  CONNECTIONS AND DISCONNECTIONS: A CONNECTIONIST ACCOUNT OF SURFACE DYSLEXIA , 1996 .

[57]  E K Warrington,et al.  Concrete word dyslexia. , 1981, British journal of psychology.

[58]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[59]  Alfonso Caramazza,et al.  Selective impairment of semantics in lexical processing , 1990 .

[60]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[61]  B. Weekes Differential Effects of Number of Letters on Word and Nonword Naming Latency , 1997 .

[62]  D. Besner,et al.  Reading pseudohomophones: Implications for models of pronunciation assembly and the locus of word-frequency effects in naming. , 1987 .

[63]  R. Friedman Recovery from Deep Alexia to Phonological Alexia: Points on a Continuum , 1996, Brain and Language.

[64]  David A. Balota,et al.  Bringing Computational Models of Word Naming Down to the Item Level , 1997 .

[65]  Christopher T. Kello,et al.  Initial phoneme versus whole-word criterion to initiate pronunciation: Evidence based on response latency and initial phoneme duration. , 1998 .

[66]  Karalyn Patterson,et al.  Letter-by-letter Reading: Psychological Descriptions of a Neurologial Syndrome , 1982 .

[67]  Tim Shallice,et al.  Lexical processing in the absence of explicit word identification: Evidence from a letter-by-letter reader , 1986 .

[68]  J. Dejerine,et al.  Contribution a l'etude anatomo-pathologique et clinique des differentes varietes de cecite verbale , 2000 .

[69]  D. Norris A quantitative multiple-levels model of reading aloud. , 1994 .

[70]  Nigel H. Goddard,et al.  Proceedings of the 15th Annual Conference of the Cognitive Science Society , 1993 .

[71]  Gregory V. Jones Deep dyslexia, imageability, and ease of predication , 1985, Brain and Language.

[72]  Geoffrey E. Hinton Deterministic Boltzmann Learning Performs Steepest Descent in Weight-Space , 1989, Neural Computation.