A distributed, developmental model of word recognition and naming.

A parallel distributed processing model of visual word recognition and pronunciation is described. The model consists of sets of orthographic and phonological units and an interlevel of hidden units. Weights on connections between units were modified during a training phase using the back-propagation learning algorithm. The model simulates many aspects of human performance, including (a) differences between words in terms of processing difficulty, (b) pronunciation of novel items, (c) differences between readers in terms of word recognition skill, (d) transitions from beginning to skilled reading, and (e) differences in performance on lexical decision and naming tasks. The model's behavior early in the learning phase corresponds to that of children acquiring word recognition skills. Training with a smaller number of hidden units produces output characteristic of many dyslexic readers. Naming is simulated without pronunciation rules, and lexical decisions are simulated without accessing word-level representations. The performance of the model is largely determined by three factors: the nature of the input, a significant fragment of written English; the learning rule, which encodes the implicit structure of the orthography in the weights on connections; and the architecture of the system, which influences the scope of what can be learned.

[1]  Stephen A. Ritz,et al.  Distinctive features, categorical perception, and probability learning: some applications of a neural model , 1977 .

[2]  J. Locke Ease of articulation. , 1972, Journal of speech and hearing research.

[3]  Michael K. Tanenhaus,et al.  Context effects in lexical processing: A connectionist approach to modularity. , 1987 .

[4]  E. Shoben,et al.  The influence of sentence constraint on the scope of facilitation for upcoming words. , 1985 .

[5]  S. Pinker,et al.  On language and connectionism: Analysis of a parallel distributed processing model of language acquisition , 1988, Cognition.

[6]  G. Humphreys,et al.  Are there independent lexical and nonlexical routes in word processing? An evaluation of the dual-route theory of reading , 1985, Behavioral and Brain Sciences.

[7]  Mark S. Seidenberg,et al.  Spelling-sound effects in reading: Time-course and decision criteria , 1985, Memory & cognition.

[8]  W D Marslen-Wilson,et al.  Sentence Perception as an Interactive Parallel Process , 1975, Science.

[9]  Mark S. Seidenberg,et al.  Context and lexical access: implications of nonword interference for lexical ambiguity resolution. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[10]  Anthony F. Jorm,et al.  An invited article: Phonological recoding and reading acquisition , 1983, Applied Psycholinguistics.

[11]  Michael C. Doyle,et al.  Effects of frequency on visual word recognition tasks: where are they? , 1989, Journal of experimental psychology. General.

[12]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[13]  A. Parkin Phonological recoding in lexical decision: Effects of spelling-to-sound regularity depend on how regularity is defined , 1982, Memory & cognition.

[14]  Mark S. Seidenberg,et al.  Orthographic and phonological activation in auditory and visual word recognition , 1980, Memory & cognition.

[15]  D. Swinney,et al.  Accessing lexical ambiguities during sentence comprehension: Effects of frequency of meaning and contextual bias , 1981 .

[16]  Mark S. Seidenberg Reading Complex Words , 1989 .

[17]  K. Rayner,et al.  Eye movements in reading: A tutorial review. , 1987 .

[18]  J. Marshall,et al.  Patterns of paralexia: A psycholinguistic approach , 1973 .

[19]  Mark S. Seidenberg,et al.  Cognitive neuropsychology and language: The state of the art , 1988 .

[20]  Charles A. Perfetti,et al.  Interactive Processes in Reading , 1981 .

[21]  Mark S. Seidenberg,et al.  On the roles of frequency and lexical access in word naming , 1990 .

[22]  Glenn M. Kleiman,et al.  Speech recoding in reading , 1975 .

[23]  Mark S. Seidenberg,et al.  When does irregular spelling or pronunciation influence word recognition , 1984 .

[24]  Wayne A. Wickelgran Context-sensitive coding, associative memory, and serial order in (speech) behavior. , 1969 .

[25]  Philip B. Gough,et al.  One Second of Reading. , 1972 .

[26]  A. Tversky,et al.  Extensional versus intuitive reasoning: the conjunction fallacy in probability judgment , 1983 .

[27]  K. Stanovich Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. , 1986 .

[28]  Noam Chomsky,et al.  The Sound Pattern of English , 1968 .

[29]  Geoffrey E. Hinton,et al.  Distributed Representations , 1986, The Philosophy of Artificial Intelligence.

[30]  A. H. Kawamoto Distributed Representations of Ambiguous Words and Their Resolution in a Connectionist Network , 1988 .

[31]  Mark S. Seidenberg The time course of phonological code activation in two writing systems , 1985, Cognition.

[32]  D. Besner,et al.  Reading pseudohomophones: Implications for models of pronunciation assembly and the locus of word-frequency effects in naming. , 1987 .

[33]  R. W. Barron Word recognition in early reading: A review of the direct and indirect access hypotheses , 1986, Cognition.

[34]  R. Treiman,et al.  Are there onset- and rime-like units in printed words? , 1987 .

[35]  Mark S. Seidenberg,et al.  Sublexical structures in visual word recognition: Access units or orthographic redundancy? , 1987 .

[36]  Terrence J. Sejnowski,et al.  NETtalk: a parallel network that learns to read aloud , 1988 .

[37]  James L. McClelland,et al.  Conspiracy effects in word pronunciation. , 1987 .

[38]  Max Coltheart,et al.  Access to the internal lexicon , 1977 .

[39]  Edward E. Smith,et al.  The role of syllables in perceptual processing , 1973 .

[40]  L. Henderson Orthography and Word Recognition in Reading , 1982 .

[41]  Derek Besner,et al.  Word recognition and identification: Do word-frequency effects reflect lexical access? , 1988 .

[42]  Geoffrey E. Hinton,et al.  Learning distributed representations of concepts. , 1989 .

[43]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[44]  Kenneth I. Forster,et al.  Frequency blocking and lexical access: One mental lexicon or two? , 1981 .

[45]  Mark S. Seidenberg Constraining models of word recognition , 1985, Cognition.

[46]  James L. McClelland,et al.  On learning the past-tenses of English verbs: implicit rules or parallel distributed processing , 1986 .

[47]  Jonathan D. Cohen,et al.  Control of automatic processes: A parallel distributed-processing account of the Stroop effect. Technical report , 1989 .

[48]  William S-Y. Wang,et al.  Language Change A Lexical Perspective , 1979 .

[49]  M. Hillinger,et al.  Priming effects with phonemically similar words: , 1980, Memory & cognition.

[50]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[51]  M. Adams What good is orthographic redundancy , 1980 .

[52]  G. Underwood Strategies of information processing , 1980 .

[53]  J. H. Neely Semantic priming and retrieval from lexical memory: Roles of inhibitionless spreading activation and limited-capacity attention. , 1977 .

[54]  John L. Bradshaw,et al.  Articulatory interference and the mown-down heterophone effect , 1974 .

[55]  P. Tabossi Effects of context on the immediate interpretation of unambiguous nouns. , 1988 .

[56]  S. L. Ehrenreich,et al.  Structure and Search of the Internal Lexicon. , 1979 .

[57]  Randolph G. Bias,et al.  Phonological recoding and reading. , 1981 .

[58]  D. Swinney Lexical access during sentence comprehension: (Re)consideration of context effects , 1979 .

[59]  Joan L. Bybee Morphology: A study of the relation between meaning and form , 1985 .

[60]  C. T. James The Role of Semantic Information in Lexical Decisions. , 1975 .

[61]  C. Perfetti,et al.  The visual tongue-twister effect: Phonological activation in silent reading , 1982 .

[62]  R. Venezky The Structure of English Orthography , 1965 .

[63]  Dominic W. Massaro,et al.  Toward a Psychology of Reading , 1978 .

[64]  John J. L. Morton,et al.  Interaction of information in word recognition. , 1969 .

[65]  H. Rubenstein,et al.  Evidence for phonemic recoding in visual word recognition , 1971 .

[66]  S. Jay Samuels,et al.  Toward a theory of automatic information processing in reading , 1974 .

[67]  James L. McClelland On the time relations of mental processes: An examination of systems of processes in cascade. , 1979 .

[68]  Derek Besner,et al.  Basic processes in reading: Two phonological codes. , 1982 .

[69]  R. Glushko The Organization and Activation of Orthographic Knowledge in Reading Aloud. , 1979 .

[70]  A. Parkin,et al.  Further explorations of the consistency effect in word and nonword pronunciation , 1987, Memory & cognition.

[71]  Jonathan Baron,et al.  How Children Get Meaning from Printed Words. , 1977 .

[72]  R. Conrad,et al.  Acoustic confusions in immediate memory. , 1964 .

[73]  James E. Hoard Aspiration, Tenseness, and Syllabication in English. , 1971 .

[74]  G S Dell,et al.  A spreading-activation theory of retrieval in sentence production. , 1986, Psychological review.

[75]  K. Stanovich,et al.  The effect of sentence context on ongoing word recognition: Tests of a two-process theory. , 1981 .

[76]  A. Benton,et al.  Developmental dyslexia: neurological aspects. , 1975, Advances in neurology.

[77]  S. Andrews Phonological recoding: Is the regularity effect consistent? , 1982 .

[78]  Mark S. Seidenberg,et al.  Acquisition and use of spelling-sound correspondences in reading , 1984 .

[79]  James L. McClelland,et al.  Mechanisms of Sentence Processing: Assigning Roles to Constituents of Sentences , 1986 .

[80]  Mark S. Seidenberg,et al.  Word recognition processes of poor and disabled readers: Do they necessarily differ? , 1985, Applied Psycholinguistics.

[81]  D. Balota,et al.  The locus of word-frequency effects in the pronunciation task: Lexical access and/or production? ☆ , 1985 .

[82]  Geoffrey E. Hinton,et al.  Parallel computations for controlling an arm. , 1984, Journal of motor behavior.

[83]  L. Barsalou Context-independent and context-dependent information in concepts , 1982, Memory & cognition.

[84]  Mark S. Seidenberg,et al.  Multiple code activation in word recognition: evidence from rhyme monitoring. , 1981, Journal of experimental psychology. Human learning and memory.

[85]  K. Forster Priming and the Effects of Sentence and Lexical Contexts on Naming Time: Evidence for Autonomous Lexical Processing* , 1981 .

[86]  Mark S. Seidenberg,et al.  Pre- and postlexical loci of contextual effects on word recognition , 1984, Memory & cognition.

[87]  Gordon D. A. Brown Resclving inconsistency: A computational model of word naming , 1987 .

[88]  Barry Gordon,et al.  Lexical access and lexical decision: Mechanisms of frequency sensitivity. , 1983 .

[89]  R W Schvaneveldt,et al.  Semantic-context effects on word recognition: Influence of varying the proportion of items presented in an appropriate context , 1977, Memory & cognition.

[90]  D. Balota,et al.  Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. , 1984, Journal of experimental psychology. Human perception and performance.

[91]  Derek Besner,et al.  Phonological Encoding in the Lexical Decision Task , 1979 .

[92]  G. C. Orden A ROWS is a ROSE: Spelling, sound, and reading , 1987 .

[93]  G. E. MacKinnon,et al.  Reading Research Advances in Theory and Practice , 1985 .

[94]  T. Landauer,et al.  Structural differences between common and rare words: Failure of equivalence assumptions for theories of word recognition , 1973 .

[95]  B. Mittelman,et al.  On control. , 1979, Dental management.

[96]  I. Fischler,et al.  Automatic and attentional processes in the effects of sentence contexts on word recognition , 1979 .

[97]  H. Kucera,et al.  Computational analysis of present-day American English , 1967 .

[98]  B. Bergum,et al.  Attention and Performance VI , 1978 .

[99]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[100]  Mark S. Seidenberg,et al.  Visual word recognition and pronunciation: a computational model and its implications , 1989 .

[101]  Elizabeth B.-N. Sanders,et al.  The effects of graphemic, phonetic, and semantic relationships on access to lexical structures , 1978 .

[102]  M. Coltheart,et al.  The cognitive neuropsychology of language , 1987 .

[103]  Jonathan Baron,et al.  Phonemic Stage Not Necessary for Reading , 1973 .

[104]  Alan D. Baddeley,et al.  Working Memory and Reading , 1979 .

[105]  Michael K. Tanenhaus,et al.  Lexical structure and language comprehension , 1989 .

[106]  David A. Balota Comprehension Processes in Reading. , 1990 .

[107]  Marie Bienkowski,et al.  Automatic access of the meanings of ambiguous words in context: Some limitations of knowledge-based processing , 1982, Cognitive Psychology.

[108]  J. H. Neely Semantic priming and retrieval from lexical memory: Evidence for facilitatory and inhibitory processes , 1976, Memory & cognition.

[109]  D. Whitteridge,et al.  Learning and Relearning , 1959, Science's STKE.

[110]  Michael I. Jordan Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[111]  James L. McClelland,et al.  On the control of automatic processes: a parallel distributed processing account of the Stroop effect. , 1990, Psychological review.

[112]  Michael Garman,et al.  Psycholinguistics: Accessing the mental lexicon , 1990 .

[113]  K. Forster,et al.  Lexical Access and Naming Time. , 1973 .

[114]  Garrison W. Cottrell,et al.  Lexical ambiguity resolution , 1987 .

[115]  J. Baron,et al.  Use of orthographic and word-specific knowledge in reading words aloud. , 1976 .

[116]  G. A. Murrell,et al.  WORD RECOGNITION AND MORPHEMIC STRUCTURE , 1974 .

[117]  K. E. P. Carter Phonological recoding in the lexical decision task , 1986 .

[118]  James L. McClelland,et al.  An interactive activation model of context effects in letter perception: I. An account of basic findings. , 1981 .

[119]  G Underwood,et al.  Orthographic vs. phonological irregularity in lexical decision , 1983, Memory & cognition.

[120]  J. Frederiksen,et al.  Spelling and sound: Approaches to the internal lexicon. , 1976 .

[121]  W. Kintsch,et al.  Memory and cognition , 1977 .

[122]  James L. McClelland The Case for Interactionism in Language Processing. , 1987 .

[123]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[124]  Mark S. Seidenberg,et al.  Orthographic effects on rhyme monitoring. , 1979 .

[125]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[126]  James L. McClelland,et al.  Distributed memory and the representation of general and specific information. , 1985, Journal of experimental psychology. General.

[127]  Geoffrey E. Hinton,et al.  Proceedings of the 1988 Connectionist Models Summer School , 1989 .

[128]  R. Schvaneveldt,et al.  Functions of graphemic and phonemic codes in visual word-recognition , 1974, Memory & cognition.

[129]  K E Stanovich,et al.  Lexical access and the spelling-to-sound regularity effect , 1980, Memory & cognition.

[130]  M. Coltheart Lexical access in simple reading tasks , 1978 .

[131]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[132]  Michael K. Tanenhaus,et al.  Linguistic Structure in Language Processing , 1988 .

[133]  G. C. Orden,et al.  Word identification in reading proceeds from spelling to sound to meaning. , 1988, Journal of experimental psychology. Learning, memory, and cognition.