Dissociations in Performance on Novel Versus Irregular Items: Single-Route Demonstrations With Input Gain in Localist and Distributed Models

Four pairs of connectionist simulations are presented in which quasi-regular mappings are computed using localist and distributed representations. In each simulation, a control parameter termed input gain was modulated over the only level of representation that mapped inputs to outputs. Input gain caused both localist and distributed models to shift between regularity-based and item-based modes of processing. Performance on irregular items was selectively impaired in the regularity-based modes, whereas performance on novel items was selectively impaired in the item-based modes. Thus, the models exhibited double dissociations without separable processing components. These results are discussed in the context of analogous dissociations found in language domains such as word reading and inflectional morphology.

[1]  H. Clahsen,et al.  Lexical entries and rules of language: A multidisciplinary study of German inflection , 1999, Behavioral and Brain Sciences.

[2]  Royal Skousen,et al.  Analogical Modeling Of Language , 1989 .

[3]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[4]  William D. Marslen-Wilson,et al.  Dissociating types of mental computation , 1997, Nature.

[5]  Kim Kirsner,et al.  What Can we Infer from Double Dissociations? , 2003, Cortex.

[6]  Joan L. Bybee Phonology and Language Use , 2004, Phonetica.

[7]  John J. L. Morton,et al.  Interaction of information in word recognition. , 1969 .

[8]  Yves Chauvin,et al.  Backpropagation: the basic theory , 1995 .

[9]  S. Petersen,et al.  A procedure for identifying regions preferentially activated by attention to semantic and phonological relations using functional magnetic resonance imaging , 2003, Neuropsychologia.

[10]  M. Coltheart Phonological dyslexia: Past and future issues. , 1996 .

[11]  James L. McClelland,et al.  Deficits in phonology and past-tense morphology: What's the connection? , 2003 .

[12]  Randall C. O'Reilly,et al.  Generalization in Interactive Networks: The Benefits of Inhibitory Competition and Hebbian Learning , 2001, Neural Computation.

[13]  D. Shanks,et al.  Neuropsychological Dissociations between Priming and Recognition: a Single-system Connectionist Account , 2003 .

[14]  R. Nosofsky Relations between exemplar-similarity and likelihood models of classification , 1990 .

[15]  M. Behrmann,et al.  Surface dyslexia and dysgraphia: dual routes, single lexicon , 1992 .

[16]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[17]  B. Hayes,et al.  Rules vs. analogy in English past tenses: a computational/experimental study , 2003, Cognition.

[18]  Thomas H. Carr,et al.  The brain is not single-minded about inflectional morphology: A response to the commentaries , 2003, Brain and Language.

[19]  R. Glushko The Organization and Activation of Orthographic Knowledge in Reading Aloud. , 1979 .

[20]  James L. McClelland,et al.  Deficits in irregular past-tense verb morphology associated with degraded semantic knowledge , 2001, Neuropsychologia.

[21]  S. Blumstein,et al.  Self-Organizing Dynamics of Lexical Access in Normals and Aphasics , 2001, Journal of Cognitive Neuroscience.

[22]  D. Plaut,et al.  The task dependence of staged versus cascaded processing: an empirical and computational study of Stroop interference in speech production. , 2000, Journal of experimental psychology. General.

[23]  G. Miller,et al.  Cognitive science. , 1981, Science.

[24]  S. Pinker,et al.  On language and connectionism: Analysis of a parallel distributed processing model of language acquisition , 1988, Cognition.

[25]  M T Ullman,et al.  The Declarative/Procedural Model of Lexicon and Grammar , 2001, Journal of psycholinguistic research.

[26]  T. Bever,et al.  The relation between linguistic structure and associative theories of language learning—A constructive critique of some connectionist learning models , 1988, Cognition.

[27]  E. Funnell Phonological processes in reading: new evidence from acquired dyslexia. , 1983, British journal of psychology.

[28]  Steven Pinker,et al.  The Nature of Regularity and Irregularity: Evidence from Hebrew Nominal Inflection , 2002, Journal of psycholinguistic research.

[29]  James L. McClelland,et al.  ‘Words or Rules’ cannot exploit the regularity in exceptions , 2002, Trends in Cognitive Sciences.

[30]  K. Patterson Phonological ALEXIA or PHONOLOGICAL alexia , 1995 .

[31]  Janice Kay,et al.  One Process, Not Two, in Reading Aloud: Lexical Analogies Do the Work of Non-Lexical Rules , 1981 .

[32]  Geoffrey E. Hinton,et al.  A general framework for parallel distributed processing , 1986 .

[33]  Barak A. Pearlmutter Gradient calculations for dynamic recurrent neural networks: a survey , 1995, IEEE Trans. Neural Networks.

[34]  Maryellen C. MacDonald,et al.  Language learning and innateness: Some implications of Compounds Research , 2003, Cognitive Psychology.

[35]  S. Pinker,et al.  A Neural Dissociation within Language: Evidence that the Mental Dictionary Is Part of Declarative Memory, and that Grammatical Rules Are Processed by the Procedural System , 1997, Journal of Cognitive Neuroscience.

[36]  Richard J. Brown Neuropsychology Mental Structure , 1989 .

[37]  S. Sloman The empirical case for two systems of reasoning. , 1996 .

[38]  Mark S. Seidenberg,et al.  Impairments in verb morphology after brain injury: a connectionist model. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[39]  Christopher T. Kello,et al.  The Emergence of a Double Dissociation in the Modulation of a Single Control Parameter in a Nonlinear Dynamical System , 2003, Cortex.

[40]  D. Medin,et al.  The specific character of abstract thought: Categorization, problem-solving, and induction: Volume 5 , 1989 .

[41]  Jean-Marc Fellous,et al.  Computational Models of Neuromodulation , 1998, Neural Computation.

[42]  S E Shaywitz,et al.  Neurobiological studies of reading and reading disability. , 2001, Journal of communication disorders.

[43]  S. Pinker Words and Rules: The Ingredients of Language , 1999 .

[44]  U. Hahn,et al.  German Inflection: Single Route or Dual Route? , 2000, Cognitive Psychology.

[45]  James L. McClelland,et al.  Rules or connections in past-tense inflections: what does the evidence rule out? , 2002, Trends in Cognitive Sciences.

[46]  Simon A. J. Winder A model for biological winner-take-all neural competition employing inhibitory modulation of NMDA-mediated excitatory gain , 1999, Neurocomputing.

[47]  Bruce F. Pennington,et al.  What do double dissociations prove? , 2001, Cogn. Sci..

[48]  J. Hodges,et al.  Deterioration of word meaning: Implications for reading , 1992, Neuropsychologia.

[49]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[50]  Karalyn Patterson,et al.  Selective disorders of reading? , 1999, Current Opinion in Neurobiology.

[51]  R. Sternberg Advances in the psychology of human intelligence , 1982 .

[52]  Christopher T. Kello,et al.  Strategic control in word reading: evidence from speeded responding in the tempo-naming task. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[53]  David C. Plaut,et al.  Strategic Control Over Rate of Processing in Word Reading: A Computational Investigation of the Tempo-Naming Task , 2000 .

[54]  M Coltheart,et al.  DRC: a dual route cascaded model of visual word recognition and reading aloud. , 2001, Psychological review.

[55]  John R. Anderson,et al.  The role of examples and rules in the acquisition of a cognitive skill. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[56]  P. Juola Double dissociations and neurophysiological expectations. , 2000, Brain and cognition.

[57]  Paul W. B. Atkins,et al.  Models of reading aloud: Dual-route and parallel-distributed-processing approaches. , 1993 .

[58]  James L. McClelland,et al.  Conspiracy effects in word pronunciation. , 1987 .

[59]  S. Pinker,et al.  The past and future of the past tense , 2002, Trends in Cognitive Sciences.

[60]  Mark S. Seidenberg,et al.  Category-Specific Semantic Deficits in Focal and Widespread Brain Damage: A Computational Account , 1998, Journal of Cognitive Neuroscience.

[61]  W. Marslen-Wilson,et al.  Rules, representations, and the English past tense , 1998, Trends in Cognitive Sciences.

[62]  D. Plaut Double dissociation without modularity: evidence from connectionist neuropsychology. , 1995, Journal of clinical and experimental neuropsychology.