Constraints on Plasticity in a Connectionist Model of the English Past Tense

This paper investigates constraints on dissociation and plasticity in a connectionist model undergoing random lesions both prior to and during training. When networks were trained only on phonological encodings of stem-suhed pairs similar to English regular verbs (e.g., walk walked), long-term deficits (i.e., critical period effects) were not observed, yet there were substantive short-term effects of injury. When training vocabulary reflected the English-like competition between regular (suffixed) and irregular verbs (e.g., go went, hit hit), the acquisition of regular verbs became increasingly susceptible to injury, while the irregulars were learned quickly and were relatively impervious to damage. Patterns of generalization to novel forms conflicts with the assumption that this behavioral dissociation is indicative of selective impairment of the learning and generalization of the past tense rule, while the associative lexical-based mechanism is left intact. Instead, we propose a view of network performance in which the regular-irregular dissociation derives from a general reduction in the ability to find a single-mechanism solution when resolving the competition between two classes of mappings. In light of other models in which regular and irregular forms compete (e.g., Patterson, Seidenberg, & McClelland, 1989), as well as patterns of performance in normal and disordered English speakers (e.g., Pinker, 1991), two general implications are discussed: (1) critical period effects need not derive from endog-enously determined maturational change, but instead may in part result from learning history in relation to characteristics of the language to be learned (i.e., entrenchment), and (2) selective dissociations can result from general damage in systems that are not modularized in terms of rule-based vs. associative mechanisms.

[1]  J. Berko The Child's Learning of English Morphology , 1958 .

[2]  Changing patterns of childhood aphasia. , 1978, Annals of neurology.

[3]  C. C. Wood Variations on a theme by Lashley: lesion experiments on the neural model of Anderson, Silverstein, Ritz, and Jones. , 1978, Psychological review.

[4]  S. Carey,et al.  Language deficits after apparent clinical recovery from childhood aphasia , 1979, Annals of neurology.

[5]  Morris Halle,et al.  The rules of language , 1980, IEEE Transactions on Professional Communication.

[6]  R. Berndt,et al.  Category-specific naming deficit following cerebral infarction , 1985, Nature.

[7]  A. Caramazza On drawing inferences about the structure of normal cognitive systems from the analysis of patterns of impaired performance: The case for single-patient studies , 1986, Brain and Cognition.

[8]  James L. McClelland,et al.  On learning the past-tenses of English verbs: implicit rules or parallel distributed processing , 1986 .

[9]  Geoffrey E. Hinton,et al.  Learning and relearning in Boltzmann machines , 1986 .

[10]  D. Riva,et al.  Late effects of unilateral brain lesions sustained before and after age one , 1986, Neuropsychologia.

[11]  H. Whitaker,et al.  Spoken syntax in children with acquired unilateral hemisphere lesions , 1986, Brain and Language.

[12]  D. Lancker,et al.  Comprehension of familiar phrases by left- but not by right-hemisphere damaged patients , 1987, Brain and Language.

[13]  A. Friederici,et al.  Grammatical Morphology in Aphasia: Evidence from Three Languages , 1987, Cortex.

[14]  Aram Dm Language sequelae of unilateral brain lesions in children. , 1988 .

[15]  L. Tyler Spoken language comprehension in a fluent aphasic patient , 1988 .

[16]  D. Lancker,et al.  Nonpropositional speech: Neurolinguistic studies , 1988 .

[17]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[18]  James L. McClelland,et al.  Connections and disconnections: Acquired dyslexia in a computational model of reading processes. , 1989 .

[19]  U. Bellugi,et al.  Neuropsychological, neurological, and neuroanatomical profile of Williams syndrome. , 2005, American journal of medical genetics. Supplement.

[20]  M. Mozer,et al.  On the Interaction of Selective Attention and Lexical Knowledge: A Connectionist Account of Neglect Dyslexia , 1990, Journal of Cognitive Neuroscience.

[21]  Y. Joanette,et al.  Narrative Discourse in Right-Brain-Damaged Right-Handers , 1990 .

[22]  Stephen José Hanson,et al.  What connectionist models learn: Learning and representation in connectionist networks , 1990, Behavioral and Brain Sciences.

[23]  Peter M. Duppenthaler Maturational Constraints on Language Learning , 1990 .

[24]  V. Marchman,et al.  U-shaped learning and frequency effects in a multi-layered perception: Implications for child language acquisition , 1991, Cognition.

[25]  M. Gopnik,et al.  Familial aggregation of a developmental language disorder , 1991, Cognition.

[26]  HOW NEUROPSYCHOLOGY INFORMS AN UNDERSTANDING OF NORMAL FUNCTION - AUTHORS RESPONSE , 1991 .

[27]  B. MacWhinney,et al.  A maximum likelihood procedure for the analysis of group and individual data in aphasia research , 1991, Brain and Language.

[28]  Michael I. Jordan,et al.  Task Decomposition Through Competition in a Modular Connectionist Architecture: The What and Where Vision Tasks , 1990, Cogn. Sci..

[29]  James L. McClelland,et al.  A computational model of semantic memory impairment: modality specificity and emergent category specificity. , 1991, Journal of experimental psychology. General.

[30]  E. Bates,et al.  Early lexical development in children with focal brain injury , 1991, Brain and Language.

[31]  Tim Shallice,et al.  EFFECTS OF WORD ABSTRACTNESS IN A CONNECTIONIST MODEL OF DEEP DYSLEXIA , 1991 .

[32]  Geoffrey E. Hinton,et al.  Lesioning an attractor network: investigations of acquired dyslexia , 1991 .

[33]  E. Bates,et al.  Statistical constraints on the use of single cases in neuropsychological research , 1991, Brain and Language.

[34]  Laurence B. Leonard,et al.  Morphological Deficits in Children With Specific Language Impairment: The Status of Features in the Underlying Grammar , 1992 .

[35]  E. Bates,et al.  Continuity in lexical and morphological development: a test of the critical mass hypothesis , 1994, Journal of Child Language.