A connectionist model of English past tense and plural morphology

The acquisition of English noun and verb morphology is modeled using a single-system connectionist network. The network is trained to produce the plurals and past tense forms of a large corpus of monosyllabic English nouns and verbs. The developmental trajectory of network performance is analyzed in detail and is shown to mimic a number of important features of the acquisition of English noun and verb morphology in young children. These include an initial error-free period of performance on both nouns and verbs followed by a period of intermittent over-regularization of irregular nouns and verbs. Errors in the model show evidence of phonological conditioning and frequency effects. Furthermore, the network demonstrates a strong tendency to regularize denominal verbs and deverbal nouns and masters the principles of voicing assimilation. Despite their incorporation into a single-system network, nouns and verbs exhibit some important differences in their profiles of acquisition. Most importantly, noun inflections are acquired earlier than verb inflections. The simulations generate several empirical predictions that can be used to evaluate further the suitability of this type of cognitive architecture in the domain of inflectional morphology.

[1]  J. Elman,et al.  Learning and morphological change , 1995, Cognition.

[2]  Mary Hare,et al.  The Role of Similarity in Hungarian Vowel Harmony: a Connectionist Account , 1990 .

[3]  S. Kuczaj The acquisition of regular and irregular past tense forms , 1977 .

[4]  N. Chater,et al.  Proceedings of the fourteenth annual conference of the cognitive science society , 1992 .

[5]  V. Marchman,et al.  From rote learning to system building: acquiring verb morphology in children and connectionist nets , 1993, Cognition.

[6]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[7]  Steven Pinker,et al.  Why No Mere Mortal Has Ever Flown Out to Center Field , 1991, Cogn. Sci..

[8]  Patrick Juola,et al.  Whole-word phonetic distances and the PGPfone alphabet , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[9]  B. MacWhinney,et al.  Implementations are not conceptualizations: Revising the verb learning model , 1991, Cognition.

[10]  Nick Chater,et al.  Connectionist natural language processing: the state of the art , 1999 .

[11]  Joan L. Bybee,et al.  Rules and schemas in the development and use of the English past tense , 1982 .

[12]  J. Elman Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[13]  Andrew W. Ellis,et al.  Age of Acquisition Norms for a Large Set of Object Names and Their Relation to Adult Estimates and Other Variables , 1997 .

[14]  H. Kucera,et al.  Computational analysis of present-day American English , 1967 .

[15]  V. Marchman,et al.  Learning from a connectionist model of the acquisition of the English past tense , 1996, Cognition.

[16]  A. Bryk,et al.  Early vocabulary growth: Relation to language input and gender. , 1991 .

[17]  S. Pinker,et al.  On language and connectionism: Analysis of a parallel distributed processing model of language acquisition , 1988, Cognition.

[18]  R. Brown,et al.  A First Language , 1973 .

[19]  James L. McClelland,et al.  On learning the past-tenses of English verbs: implicit rules or parallel distributed processing , 1986 .

[20]  V. Marchman,et al.  U-shaped learning and frequency effects in a multi-layered perception: Implications for child language acquisition , 1991, Cognition.

[21]  J. Berko The Child's Learning of English Morphology , 1958 .

[22]  G. Marcus,et al.  Children's overregularization of English plurals: a quantitative analysis , 1995, Journal of Child Language.

[23]  S Pinker,et al.  Overregularization in language acquisition. , 1992, Monographs of the Society for Research in Child Development.

[24]  E. Bates,et al.  Continuity in lexical and morphological development: a test of the critical mass hypothesis , 1994, Journal of Child Language.

[25]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[26]  V. Marchman,et al.  Overregularization in English plural and past tense inflectional morphology: a response to Marcus (1995) , 1997, Journal of Child Language.

[27]  Gary F. Marcus,et al.  German Inflection: The Exception That Proves the Rule , 1995, Cognitive Psychology.

[28]  Eric H. Lenneberg,et al.  New directions in the study of language , 1964 .

[29]  Garrison W. Cottrell,et al.  Acquiring the Mapping from Meaning to Sounds , 1994, Connect. Sci..

[30]  Steven Pinker,et al.  Regular and Irregular Morphology and the Psychological Status of Rules of Grammar , 1991 .

[31]  S Pinker,et al.  Sensitivity of children's inflection to grammatical structure , 1994, Journal of Child Language.

[32]  R. H. Baayen,et al.  The CELEX Lexical Database (CD-ROM) , 1996 .

[33]  M. Harris,et al.  Early lexical development and maternal speech: a comparison of children's initial and subsequent uses of words , 1991, Journal of Child Language.

[34]  Garrison W. Cottrell,et al.  Selective attention in the acquisition of the past tense , 1996 .