Acquisition of aspect in self-organizing connectionist models

Abstract Two connectionist networks, DISLEX and DevLex-II, were used in this study to model the acquisition of lexical and grammatical aspect. Both models use multi-layered self-organizing feature maps, connected by associative links trained according to the Hebbian learning rule. Previous empirical research has identified a strong association between lexical aspect and grammatical aspect in child language, on the basis of which some researchers argue for innate semantic categories or prelinguistic predispositions. Our simulations indicate that such an association can emerge from dynamic self-organization and Hebbian learning in connectionist networks, without the need of a priori assumptions about the structure of innate knowledge. Our modeling results further attest to the utility of self-organizing neural networks in the study of language acquisition.

[1]  J. Elman,et al.  Rethinking Innateness: A Connectionist Perspective on Development , 1996 .

[2]  L. Fenson,et al.  Lexical development norms for young children , 1996 .

[3]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[4]  James W. Deutsch The Mind within the Net: Models of Learning, Thinking and Acting , 2001 .

[5]  Risto Miikkulainen,et al.  Semantic Boost on Episodic Associations: An Empirically-Based Computational Model , 2007, Cogn. Sci..

[6]  Letitia R. Naigles,et al.  Children use syntax to learn verb meanings , 1990, Journal of Child Language.

[7]  Ping Li 6. In search of meaning: The acquisition of semantic structure and morphological systems , 2006 .

[8]  Thomas R. Shultz,et al.  Connectionist Models of Development: Developmental Processes in Real and Artificial Neural Networks , 2003 .

[9]  Chen Yu,et al.  Learning Syntax-Semantics Mappings to Bootstrap Word Learning , 2006 .

[10]  Max-Planck-Gesellschaft zur Förderung der Wissenschaften,et al.  The Child's construction of language , 1981 .

[11]  Ping Li,et al.  3 A self-organizing connectionist model of bilingual processing , 2002 .

[12]  W. Klein,et al.  Aspect and Assertion in Mandarin Chinese , 2000 .

[13]  Bernard Comrie Aspect: An Introduction to the Study of Verbal Aspect and Related Problems , 1976 .

[14]  D. Bickerton The roots of language , 2016 .

[15]  Risto Miikkulainen,et al.  Subsymbolic natural language processing - an integrated model of scripts, lexicon, and memory , 1993, Neural network modeling and connectionism.

[16]  B. MacWhinney Models of the emergence of language. , 1998, Annual review of psychology.

[17]  R. Miikkulainen Dyslexic and Category-Specific Aphasic Impairments in a Self-Organizing Feature Map Model of the Lexicon , 1997, Brain and Language.

[18]  L. Harner Children Talk about the Time and Aspect of Actions. , 1981 .

[19]  Yasuhiro Shirai,et al.  On the overgeneralization of progressive marking on stative verbs: bioprogram or input? , 1994 .

[20]  M. Maratsos,et al.  The internal language of children's syntax : The ontogenesis and representation of syntactic categories , 1980 .

[21]  T. Kohonen,et al.  Self-organizing semantic maps , 1989, Biological Cybernetics.

[22]  Ping Li,et al.  The Acquisition of Word Meaning through Global Lexical Co-occurrences , 2000 .

[23]  Y. Shirai The emergence of tense-aspect morphology in Japanese: universal predisposition? , 1998 .

[24]  William D. Marslen-Wilson,et al.  Universals in Morphological Representation: Evidence from Italian , 1997 .

[25]  Zeno Vendler,et al.  Verbs and Times , 1957, The Language of Time - A Reader.

[26]  Ping Li,et al.  PatPho: A phonological pattern generator for neural networks , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[27]  D. Bickerton The language bioprogram hypothesis , 1984, Behavioral and Brain Sciences.

[28]  A. Baddeley,et al.  Working Memory and Language , 2018, Working Memories.

[29]  B. MacWhinney,et al.  Vocabulary Acquisition and Verbal Short-Term Memory: Computational and Neural Bases , 1997, Brain and Language.

[30]  F. Attneave,et al.  The Organization of Behavior: A Neuropsychological Theory , 1949 .

[31]  L. Bloom,et al.  Semantics of verbs and the development of verb inflection in child language , 1980 .

[32]  Stephen Whittaker,et al.  The encoding of tense and aspect by three- to five-year-old children☆ , 1988 .

[33]  P. Harris,et al.  Is the English present progressive unique , 1985, Journal of Child Language.

[34]  D A Behrend,et al.  Morphological cues to verb meaning: verb inflections and the initial mapping of verb meanings , 1995, Journal of Child Language.

[35]  Ping Li Language Acquisition in a Self-Organising Neural Network Model , 2004 .

[36]  白井 恭弘,et al.  Primacy of aspect in language acquisition : simplified input and prototype /[by] Shirai, Yasuhiro , 1991 .

[37]  Igor Farkas,et al.  Modeling the Development of Lexicon with a Growing Self-Organizing Map , 2002, JCIS.

[38]  Risto Miikkulainen,et al.  SARDNET: A Self-Organizing Feature Map for Sequences , 1994, NIPS.

[39]  M. Bowerman,et al.  The acquisition of lexical and grammatical aspect in Chinese , 1998 .

[40]  David G. Stork,et al.  Pattern Classification (2nd ed.) , 1999 .

[41]  Ping Li,et al.  A Self-Organizing Connectionist Model of Early Word Production , 2005 .

[42]  L. Gleitman The Structural Sources of Verb Meanings , 2020, Sentence First, Arguments Afterward.

[43]  J. Nazuno Haykin, Simon. Neural networks: A comprehensive foundation, Prentice Hall, Inc. Segunda Edición, 1999 , 2000 .

[44]  Ping Li,et al.  Competition : A Connectionist Model of the Learning of English Reversive Prefixes , 2010 .

[45]  Ping Li,et al.  Early lexical development in a self-organizing neural network , 2004, Neural Networks.

[46]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[47]  B. MacWhinney,et al.  Implementations are not conceptualizations: Revising the verb learning model , 1991, Cognition.

[48]  Carlota S. Smith,et al.  The Parameter of Aspect , 1991 .

[49]  David G. Stork,et al.  Pattern Classification , 1973 .

[50]  Ping Li,et al.  Dynamic Self-Organization and Early Lexical Development in Children , 2007, Cogn. Sci..

[51]  Tom Ziemke,et al.  A Self-Organizing Connectionist Model of Early Word Production , 2005 .

[52]  Ping Li,et al.  The emergence of competing modules in bilingualism , 2005, Trends in Cognitive Sciences.

[53]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[54]  Yasuhiro Shirai,et al.  The Acquisition of Tense-Aspect Morphology: A Prototype Account. , 1995 .

[55]  R. Brown A First Language , 1973 .

[56]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[57]  Chen Yu,et al.  Statistical Cross-Situational Learning to Build Word-to-World Mappings , 2006 .

[58]  Yasuhiro Shirai,et al.  The Acquisition of Lexical and Grammatical Aspect , 2000 .

[59]  Ping Li,et al.  A self-organizing neural network model of the acquisition of word meaning , 2001 .

[60]  Carlota Smith A Theory of Aspectual Choice , 1983 .