A Computational Model of Early Argument Structure Acquisition

How children go about learning the general regularities that govern language, as well as keeping track of the exceptions to them, remains one of the challenging open questions in the cognitive science of language. Computational modeling is an important methodology in research aimed at addressing this issue. We must determine appropriate learning mechanisms that can grasp generalizations from examples of specific usages, and that exhibit patterns of behavior over the course of learning similar to those in children. Early learning of verb argument structure is an area of language acquisition that provides an interesting testbed for such approaches due to the complexity of verb usages. A range of linguistic factors interact in determining the felicitous use of a verb in various constructions-associations between syntactic forms and properties of meaning that form the basis for a number of linguistic and psycholinguistic theories of language. This article presents a computational model for the representation, acquisition, and use of verbs and constructions. The Bayesian framework is founded on a novel view of constructions as a probabilistic association between syntactic and semantic features. The computational experiments reported here demonstrate the feasibility of learning general constructions, and their exceptions, from individual usages of verbs. The behavior of the model over the timecourse of acquisition mimics, in relevant aspects, the stages of learning exhibited by children. Therefore, this proposal sheds light on the possible mechanisms at work in forming linguistic generalizations and maintaining knowledge of exceptions.

[1]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[2]  Jane B. Childers,et al.  The role of pronouns in young children's acquisition of the English transitive construction. , 2001, Developmental psychology.

[3]  G. Lakoff,et al.  Women, Fire, and Dangerous Things: What Categories Reveal about the Mind , 1988 .

[4]  M. Tomasello,et al.  Differential productivity in young children's use of nouns and verbs , 1997, Journal of Child Language.

[5]  Jeffrey L. Elman,et al.  Distributed Representations, Simple Recurrent Networks, and Grammatical Structure , 1991, Mach. Learn..

[6]  J. Pine,et al.  Comparing different models of the development of the English verb category , 1998 .

[7]  Suzanne Stevenson,et al.  The Acquisition and Use of Argument Structure Constructions: A Bayesian Model , 2005 .

[8]  Robert Givan,et al.  Specific-to-General Learning for Temporal Events with Application to Learning Event Definitions from Video , 2002, J. Artif. Intell. Res..

[9]  Eytan Ruppin,et al.  Unsupervised Context Sensitive Language Acquisition from a Large Corpus , 2003, NIPS.

[10]  Alexander Clark Unsupervised induction of stochastic context-free grammars using distributional clustering , 2001, CoNLL.

[11]  Nancy Chang,et al.  Putting Meaning into Grammar Learning , 2004, Workshop On Psycho-Computational Models Of Human Language Acquisition.

[12]  Ronald W. Langacker,et al.  Grammar and conceptualization , 1999 .

[13]  Peter Ford Dominey Learning Grammatical Constructions in a Miniature Language from Narrated Video Events , 2003 .

[14]  James L. McClelland,et al.  Mechanisms of Sentence Processing: Assigning Roles to Constituents of Sentences , 1986 .

[15]  Alexander Clark,et al.  Unsupervised Language Acquisition: Theory and Practice , 2002, ArXiv.

[16]  I. Good THE POPULATION FREQUENCIES OF SPECIES AND THE ESTIMATION OF POPULATION PARAMETERS , 1953 .

[17]  N. Akhtar,et al.  Acquiring basic word order: evidence for data-driven learning of syntactic structure , 1999, Journal of Child Language.

[18]  Melissa Bowerman,et al.  Argument structure and learnability: Is a solution in sight? , 1996 .

[19]  Joseph P. Allen Probabilistic Constraints in Acquisition , 1997 .

[20]  M. Tomasello Do young children have adult syntactic competence? , 2000, Cognition.

[21]  Sourabh Niyogi Bayesian Learning at the Syntax-Semantics Interface , 2002 .

[22]  Michael Tomasello,et al.  Beyond Names for Things: Young Children's Acquisition of Verbs , 1997 .

[23]  Michael P Maratsos,et al.  A study in novel word learning: The productivity of the causative , 1987 .

[24]  G. Marcus Negative evidence in language acquisition , 1993, Cognition.

[25]  Steven Pinker,et al.  Productivity and constraints in the acquisition of the passive , 1987, Cognition.

[26]  Fernando C Pereira Formal grammar and information theory: together again? , 2000, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[27]  C. Fillmore,et al.  Regularity and Idiomaticity in Grammatical Constructions: The Case of Let Alone , 1988 .

[28]  Afra Alishahi,et al.  A Probabilistic Model of Early Argument Structure Acquisition , 2005 .

[29]  M. Tomasello,et al.  A tale of two theories: response to Fisher , 2002, Cognition.

[30]  N. Chater,et al.  Simplicity: A cure for overgeneralizations in language acquisition? , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.

[31]  A. Goldberg Constructions at Work: The Nature of Generalization in Language , 2006 .

[32]  Anna L. Theakston,et al.  The role of entrenchment in children's and adults' performance on grammaticality judgment tasks , 2004 .

[33]  Willard Van Orman Quine,et al.  Word and Object , 1960 .

[34]  Robert Givan,et al.  Specific-to-general learning for temporal events , 2002, AAAI/IAAI.

[35]  G. Miller,et al.  Cognitive science. , 1981, Science.

[36]  L. Gleitman The Structural Sources of Verb Meanings , 2020, Sentence First, Arguments Afterward.

[37]  Letitia R. Naigles,et al.  Children use syntax to learn verb meanings , 1990, Journal of Child Language.

[38]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[39]  S. Pinker Learnability and Cognition: The Acquisition of Argument Structure , 1989 .

[40]  Beth Levin,et al.  English Verb Classes and Alternations: A Preliminary Investigation , 1993 .

[41]  Julian M. Pine,et al.  Constructing a Language: A Usage-Based Theory of Language Acquisition. , 2004 .

[42]  Ping Li,et al.  Early lexical development in a self-organizing neural network , 2004, Neural Networks.

[43]  J. Siskind A computational study of cross-situational techniques for learning word-to-meaning mappings , 1996, Cognition.

[44]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[45]  Rutvik H. Desai Bootstrapping in miniature language acquisition , 2002, Cognitive Systems Research.

[46]  B. MacWhinney,et al.  The Handbook of East Asian Psycholinguistics: The competition model , 2006 .

[47]  B. MacWhinney A multiple process solution to the logical problem of language acquisition , 2004, Journal of Child Language.

[48]  Fernand Gobet,et al.  Modelling Syntactic Development in a Cross-Linguistic Context , 2004 .

[49]  益子 真由美 Argument Structure , 1993, The Lexicon.

[50]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[51]  Brian MacWhinney,et al.  Basic Syntactic Processes , 1982 .

[52]  Julian M. Pine,et al.  A process model of children's early verb use , 2000 .

[53]  S Pinker,et al.  Overregularization in language acquisition. , 1992, Monographs of the Society for Research in Child Development.

[54]  Chen Yu,et al.  The Role of Embodied Intention in Early Lexical Acquisition , 2005, Cogn. Sci..

[55]  G. Lakoff Women, fire, and dangerous things : what categories reveal about the mind , 1989 .

[56]  Melissa Bowerman,et al.  Evaluating competing linguistic models with language acquisition data: Implications of developmental errors with causative verbs. , 1982 .

[57]  Suzanne Stevenson,et al.  A Cognitive Model for the Representation and Acquisition of Verb Selectional Preferences , 2007 .

[58]  Cynthia L Fisher,et al.  Structural limits on verb mapping: the role of abstract structure in 2.5‐year‐olds’ interpretations of novel verbs , 2002 .

[59]  E. Markman,et al.  When it is better to receive than to give: Syntactic and conceptual constraints on vocabulary growth , 1994 .

[60]  John R. Anderson,et al.  The Adaptive Nature of Human Categorization , 1991 .

[61]  Hal L. Smith,et al.  A competition model , 2008 .

[62]  Suzanne Stevenson,et al.  A computational usage-based model for learning general properties of semantic roles , 2007 .

[63]  Peter Ford Dominey,et al.  A Developmental Model of Syntax Acquisition in the Construction Grammar Framework with Cross-Linguistic Validation in English and Japanese , 2004 .

[64]  Deb Roy,et al.  Intentional Context in Situated Natural Language Learning , 2005, CoNLL.