The distributional structure of grammatical categories in speech to young children

We present a series of three analyses of young children’s linguistic input to determine the distributional information it could plausibly offer to the process of grammatical category learning. Each analysis was conducted on four separate corpora from the CHILDES database (MacWhinney, 2000) of speech directed to children under 2;5. We show that, in accord with other findings, a distributional analysis which categorizes words based on their co-occurrence patterns with surrounding words successfully categorizes the majority of nouns and verbs. In Analyses 2 and 3, we attempt to make our analyses more closely relevant to natural language acquisition by adopting more realistic assumptions about how young children represent their input. In Analysis 2, we limit the distributional context by imposing phrase structure boundaries, and find that categorization improves even beyond that obtained from less limited contexts. In Analysis 3, we reduce the representation of input elements which young children might not fully process and we find that categorization is not adversely affected: Although noun categorization is worse than in Analyses 1 and 2, it is still good; and verb categorization actually improves. Overall, successful categorization of nouns and verbs is maintained across all analyses. These results provide promising support for theories of grammatical category formation involving distributional analysis, as long as these analyses are combined with appropriate assumptions about the child learner’s computational biases and capabilities.

[1]  Willard Van Orman Quine,et al.  Word and Object , 1960 .

[2]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .

[3]  G. Miller,et al.  The Genesis of Language: A Psycholinguistic Approach , 1966 .

[4]  Elizabeth F. Shipley,et al.  The Acquisition of Linguistic Structure. Technical Report VIII, A Study in the Acquisition of Language: Free Responses to Commands. , 1969 .

[5]  L. Bloom Language Development: Form and Function in Emerging Grammars , 1970 .

[6]  J. Macnamara Cognitive basis of language learning in infants. , 1972, Psychological review.

[7]  J. Kimball Seven principles of surface structure parsing in natural language , 1973 .

[8]  Melissa Bowerman,et al.  STRUCTURAL RELATIONSHIPS IN CHILDREN'S UTTERANCES: SYNTACTIC OR SEMANTIC?1 , 1973 .

[9]  F. Moore Cognitive development and the acquisition of language , 1973 .

[10]  R. Brown,et al.  A First Language , 1973 .

[11]  P. Suppes The Semantics of Children's Language , 1974 .

[12]  Lyle L. Lloyd,et al.  Language Perspectives: Acquisition, Retardation, and Intervention , 1974 .

[13]  Noam Chomsky,et al.  The Logical Structure of Linguistic Theory , 1975 .

[14]  E. Newport MOTHERESE: THE SPEECH OF MOTHERS TO YOUNG CHILDREN. , 1975 .

[15]  A. Peters LANGUAGE LEARNING STRATEGIES: DOES THE WHOLE EQUAL THE SUM OF THE PARTS? , 1977 .

[16]  S. Pinker Formal models of language learning , 1979, Cognition.

[17]  M. Maratsos,et al.  The internal language of children's syntax : The ontogenesis and representation of syntactic categories , 1980 .

[18]  Elissa L. Newport,et al.  The role of constituent structure in the induction of an artificial language , 1981 .

[19]  Eric Wanner,et al.  Language acquisition: the state of the art , 1982 .

[20]  S. Weinstein,et al.  Models of language acquisition , 1984 .

[21]  Steven Pinker,et al.  Language learnability and language development , 1985 .

[22]  B. MacWhinney,et al.  A functionalist approach to the acquisition of grammar , 1987 .

[23]  Elissa L Newport,et al.  Structural packaging in the input to language learning: Contributions of prosodic and morphological marking of phrases to the acquisition of language , 1987, Cognitive Psychology.

[24]  J. S. Johnson,et al.  Critical period effects in second language learning: The influence of maturational state on the acquisition of English as a second language , 1989, Cognitive Psychology.

[25]  Catherine E. Snow,et al.  Children's language , 1990 .

[26]  Elissa L. Newport,et al.  Maturational Constraints on Language Learning , 1990, Cogn. Sci..

[27]  Barbara Landau,et al.  Function Morphemes in Young Children's Speech Perception and Production , 1990 .

[28]  L. Gleitman The Structural Sources of Verb Meanings , 2020, Sentence First, Arguments Afterward.

[29]  Eric Brill,et al.  Discovering the Lexical Features of a Language , 1991, ACL.

[30]  A. Woodward,et al.  Perception of acoustic correlates of major phrasal units by young infants , 1992, Cognitive Psychology.

[31]  Nick Chater,et al.  BOOTSTRAPPING SYNTACTIC CATEGORIES , 1992 .

[32]  Catharine H. Echols A perceptually-based model of children's earliest productions , 1993, Cognition.

[33]  Hinrich Schütze,et al.  Part-of-Speech Induction From Scratch , 1993, ACL.

[34]  James Henderson,et al.  Review of Connectionist approaches to natural language processing by Ronan G. Reilly and Noel E. Sharkey. Lawrence Erlbaum Associates 1992. , 1993 .

[35]  R. Reilly,et al.  Connectionist approaches to natural language processing , 1994 .

[36]  E. Jelinek Quantification in Straits Salish , 1995 .

[37]  James L. Morgan,et al.  Signal to syntax : bootstrapping from speech to grammar in early acquisition , 1996 .

[38]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[39]  Elizabeth Hughes,et al.  Proceedings of the 21th annual Boston University Conference on Language Development , 1997 .

[40]  T. A. Cartwright,et al.  Syntactic categorization in early language acquisition: formalizing the role of distributional analysis , 1997, Cognition.

[41]  P. Jusczyk,et al.  Sensitivity to discontinuous dependencies in language learners: evidence for limitations in processing space , 1998, Cognition.

[42]  L. Gerken,et al.  An electrophysiological study of infants' sensitivity to the sound patterns of English speech. , 1998, Journal of speech, language, and hearing research : JSLHR.

[43]  Nick Chater,et al.  Distributional Information: A Powerful Cue for Acquiring Syntactic Categories , 1998, Cogn. Sci..

[44]  Lila R. Gleitman,et al.  Human simulations of lexical acquisition , 1999 .

[45]  H. Gleitman,et al.  Human simulations of vocabulary learning , 1999, Cognition.

[46]  J. Werker,et al.  Newborn infants’ sensitivity to perceptual cues to lexical and grammatical words , 1999, Cognition.

[47]  R. Gómez,et al.  Artificial grammar learning by 1-year-olds leads to specific and abstract knowledge , 1999, Cognition.

[48]  Toben H. Mintz Unique Entropy As A Model Of Linguistic Classification , 2000 .

[49]  Nick Chater,et al.  Distributional Bootstrapping: From Word Class to Proto-Sentence , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.