Behavioral and computational aspects of language and its acquisition

Abstract One of the greatest challenges facing the cognitive sciences is to explain what it means to know a language, and how the knowledge of language is acquired. The dominant approach to this challenge within linguistics has been to seek an efficient characterization of the wealth of documented structural properties of language in terms of a compact generative grammar—ideally, the minimal necessary set of innate, universal, exception-less, highly abstract rules that jointly generate all and only the observed phenomena and are common to all human languages. We review developmental, behavioral, and computational evidence that seems to favor an alternative view of language, according to which linguistic structures are generated by a large, open set of constructions of varying degrees of abstraction and complexity, which embody both form and meaning and are acquired through socially situated experience in a given language community, by probabilistic learning algorithms that resemble those at work in other cognitive modalities.

[1]  John Robert Ross,et al.  Constraints on variables in syntax , 1967 .

[2]  E. Mark Gold,et al.  Language Identification in the Limit , 1967, Inf. Control..

[3]  M. Bornstein,et al.  Socioeconomic Status, Parenting, and Child Development , 2003 .

[4]  E. Hoff The specificity of environmental influence: socioeconomic status affects early vocabulary development via maternal speech. , 2003, Child development.

[5]  Alexander Clark,et al.  Planar Languages and Learnability , 2006, ICGI.

[6]  William C. Ritchie,et al.  Handbook of Child Language Acquisition , 1998 .

[7]  J. Saffran,et al.  From Syllables to Syntax: Multilevel Statistical Learning by 12-Month-Old Infants , 2003 .

[8]  T. Regier,et al.  Learning the unlearnable: the role of missing evidence , 2004, Cognition.

[9]  D. Slobin,et al.  Social interaction, Social Context, and Language : Essays in Honor of Susan Ervin-tripp , 1996 .

[10]  Liliane Haegeman,et al.  Introduction to Government and Binding Theory , 1991 .

[11]  George Lakoff,et al.  Irregularity In Syntax , 1970 .

[12]  Carson T. Schütze The empirical base of linguistics: Grammaticality judgments and linguistic methodology , 1998 .

[13]  Noam Chomsky,et al.  The Minimalist Program , 1992 .

[14]  David Adger,et al.  Core Syntax: A Minimalist Approach , 2003 .

[15]  Adam Makkai Homo loquens as "sender-receiver" (i.e., transceiver) and the raison d'être of sememic, lexemic and morphemic prefabs in natural language structures and language use , 1995 .

[16]  Heidi Waterfall,et al.  Emergence of syntax: commonalities and differences across children. , 2008, Developmental science.

[17]  E. Hoff Causes and consequences of SES-related differences in parent-to-child speech. , 2003 .

[18]  J. Pine,et al.  Lexically-based learning and early grammatical development , 1997, Journal of Child Language.

[19]  Dan Klein,et al.  Natural Language Grammar Induction Using a Constituent-Context Model , 2001, NIPS.

[20]  K. Lashley The problem of serial order in behavior , 1951 .

[21]  Walt Detmar Meurers,et al.  Head-driven phrase structure grammar: linguistic approach, formal foundations, and computational realization , 2006 .

[22]  J. McCawley Thirty Million Theories Of Grammar , 1982 .

[23]  Anette Rosenbach,et al.  What counts as evidence in linguistics?: the case of innateness , 2007 .

[24]  Zellig S. Harris,et al.  Distributional Structure , 1954 .

[25]  Kent Johnson Gold’s Theorem and Cognitive Science* , 2004, Philosophy of Science.

[26]  Alexander Clark,et al.  PAC-learnability of Probabilistic Deterministic Finite State Automata , 2004, J. Mach. Learn. Res..

[27]  L. A. Jeffress,et al.  Cerebral Mechanisms in Behavior , 1953 .

[28]  M. Tomasello,et al.  Young children's overgeneralizations with fixed transitivity verbs. , 1999, Child development.

[29]  Ciprian Chelba Portability of syntactic structure for language modeling , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[30]  Z. Harris From Morpheme to Utterance , 1946 .

[31]  M. Tomasello The item-based nature of children’s early syntactic development , 2000, Trends in Cognitive Sciences.

[32]  Partha Niyogi,et al.  Book Reviews: The Computational Nature of Language Learning and Evolution, by Partha Niyogi , 2007, CL.

[33]  E. Hoff-Ginsberg,et al.  Function and structure in maternal speech: Their relation to the child's development of syntax. , 1986 .

[34]  Alexander Clark Unsupervised induction of stochastic context-free grammars using distributional clustering , 2001, CoNLL.

[35]  M. Pickering,et al.  Toward a mechanistic psychology of dialogue , 2004, Behavioral and Brain Sciences.

[36]  N. Chater,et al.  Simplicity: a unifying principle in cognitive science? , 2003, Trends in Cognitive Sciences.

[37]  Heidi Waterfall,et al.  Characterizing Motherese: On the Computational Structure of Child-Directed Language , 2007 .

[38]  E. Hoff-Ginsberg,et al.  Some contributions of mothers' speech to their children's syntactic growth , 1985, Journal of Child Language.

[39]  Ray Jackendoff,et al.  The Architecture of the Language Faculty , 1996 .

[40]  Paul M. B. Vitányi,et al.  The Power and Perils of MDL , 2007, 2007 IEEE International Symposium on Information Theory.

[41]  J E Janosky,et al.  Maternal education and measures of early speech and language. , 1999, Journal of speech, language, and hearing research : JSLHR.

[42]  C. A. Ferguson,et al.  Talking to Children: Language Input and Acquisition , 1979 .

[43]  Noam Chomsky Knowledge of language: its nature, origin, and use , 1988 .

[44]  D. McDermott Mind and mechanism , 2001 .

[45]  M A Nowak,et al.  Evolution of universal grammar. , 2001, Science.

[46]  Zellig S. Harris,et al.  Mathematical structures of language , 1968, Interscience tracts in pure and applied mathematics.

[47]  Ronald Rosenfeld,et al.  A maximum entropy approach to adaptive statistical language modelling , 1996, Comput. Speech Lang..

[48]  Noam Chomsky,et al.  The Generative Enterprise Revisited: Discussions with Riny Huybregts, Henk van Riemsdijk, Naoki Fukui and Mihoko Zushi , 2004 .

[49]  Z. Harris,et al.  Foundations of language , 1941 .

[50]  Joan L. Bybee,et al.  Frequency and the emergence of linguistic structure , 2001 .

[51]  Fred W. Householder Methods in Structural Linguistics. Zellig S. Harris , 1952 .

[52]  Paul M. Postal,et al.  Skeptical Linguistic Essays , 2004 .

[53]  Colin de la Higuera,et al.  Learning typed automata from automatically labeled data , 2004 .

[54]  Peter Grünwald,et al.  A minimum description length approach to grammar inference , 1995, Learning for Natural Language Processing.

[55]  George R. Doddington,et al.  The ATIS Spoken Language Systems Pilot Corpus , 1990, HLT.

[56]  Keith E. Nelson,et al.  Facilitating children's syntax acquisition. , 1977 .

[57]  R. Langacker Foundations of cognitive grammar , 1983 .

[58]  Ivan A. Sag,et al.  Book Reviews: Head-driven Phrase Structure Grammar and German in Head-driven Phrase-structure Grammar , 1996, CL.

[59]  SHALOM LAPPIN,et al.  Machine learning theory and practice as a source of insight into universal grammar , 2007 .

[60]  Elizabeth Bates,et al.  Clausal backgrounding and pronominal reference: A functionalist approach to c-command , 2002 .

[61]  M. Tomasello Constructing a Language: A Usage-Based Theory of Language Acquisition , 2003 .

[62]  Shimon Edelman,et al.  Bridging language with the rest of cognition: computational, algorithmic and neurobiological issues and methods , 2004 .

[63]  Joshua Goodman,et al.  A bit of progress in language modeling , 2001, Comput. Speech Lang..

[64]  B. Hart,et al.  American Parenting of Language-Learning Children: Persisting Differences in Family-Child Interactions Observed in Natural Home Environments. , 1992 .

[65]  Karl G. D. Bailey,et al.  Disfluencies and human language comprehension , 2004, Trends in Cognitive Sciences.

[66]  J. Pine,et al.  Subject–auxiliary inversion errors and wh-question acquisition: ‘what children do know?’ , 2000, Journal of Child Language.

[67]  H. Andersen ABDUCTIVE AND DEDUCTIVE CHANGE , 1973 .

[68]  Noam Chomsky,et al.  Rules and representations , 1980, Behavioral and Brain Sciences.

[69]  J. Tenenbaum,et al.  Special issue on “Probabilistic models of cognition , 2022 .

[70]  Jack L. Vevea,et al.  The varieties of speech to young children. , 2007, Developmental psychology.

[71]  Anette Rosenbach,et al.  What counts as evidence in linguistics?: an introduction , 2004 .

[72]  Robert L. Mercer,et al.  Word-Sense Disambiguation Using Statistical Methods , 1991, ACL.

[73]  R S Chapman,et al.  The relation between age and mean length of utterance in morphemes. , 1981, Journal of speech and hearing research.

[74]  Toben H. Mintz,et al.  The distributional structure of grammatical categories in speech to young children , 2002 .

[75]  C. M. Scott,et al.  Adverbial connectivity in conversations of children 6 to 12 , 1984, Journal of Child Language.

[76]  Brian MacWhinney,et al.  The emergence of language. , 1999 .

[77]  Jef van den Broeck,et al.  Class differences in syntactic complexity in the Flemish town of Maaseik , 1977, Language in Society.

[78]  Alexander Clark,et al.  Identification in the Limit of Substitutable Context-Free Languages , 2005, ALT.

[79]  A. Sanford,et al.  Depth of processing in language comprehension: not noticing the evidence , 2002, Trends in Cognitive Sciences.

[80]  Charles D. Yang,et al.  Morphosyntactic Learning and the Development of Tense , 2007 .

[81]  E. Dąbrowska,et al.  Individual differences in language attainment: Comprehension of passive sentences by native and non-native English speakers , 2006 .

[82]  Michael Tomasello,et al.  Acquiring Linguistic Constructions , 2007 .

[83]  J. Hurford The neural basis of predicate-argument structure. , 2003, The Behavioral and brain sciences.

[84]  Dana Ron,et al.  The power of amnesia: Learning probabilistic automata with variable memory length , 1996, Machine Learning.

[85]  P. Kuhl Early language acquisition: cracking the speech code , 2004, Nature Reviews Neuroscience.

[86]  Beatrice Santorini,et al.  Building a Large Annotated Corpus of English: The Penn Treebank , 1993, CL.

[87]  Dan Klein,et al.  Learning Accurate, Compact, and Interpretable Tree Annotation , 2006, ACL.

[88]  S. Edelman Computing the mind : how the mind really works , 2008 .

[89]  Elie Bienenstock,et al.  Neural Networks and the Bias/Variance Dilemma , 1992, Neural Computation.

[90]  Pieter W. Adriaans,et al.  The EMILE 4.1 Grammar Induction Toolbox , 2002, ICGI.

[91]  C. Chomsky The acquisition of syntax in children from 5 to 10 , 1969 .

[92]  I. Sigel,et al.  HANDBOOK OF CHILD PSYCHOLOGY , 2006 .

[93]  T. Huxley Biogenesis and abiogenesis. , 1890 .

[94]  Alison Wray,et al.  Holistic utterances in protolanguage: the link from primates to humans , 2000 .

[95]  Edward Sapir,et al.  Language: An Introduction to the Study of Speech , 1955 .

[96]  Menno van Zaanen ABL: Alignment-Based Learning , 2000, COLING.

[97]  N. Pearlmutter,et al.  Constraints on sentence comprehension , 1998, Trends in Cognitive Sciences.

[98]  Luc Steels,et al.  The Origins of Syntax in Visually Grounded Robotic Agents , 1997, IJCAI.

[99]  José Oncina,et al.  Learning deterministic regular grammars from stochastic samples in polynomial time , 1999, RAIRO Theor. Informatics Appl..

[100]  J. Huttenlocher,et al.  Language input and child syntax , 2002, Cognitive Psychology.

[101]  M. Goldstein,et al.  Social Feedback to Infants' Babbling Facilitates Rapid Phonological Learning , 2008, Psychological science.

[102]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[103]  Howard Lasnik,et al.  The minimalist program in syntax , 2002, Trends in Cognitive Sciences.

[104]  Morten H. Christiansen,et al.  Uncovering the Richness of the Stimulus: Structure Dependence and Indirect Statistical Evidence , 2005, Cogn. Sci..

[105]  Letitia R. Naigles,et al.  Why are some verbs learned before other verbs? Effects of input frequency and structure on children's early verb use , 1998, Journal of Child Language.

[106]  Letitia R. Naigles,et al.  How children use input to acquire a lexicon. , 2002, Child development.

[107]  Anne Fernald,et al.  Names in frames: infants interpret words in sentence frames faster than words in isolation. , 2006, Developmental science.

[108]  J. Roberts,et al.  Complex syntax production of African American preschoolers. , 2001, Journal of speech, language, and hearing research : JSLHR.

[109]  Alexander Clark,et al.  Unsupervised Language Acquisition: Theory and Practice , 2002, ArXiv.

[110]  Hinrich Schütze,et al.  Book Reviews: Foundations of Statistical Natural Language Processing , 1999, CL.

[111]  Walt Detmar Meurers,et al.  Encyclopedia of Language and Linguistics , 2006 .

[112]  Tomaso Poggio,et al.  From Understanding Computation to Understanding Neural Circuitry , 1976 .

[113]  Noam Chomsky Current Issues in Linguistic Theory , 1964 .

[114]  E. Gibson,et al.  Memory Limitations and Structural Forgetting: The Perception of Complex Ungrammatical Sentences as Grammatical , 1999 .

[115]  Holger Diessel,et al.  The Acquisition of Complex Sentences , 2004 .

[116]  H. Craig,et al.  The Complex Syntax Skills of Poor, Urban, African-American Preschoolers at School Entry , 1994 .

[117]  Lynn Nadel,et al.  Encyclopedia of Cognitive Science , 2003 .

[118]  Östen Dahl,et al.  The growth and maintenance of linguistic complexity , 2004 .

[119]  Nick Chater,et al.  Toward a connectionist model of recursion in human linguistic performance , 1999 .

[120]  Dan Klein,et al.  Corpus-Based Induction of Syntactic Structure: Models of Dependency and Constituency , 2004, ACL.

[121]  Letitia R. Naigles,et al.  Input to verb learning: Evidence for the plausibility of syntactic bootstrapping , 1995 .

[122]  J. Pine,et al.  Reanalysing rote-learned phrases: individual differences in the transition to multi-word speech , 1993, Journal of Child Language.

[123]  Timothy Baldwin,et al.  An Empirical Model of Multiword Expression Decomposability , 2003, ACL 2003.

[124]  L. Gleitman,et al.  Language and Experience: Evidence from the Blind Child , 1988 .

[125]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[126]  Shimon Edelman,et al.  Representation and recognition in vision , 1999 .

[127]  Noam Chomsky,et al.  Lectures on Government and Binding , 1981 .

[128]  J. Tenenbaum,et al.  Poverty of the Stimulus? A Rational Approach , 2006 .

[129]  Frederick J. Newmeyer,et al.  Against a parameter-setting approach to typological variation , 2004 .

[130]  Pieter W. Adriaans,et al.  Learning Shallow Context-free Languages under Simple Distributions , 2001 .

[131]  W. Bruce Croft Typology and Universals , 1990 .

[132]  James R. Glass,et al.  Empirical acquisition of word and phrase classes in the atis domain , 1993, EUROSPEECH.

[133]  Barbara Landau,et al.  Objects and places: Geometric and syntactic representations in early lexical learning , 1990 .

[134]  John A. Goldsmith,et al.  Unsupervised Learning of the Morphology of a Natural Language , 2001, CL.

[135]  William Croft,et al.  Radical Construction Grammar: Syntactic Theory in Typological Perspective , 2001 .

[136]  Carlo Cecchetto,et al.  Introduction to Government and Binding Theory , 1996 .

[137]  Noah A. Smith,et al.  Guiding Unsupervised Grammar Induction Using Contrastive Estimation , 2005 .

[138]  Mark A. Pitt,et al.  Advances in Minimum Description Length: Theory and Applications , 2005 .

[139]  S. Pinker,et al.  The nature of the language faculty and its implications for evolution of language (Reply to Fitch, Hauser, and Chomsky) , 2005, Cognition.

[140]  Eytan Ruppin,et al.  Functional Representation of Enzymes by Specific Peptides , 2007, PLoS Comput. Biol..

[141]  Michael Tomasello,et al.  Beyond Names for Things: Young Children's Acquisition of Verbs , 1997 .

[142]  Kees Vermeulen,et al.  Algebras, diagrams and decisions in language, logic and computation , 2001 .

[143]  D. Gary Miller,et al.  1. Theoretical Prerequisites , 1994 .

[144]  Mark C. Baker The Atoms of Language , 1987 .

[145]  Frederick J. Newmeyer,et al.  Generative Linguistics: An Historical Perspective , 1995 .

[146]  B. MacWhinney The CHILDES project: tools for analyzing talk , 1992 .

[147]  R. Baayen,et al.  Shifting paradigms: gradient structure in morphology , 2005, Trends in Cognitive Sciences.

[148]  Alexander Clark,et al.  PAC-Learning Unambiguous NTS Languages , 2006, ICGI.

[149]  Martin Herman,et al.  New Visual Invariants for Terrain Navigation Without 3D Reconstruction , 1998, International Journal of Computer Vision.

[150]  Jeannette Schaeffer,et al.  The Acquisition of Direct Object Scrambling and Clitic Placement: Syntax and pragmatics , 2000 .

[151]  Eytan Ruppin,et al.  Unsupervised learning of natural languages , 2006 .

[152]  B. Erman,et al.  The idiom principle and the open choice principle , 2000 .

[153]  John Goldsmtth TOWARDS A NEW EMPIRICISM , 2007 .

[154]  Timothy Baldwin,et al.  Multiword Expressions: A Pain in the Neck for NLP , 2002, CICLing.

[155]  Željko Bošković,et al.  Be careful where you float your quantifiers , 2004 .

[156]  Adele E. Goldberg Constructions: a new theoretical approach to language , 2003, Trends in Cognitive Sciences.

[157]  C. Felser,et al.  Antecedent Priming at Trace Positions in Japanese Long-Distance Scrambling , 2002, Journal of psycholinguistic research.

[158]  Z. Harris,et al.  Methods in structural linguistics. , 1952 .

[159]  John Goldsmith,et al.  Morphological Analogy: Only a Beginning , 2008 .

[160]  S. Saporta,et al.  Psycholinguistics: A book of readings , 1964 .

[161]  Christopher D. Manning,et al.  Probabilistic models of language processing and acquisition , 2006, Trends in Cognitive Sciences.

[162]  Andrew Roberts,et al.  The use of corpora for automatic evaluation of grammar inference systems , 2003 .

[163]  Brian Roark,et al.  Probabilistic Top-Down Parsing and Language Modeling , 2001, CL.

[164]  I. M. Schlesinger,et al.  Categories and Processes in Language Acquisition , 1990 .

[165]  Ngoni Chipere,et al.  Variations in Native Speaker Competence: Implications for First-language Teaching , 2001 .

[166]  E. Hoff How social contexts support and shape language development , 2006 .

[167]  E. Hoff-Ginsberg Maternal speech and the child's development of syntax: a further look , 1990, Journal of Child Language.

[168]  Thomas L. Griffiths,et al.  Contextual Dependencies in Unsupervised Word Segmentation , 2006, ACL.

[169]  L. Gleitman The Structural Sources of Verb Meanings , 2020, Sentence First, Arguments Afterward.

[170]  R. Schreuder,et al.  Idioms : structural and psychological perspectives , 1997 .

[171]  E. Hoff-Ginsberg The relation of birth order and socioeconomic status to children's language experience and language development , 1998, Applied Psycholinguistics.

[172]  M. Braine Children's First Word Combinations. , 1976 .

[173]  Peter W. Culicover,et al.  Syntactic Nuts: Hard Cases, Syntactic Theory, and Language Acquisition , 1999 .

[174]  Noam Chomsky,et al.  वाक्यविन्यास का सैद्धान्तिक पक्ष = Aspects of the theory of syntax , 1965 .