What is grammar like? A usage-based constructionist perspective

This paper is intended to elucidate some implications of usage-based linguistic theory for statistical and computational models of language acquisition, focusing on morphology and morphophonology. I discuss the need for grammar (a.k.a. abstraction), the contents of individual grammars (a potentially infinite number of constructions, paradigmatic mappings and predictive relationships between phonological units), the computational characteristics of constructions (complex non-crossover interactions among partially redundant features), resolution of competition among constructions (probability matching), and the need for multimodel inference in modeling internal grammars underlying the linguistic performance of a community.

[1]  Vsevolod Kapatsinski.  Velar palatalization in Russian and artificial grammar: Constraints on models of morphophonology , 2010 .

[2]  Joan L. Bybee.  Cognitive Processes in Grammaticalization , 2014 .

[3]  Partha Niyogi,et al.  Book Reviews: The Computational Nature of Language Learning and Evolution, by Partha Niyogi , 2007, CL.

[4]  Kaori Idemaru,et al.  Word recognition reflects dimension-based statistical learning. , 2011, Journal of experimental psychology. Human perception and performance.

[5]  C. Browman,et al.  Articulatory Phonology: An Overview , 1992, Phonetica.

[6]  Matthew Stave,et al.  Inductive Bias against Stem Changes as Perseveration: Experimental Evidence for an Articulatory Approach to Output-Output Faithfulness , 2013, CogSci.

[7]  R. Baayen,et al.  Predicting the Unpredictable: Interpreting Neutralized Segments in Dutch , 2003 .

[8]  Katherine D. Kinzler,et al.  Phonological knowledge in compensation for native and non-native assimilation , 2009 .

[9]  C. Fillmore,et al.  Regularity and Idiomaticity in Grammatical Constructions: The Case of Let Alone , 1988 .

[10]  A. Goldberg.  Surface generalizations: An alternative to alternations , 2002 .

[11]  Noam Chomsky,et al.  Lectures on Government and Binding , 1981 .

[12]  J. Harris,et al.  Habituatory response decrement in the intact organism. , 1943 .

[13]  Walter Daelemans,et al.  TiMBL: Tilburg Memory-Based Learner, version 2.0, Reference guide , 1998 .

[14]  Andries W. Coetzee,et al.  The Place of Variation in Phonological Theory , 2011 .

[15]  Ewa Dąbrowska,et al.  Different speakers, different grammars: Individual differences in native language attainment , 2012 .

[16]  Achim Zeileis,et al.  BMC Bioinformatics BioMed Central Methodology article Conditional variable importance for random forests , 2008 .

[17]  Michael K. Tanenhaus,et al.  Neural correlates of partial lexical activation , 2008, Proceedings of the National Academy of Sciences.

[18]  Vsevolod Kapatsinski.  Estimating predictor importance 1 Towards a de-ranged study of variation: Estimating predictor importance with multimodel inference , 2013 .

[19]  Noam Chomsky,et al.  Some controversial questions in phonological theory , 1965, Journal of Linguistics.

[20]  Eve V. Clark,et al.  WHAT'S IN A WORD? ON THE CHILD'S ACQUISITION OF SEMANTICS IN HIS FIRST LANGUAGE , 1973 .

[21]  Harald Clahsen,et al.  Derivational morphology in the German mental lexicon: A dual mechanism account , 2002 .

[22]  John J. Ohala,et al.  Southern Bantu vs. the World: The Case of Palatalization of Labials , 1978 .

[23]  Willem H. Zuidema,et al.  Three Design Principles of Language: The Search for Parsimony in Redundancy , 2013, Language and speech.

[24]  Linda B Smith,et al.  Learning Words in Space and Time , 2011, Psychological science.

[25]  R. F. Stanners,et al.  Memory representation for morphologically related words. , 1979 .

[26]  Albert-László Barabási,et al.  Emergence of scaling in complex networks , 2005 .

[27]  J. Werker,et al.  Early Word Learners' Ability to Access Phonetic Detail in Well-Known Words , 2003, Language and speech.

[28]  Vsevolod Kapatsinski,et al.  Frequency of Use Leads to Automaticity of Production: Evidence from Repair in Conversation , 2010, Language and speech.

[29]  Walter Daelemans,et al.  Memory-Based Language Processing , 2009, Studies in natural language processing.

[30]  Carla L. Hudson Kam,et al.  Regularizing Unpredictable Variation: The Roles of Adult and Child Learners in Language Formation and Change , 2005 .

[31]  Angelo Cangelosi,et al.  An Embodied Model for Sensorimotor Grounding and Grounding Transfer: Experiments With Epigenetic Robots , 2006, Cogn. Sci..

[32]  Alexander L. Francis,et al.  The relationship between native allophonic experience with vowel duration and perception of the English tense/lax vowel contrast by Spanish and Russian listeners. , 2008, The Journal of the Acoustical Society of America.

[33]  N. Ellis.  Selective Attention and Transfer Phenomena in L2 Acquisition: Contingency, Cue Competition, Salience, Interference, Overshadowing, Blocking, and Perceptual Learning , 2006 .

[34]  Victor Kuperman,et al.  of construction probability on word durations during spontaneous incremental sentence production , 2012 .

[35]  R Harald Baayen,et al.  Sidestepping the Combinatorial Explosion: An Explanation of n-gram Frequency Effects Based on Naive Discriminative Learning , 2013, Language and speech.

[36]  Adrian E. Raftery,et al.  Bayesian model averaging: development of an improved multi-class, gene selection and classification tool for microarray data , 2005, Bioinform..

[37]  S. Baron-Cohen,et al.  Enhanced visual search for a conjunctive target in autism: a research note. , 1998, Journal of child psychology and psychiatry, and allied disciplines.

[38]  William Labov.  When Intuitions Fail , 2003 .

[39]  Antal van den Bosch,et al.  Implicit Schemata and Categories in Memory-based Language Processing , 2013, Language and speech.

[40]  Elliott Moreton,et al.  Modelling Modularity Bias inPhonological Pattern Learning , 2008 .

[41]  G S Dell,et al.  A spreading-activation theory of retrieval in sentence production. , 1986, Psychological review.

[42]  J. Berko.  The Child's Learning of English Morphology , 1958 .

[43]  R. Solomon,et al.  Visual duration threshold as a function of word-probability. , 1951, Journal of experimental psychology.

[44]  Bruce Hayes,et al.  Phonological Restructuring in Yidin and its Theoretical Consequences , 2000 .

[45]  P. Smolensky,et al.  Analytic bias and phonological typology * , 2008 .

[46]  Bertram F. Malle,et al.  The evolution of language out of pre-language , 2002 .

[47]  E. Newport,et al.  Computation of Conditional Probability Statistics by 8-Month-Old Infants , 1998 .

[48]  Ewa Dąbrowska,et al.  Language, Mind and Brain: Some Psychological and Neurological Constraints on Theories of Grammar , 2004 .

[49]  W. Labov,et al.  Empirical foundations for a theory of language change , 2014 .

[50]  David R. Anderson,et al.  Model selection and multimodel inference : a practical information-theoretic approach , 2003 .

[51]  D. Medin,et al.  SUSTAIN: a network model of category learning. , 2004, Psychological review.

[52]  Nick C. Ellis,et al.  Rules or associations in the acquisition of morphology ? The frequency by Regularity interaction in human and PDP learning of morphosyntax , 1998 .

[53]  Bridget Samuels,et al.  On Evolutionary Phonology , 2007, Biolinguistics.

[54]  G. Udny Yule,et al.  The statistical study of literary vocabulary , 1944 .

[55]  Royal Skousen,et al.  Analogical Modeling Of Language , 1989 .

[56]  R. Harald Baayen,et al.  Morphological structure in language processing , 2003 .

[57]  R. H. Baayen,et al.  Storage and computation in the mental lexicon , 2005 .

[58]  Noam Chomsky.  A minimalist program for linguistic theory , 1992 .

[59]  W. Marslen-Wilson,et al.  The temporal structure of spoken language understanding , 1980, Cognition.

[60]  S Pinker,et al.  Overregularization in language acquisition. , 1992, Monographs of the Society for Research in Child Development.

[61]  J. Goldsmith.  Towards a new empiricism for linguistics , 2010 .

[62]  Sharon Lee Armstrong,et al.  What some concepts might not be , 1983, Cognition.

[63]  Sanford A. Schane,et al.  On the psychological reality of a natural rule of syllable structure , 1975, Cognition.

[64]  Noam Chomsky.  Knowledge of Language , 1986 .

[65]  Richard F. Thompson.  Habituation: A history , 2009, Neurobiology of Learning and Memory.

[66]  H. Simon,et al.  ON A CLASS OF SKEW DISTRIBUTION FUNCTIONS , 1955 .

[67]  Christo Kirov,et al.  Bayesian Speech Production: Evidence from Latency and Hyperarticulation , 2013, CogSci.

[68]  Savas Tsohatsidis.  Meanings and prototypes : studies in linguistic categorization , 1990 .

[69]  S. Goldinger.  Echoes of echoes? An episodic theory of lexical access. , 1998, Psychological review.

[70]  Bruce Hayes,et al.  A Maximum Entropy Model of Phonotactics and Phonotactic Learning , 2008, Linguistic Inquiry.

[71]  N. Longo.  PROBABILITY-LEARNING AND HABIT-REVERSAL IN THE COCKROACH. , 1964, The American journal of psychology.

[72]  William B Estes,et al.  Similarity , Frequency , and Category Representations , 1988 .

[73]  Andrew Martin,et al.  The evolving lexicon , 2007 .

[74]  D. Broadbent.  Word-frequency effect and response bias. , 1967, Psychological review.

[75]  R. Nosofsky.  Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[76]  W. F. Hawkins,et al.  Vexierversuch: the log relationship between word-frequency and recognition obtained in the absence of stimulus words. , 1958, Journal of experimental psychology.

[77]  Edward A. Vessel,et al.  Perceptual Pleasure and the Brain , 2006 .

[78]  Russell Lee-Goldman,et al.  On expressing measurement and comparison in English and Japanese , 2010 .

[79]  J. Tenenbaum,et al.  Word learning as Bayesian inference. , 2007, Psychological review.

[80]  Tore Nesset,et al.  Making choices in Russian: pros and cons of statistical methods for rival forms , 2013 .

[81]  Amy Perfors,et al.  Memory limitations alone do not lead to over-regularization: An experimental and computational investigation , 2011, CogSci.

[82]  Charles D. Yang,et al.  Knowledge and learning in natural language , 2000 .

[83]  Laurie S. Glezer,et al.  Evidence for Highly Selective Neuronal Tuning to Whole Words in the “Visual Word Form Area” , 2009, Neuron.

[84]  W. Marslen-Wilson,et al.  Morphology and meaning in the English mental lexicon. , 1994 .

[85]  Vsevolod Kapatsinski.  Modularity in the Channel: The Link between Separability of Features and Learnability of Dependencies between Them , 2011, ICPhS.

[86]  R. Nosofsky.  Attention, similarity, and the identification-categorization relationship. , 1986 .

[87]  Mark Johnson,et al.  Language Acquisition as Statistical Inference , 2013 .

[88]  Warren S. Sarle,et al.  Neural Networks and Statistical Models , 1994 .

[89]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[90]  Dagmar Divjak,et al.  Extracting prototypes from exemplars What can corpus data tell us about concept representation? , 2013 .

[91]  Noam Chomsky,et al.  The Logical Structure of Linguistic Theory , 1975 .

[92]  B. MacWhinney,et al.  The Competition Model: the Input, the Context, and the Brain Part of the First and Second Language Acquisition Commons, and the Psychology Commons , 2022 .

[93]  Charles Reiss.  Constraining the Learning Path without Constraints, or The Ocp and NoBanana 1 , 2008 .

[94]  Bruce Hayes,et al.  Saltation and the P-map* , 2015, Phonology.

[95]  A. Yu.  Perceptual Compensation Is Correlated with Individuals' “Autistic” Traits: Implications for Models of Sound Change , 2010, PloS one.

[96]  R. Wright.  Phonetically Based Phonology: A review of perceptual cues and cue robustness , 2004 .

[97]  Jeffrey Lidz,et al.  Statistical insensitivity in the acquisition of Tsez noun classes , 2014 .

[98]  Joan L. Bybee,et al.  Regular morphology and the lexicon. , 1995 .

[99]  Andrew Garrett,et al.  Sound change , 2013 .

[100]  T. Deacon.  The Symbolic Species: The Co-evolution of Language and the Brain , 1998 .

[101]  Vsevolod Kapatsinski,et al.  The architecture of grammar in artificial grammar learning: Formal biases in the acquisition of morphophonology and the nature of the learning task , 2009 .

[102]  Vsevolod Kapatsinski,et al.  What is it I am writing? Lexical frequency effects in spelling Russian prefixes: Uncertainty and competition in an apparently regular system , 2010 .

[103]  Vsevolod Kapatsinski,et al.  Testing Theories of Linguistic Constituency with Configural Learning: The Case of the English Syllable , 2009 .

[104]  David Eddington,et al.  Issues in modeling language processing analogically , 2004 .

[105]  Vsevolod Kapatsinski,et al.  Conspiring to Mean: Experimental and Computational Evidence for a Usage-Based Harmonic Approach to Morphophonology , 2013 .

[106]  William Labov,et al.  On the uses of variable rules , 1979, Language in Society.

[107]  B. Lindblom,et al.  Numerical Simulation of Vowel Quality Systems: The Role of Perceptual Contrast , 1972 .

[108]  Janet L. McDonald,et al.  Properties of Phonological Markers That Affect the Acquisition of Gender-Like Subclasses☆☆☆★ , 1998 .

[109]  Betty S. Phillips,et al.  Lexical diffusion, lexical frequency, and lexical analysis , 2001 .

[110]  Michael Becker,et al.  The Surfeit of the Stimulus: Analytic Biases Filter Lexical Statistics in Turkish Laryngeal Alternations , 2011 .

[111]  Paul Kay,et al.  On the logic of variable rules , 1979, Language in Society.

[112]  Stephen R Mitroff,et al.  Nothing compares 2 views: Change blindness can occur despite preserved access to the changed information , 2004, Perception & psychophysics.

[113]  Caroline F. Rowland,et al.  Avoiding dative overgeneralisation errors: semantics, statistics or both? , 2014 .

[114]  T. Nesset.  Abstract phonology in a concrete model : cognitive linguistics and the morphology-phonology interface , 2008 .

[115]  B. Bergen.  The Psychological Reality of Phonaesthemes , 2004 .

[116]  William Labov,et al.  What is a Linguistic Fact , 1975 .

[117]  Siva Kalyan,et al.  Similarity in linguistic categorization: The importance of necessary properties , 2012 .

[118]  S. Pauen.  The global-to-basic level shift in infants’ categorical thinking: First evidence from a longitudinal study , 2002 .

[119]  B. Ambridge,et al.  The development of abstract syntax: Evidence from structural priming and the lexical boost , 2012, Cognition.

[120]  Dagmar Divjak,et al.  Frequency effects in language learning and processing , 2012 .

[121]  James White.  Evidence for a learning bias against saltatory phonological alternations , 2014, Cognition.

[122]  E. Dąbrowska,et al.  Polish children's productivity with case marking: the role of regularity, type frequency, and phonological diversity , 2006, Journal of Child Language.

[123]  Paul D. Allopenna,et al.  Tracking the Time Course of Spoken Word Recognition Using Eye Movements: Evidence for Continuous Mapping Models , 1998 .

[124]  Joan L. Bybee.  Morphology: A study of the relation between meaning and form , 1985 .

[125]  F. W. Householder.  Phonological theory: A brief comment , 1966 .

[126]  W. Labov.  Contraction, Deletion, and Inherent Variability of the English Copula. , 1969 .

[127]  Kaori Idemaru,et al.  Individual differences in cue weights are stable across time: the case of Japanese stop lengths. , 2012, The Journal of the Acoustical Society of America.

[128]  Geert Booij,et al.  Construction Morphology , 2010, Lang. Linguistics Compass.

[129]  Joan L. Bybee.  4. Sequentiality as the basis of constituent structure , 2002 .

[130]  Broadbent De.  Word-frequency effect and response bias. , 1967 .

[131]  David Eddington.  Spanish stress assignment within the analogical modeling of language , 2000 .

[132]  Sabine Arndt-Lappe,et al.  Towards an exemplar-based model of stress in English noun–noun compounds1 , 2011, Journal of Linguistics.

[133]  Vsevolod Kapatsinski,et al.  A multimodel inference approach to categorical variant choice: construction, priming and frequency effects on the choice between full and contracted forms of am, are and is , 2017 .

[134]  Elizabeth Bates,et al.  On the inseparability of grammar and the lexicon: Evidence from acquisition. , 1997 .

[135]  S. Piantadosi.  Zipf’s word frequency law in natural language: A critical review and future directions , 2014, Psychonomic Bulletin & Review.

[136]  Noam Chomsky.  Knowledge of language: its nature, origin, and use , 1988 .

[137]  B. Elan Dresher.  The Contrastive Hierarchy in Phonology , 2009 .

[138]  D. Swingley,et al.  Lexical exposure and word-form encoding in 1.5-year-olds. , 2007, Developmental psychology.

[139]  Joan L. Bybee,et al.  A Usage-based Approach to Spanish Verbs of 'Becoming' , 2006 .

[140]  Colin Wilson,et al.  Learning Phonology With Substantive Bias: An Experimental and Computational Study of Velar Palatalization , 2006, Cogn. Sci..

[141]  A. Healy,et al.  Detection errors on the word the: evidence for reading units larger than letters. , 1976, Journal of experimental psychology. Human perception and performance.

[142]  R. Langacker.  Foundations of cognitive grammar , 1983 .

[143]  G. Dell,et al.  Speech errors, phonotactic constraints, and implicit learning: a study of the role of experience in language production. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[144]  Walter Daelemans,et al.  Forgetting Exceptions is Harmful in Language Learning , 1998, Machine Learning.

[145]  Noam Chomsky,et al.  The Sound Pattern of English , 1968 .

[146]  J. Hay.  Causes and Consequences of Word Structure , 2003 .

[147]  B. Hayes,et al.  Rules vs. analogy in English past tenses: a computational/experimental study , 2003, Cognition.

[148]  Scott A. Jackson,et al.  High functional load inhibits phonological contrast loss: A corpus study , 2013, Cognition.

[149]  Adam N. Sanborn,et al.  Unifying rational models of categorization via the hierarchical Dirichlet process , 2019 .

[150]  J. Pierrehumbert.  The statistical basis of an unnatural alternation , 2005 .

[151]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002, Science.

[152]  Tom Verguts,et al.  Beyond exemplars and prototypes as memory representations of natural concepts: A clustering approach☆ , 2007 .

[153]  T. Nesset.  Abstract Phonology in a Concrete Model , 2008 .

[154]  Peter T. Richtsmeier,et al.  Word-types, not word-tokens, facilitate extraction of phonotactic sequences by adults. , 2011, Laboratory phonology.

[155]  Joan L. Bybee,et al.  Explanation in morphophonemics: Changes in provençal and Spanish preterite forms , 1980 .

[156]  Paul Smolensky,et al.  Grammar-based connectionist approaches to language , 1999, Cogn. Sci..

[157]  James L. McClelland,et al.  Semantic Cognition: A Parallel Distributed Processing Approach , 2004 .

[158]  Joan L. Bybee,et al.  From Usage to Grammar: The Mind's Response to Repetition , 2007 .

[159]  S. Freytag.  Knowledge Of Language Its Nature Origin And Use , 2016 .

[160]  Kie Zuraw,et al.  Patterned exceptions in phonology , 2000 .

[161]  James L. Morgan,et al.  When Hearing Lips and Seeing Voices Becomes Perceiving Speech: Auditory-Visual Integration in Lexical Access , 2011, CogSci.

[162]  Patrick Morrison,et al.  The Symbolic Species: The Co-Evolution of Language and the Human Brain , 1999, BMJ.

[163]  Dušica Filipović Đurđević,et al.  An amorphous model for morphological processing in visual comprehension based on naive discriminative learning. , 2011, Psychological review.

[164]  M. Tomasello.  Constructing a Language: A Usage-Based Theory of Language Acquisition , 2003 .

[165]  B. Hayes,et al.  Natural and Unnatural Constraints in Hungarian Vowel Harmony , 2009 .

[166]  R. Aslin,et al.  Statistical phonetic learning in infants: facilitation and feature generalization. , 2008, Developmental science.

[167]  L. Bloomfield.  A Set of Postulates for the Science of Language , 1926, International Journal of American Linguistics.

[168]  J. K. Bock.  Syntactic persistence in language production , 1986, Cognitive Psychology.

[169]  J. Pierrehumbert.  Why phonological constraints are so coarse-grained , 2001 .

[170]  Carol Lynn Moder,et al.  Morphological Classes as Natural Categories , 1983 .

[171]  Pawel M. Nowak,et al.  Phonological Rule-Learning and Its Implications for a Theory of Vowel Harmony , 2003 .

[172]  D. Norris,et al.  Shortlist B: a Bayesian model of continuous speech recognition. , 2008, Psychological review.

[173]  B. Ambridge,et al.  The island status of clausal complements: Evidence in favor of an information structure explanation , 2008 .

[174]  Vsevolod Kapatsinski,et al.  What is grammar like? A usage-based constructionist perspective , 2014, LILT.

[175]  R. Harald Baayen,et al.  Models, forests, and trees of York English: Was/were variation as a case study for statistical practice , 2012, Language Variation and Change.

[176]  R. Harald Baayen,et al.  Quantitative aspects of morphological productivity , 1992 .

[177]  F Grosjean,et al.  Spoken word recognition processes and the gating paradigm , 1980, Perception & psychophysics.

[178]  Tom M. Mitchell,et al.  The Need for Biases in Learning Generalizations , 2007 .

[179]  Robert Malouf,et al.  Morphological Organization: The Low Conditional Entropy Conjecture , 2013 .

[180]  J. Mandler.  Perceptual and Conceptual Processes in Infancy , 2000 .

[181]  Franziska Frankfurter,et al.  Constructions: A construction grammar approach to argument structure: Adele E. Goldberg, Chicago, IL: The University of Chicago Press, 1995. xi + 265 pp , 1998 .

[182]  Marcus Lindskog,et al.  Is it Time Bayes went Fishing? Bayesian Probabilistic Reasoning in a Category Learning Task , 2013, CogSci.

[183]  S. Pinker,et al.  On language and connectionism: Analysis of a parallel distributed processing model of language acquisition , 1988, Cognition.

[184]  William Croft,et al.  Radical Construction Grammar: Syntactic Theory in Typological Perspective , 2001 .

[185]  Michael Becker,et al.  Source-Oriented Generalizations as Grammar Inference in Russian Vowel Deletion , 2016, Linguistic Inquiry.

[186]  Igor Aleksander,et al.  The Study of Information: Interdisciplinary Messages , 1986, J. Inf. Technol..

[187]  A. Lotto,et al.  Cue weighting in auditory categorization: implications for first and second language acquisition. , 2006, The Journal of the Acoustical Society of America.

[188]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[189]  Grover Hudson,et al.  PHONOLOGY AND LANGUAGE USE , 2004 .

[190]  Joan L. Bybee.  Word Frequency in Lexical Diffusion and the Source of Morphophonological Change , 2007 .

[191]  Matthew Goldrick,et al.  Mechanisms of interaction in speech production , 2009, Language and cognitive processes.

[192]  Vsevolod Kapatsinski,et al.  Frequency and the emergence of prefabs: Evidence from monitoring , 2009 .

[193]  Gert Westermann,et al.  A neuroconstructivist model of past tense development and processing. , 2012, Psychological review.

[194]  Chris Davis,et al.  Tracking the acquisition of orthographic skills in developing readers: masked priming effects. , 2007, Journal of experimental child psychology.