FREQUENCY EFFECTS IN LANGUAGE PROCESSING

This article shows how language processing is intimately tuned to input frequency. Examples are given of frequency effects in the processing of phonology, phonotactics, reading, spelling, lexis, morphosyntax, formulaic language, language comprehension, grammaticality, sentence production, and syntax. The implications of these effects for the representations and developmental sequence of SLA are discussed. Usage-based theories hold that the acquisition of language is exemplar based. It is the piecemeal learning of many thousands of constructions and the frequency-biased abstraction of regularities within them. Determinants of pattern productivity include the power law of practice, cue competition and constraint satisfaction, connectionist learning, and effects of type and token frequency. The regularities of language emerge from experience as categories and prototypical patterns. The typical route of emergence of constructions is from formula, through low-scope pattern, to construction. Frequency plays a large part in explaining sociolinguistic variation and language change. Learners' sensitivity to frequency in all these domains has implications for theories of implicit and explicit learning and their interactions. The review concludes by considering the history of frequency as an explanatory concept in theoretical and applied linguistics, its 40 years of exile, and its necessary reinstatement as a bridging variable that binds the different schools of language acquisition research.

[1]  Laura Collins THE L2 ACQUISITION OF TENSE-ASPECT MORPHOLOGY , 2004, Studies in Second Language Acquisition.

[2]  Richard I. Ivry,et al.  Attention and Structure in Sequence Learning , 2004 .

[3]  Adele E. Goldberg,et al.  Learning argument structure generalizations , 2004 .

[4]  R. Barnard Cognition and Second Language Instruction , 2003 .

[5]  David Lightfoot,et al.  Explaining language change: an evolutionary approach , 2002 .

[6]  Michael Lewis The Lexical Approach: The State of ELT and a Way Forward , 2002 .

[7]  Nick C. Ellis,et al.  Memory for language , 2001 .

[8]  David B. Pisoni,et al.  Emergent phonotactic generalizations in English and Arabic , 2001 .

[9]  R. Dekeyser,et al.  Explaining the “Natural Order of L2 Morpheme Acquisition” in English: A Meta-analysis of Multiple Determinants , 2001 .

[10]  Karin Humphreys,et al.  The psychology of language : from data to theory , 2001 .

[11]  N. Schmitt,et al.  Vocabulary in Language Teaching , 2000 .

[12]  G. Leech Grammars of spoken English: new outcomes of corpus-oriented research. , 2000 .

[13]  J. Norris,et al.  Effectiveness of L2 Instruction: A Research Synthesis and Quantitative Meta‐analysis , 2000 .

[14]  R. Gómez,et al.  Infant artificial language learning and language acquisition , 2000, Trends in Cognitive Sciences.

[15]  M. Tomasello The item-based nature of children’s early syntactic development , 2000, Trends in Cognitive Sciences.

[16]  Alexandra A. Cleland,et al.  Activation of Syntactic Information During Language Production , 2000, Journal of psycholinguistic research.

[17]  Susan Hunston,et al.  Book Reviews: Pattern Grammar: A Corpus-Driven Approach to the Lexical Grammar of English , 2000, CL.

[18]  K. Bardovi-Harlig Tense and aspect in second language acquisition : form, meaning, and use , 2000 .

[19]  Michael Barlow,et al.  Usage-based models of language , 2000 .

[20]  Zenzi M. Griffin,et al.  The persistence of structural priming: transient activation or implicit learning? , 2000, Journal of experimental psychology. General.

[21]  Rod Ellis,et al.  Item versus System Learning: Explaining Free Variation. , 1999 .

[22]  Usha Goswami,et al.  Causal connections in beginning reading: the importance of rhyme , 1999 .

[23]  Maryellen C. MacDonald,et al.  A probabilistic constraints approach to language acquisition and processing , 1999, Cogn. Sci..

[24]  M. Brent Speech segmentation and word discovery: a computational perspective , 1999, Trends in Cognitive Sciences.

[25]  Mark S. Seidenberg,et al.  Phonology, reading acquisition, and dyslexia: insights from connectionist models. , 1999, Psychological review.

[26]  Elizabeth K. Johnson,et al.  Statistical learning of tone sequences by human infants and adults , 1999, Cognition.

[27]  Paul B. Mandell On the reliability of grammaticality judgement tests in second language acquisition research , 1999 .

[28]  James E. McDermott,et al.  Implicit and Explicit Learning of Languages. , 1999 .

[29]  Familiarity breeds consent : is structural facilitation evidence for the implicit knowledge of syntactic structures? , 1999 .

[30]  M. Tomasello,et al.  Early syntactic development: A Construction Grammar approach. , 1999 .

[31]  M. Grandon Awareness and Second Language Acquisition , 1999 .

[32]  飯島 周 「会話の文法」に関する一考察 : Longman Grammar of Spoken and Written Englishの場合 , 1999 .

[33]  Mark S. Seidenberg,et al.  The emergence of grammaticality in connectionist networks. , 1999 .

[34]  N. Ellis Emergentism, Connectionism, and Language Learning. , 1998 .

[35]  Brian MacWhinney,et al.  THE ACQUISITION OF CASE MARKING BY ADULT LEARNERS OF RUSSIAN AND GERMAN , 1998, Studies in Second Language Acquisition.

[36]  Judit Kormos,et al.  PROBLEM-SOLVING MECHANISMS IN L2 COMMUNICATION , 1998, Studies in Second Language Acquisition.

[37]  L. Barsalou,et al.  Basing Categorization on Individuals and Events , 1998, Cognitive Psychology.

[38]  Catherine Doughty,et al.  Focus on Form in Classroom Second Language Acquisition. The Cambridge Applied Linguistics Series. , 1998 .

[39]  W. D. Davies,et al.  Native speaker vs. L2 learner grammaticality judgements , 1998 .

[40]  Carson T. Schütze The empirical base of linguistics: Grammaticality judgments and linguistic methodology , 1998 .

[41]  Rens Bod,et al.  Beyond Grammar: An Experience-Based Theory of Language , 1998 .

[42]  Susan Conrad,et al.  Corpus Linguistics: Investigating Language Structure and Use , 1998 .

[43]  Nick Chater,et al.  Connectionist and Statistical Approaches to Language Acquisition: A Distributional Perspective. , 1998 .

[44]  S. Goldinger Echoes of echoes? An episodic theory of lexical access. , 1998, Psychological review.

[45]  Morten H. Christiansen,et al.  Learning to Segment Speech Using Multiple Cues: A Connectionist Model , 1998 .

[46]  U. Goswami,et al.  Children's orthographic representations and linguistic transparency: Nonsense word reading in English, French, and Spanish , 1998, Applied Psycholinguistics.

[47]  B. MacWhinney IMPLICIT AND EXPLICIT PROCESSES Commentary , 1998 .

[48]  John Sinclair,et al.  Grammar patterns. 1., Verbs , 1998 .

[49]  B. MacWhinney Models of the emergence of language. , 1998, Annual review of psychology.

[50]  M. Zorzi,et al.  Two routes or one in reading aloud? A connectionist dual-process model. , 1998 .

[51]  J. Pine,et al.  Comparing different models of the development of the English verb category , 1998 .

[52]  Morton Ann Gernsbacher,et al.  Learning and losing syntax: Practice makes perfect and frequency builds fortitude , 1998 .

[53]  M. Tomasello The new psychology of language : cognitive and functional approaches to language structure , 1998 .

[54]  Nick C. Ellis,et al.  Rules or associations in the acquisition of morphology ? The frequency by Regularity interaction in human and PDP learning of morphosyntax , 1998 .

[55]  R Ratcliff,et al.  Memory-based language processing: psycholinguistic research in the 1990s. , 1998, Annual review of psychology.

[56]  Dan I. Slobin,et al.  The origins of grammaticizable notions: beyond the individual mind , 2014 .

[57]  J. Pind The Discovery of Spoken Language, Peter W. Jusczyk (Ed.). MIT Press (1997), ISBN 0 262 10058 4 , 1997 .

[58]  Sandra A. Thompson,et al.  Three Frequency Effects in Syntax , 1997 .

[59]  H. Wimmer,et al.  The impact of orthographic consistency on dyslexia: A German-English comparison , 1997, Cognition.

[60]  Nick C. Ellis,et al.  MORPHOLOGY AND LONGER DISTANCE DEPENDENCIES , 1997, Studies in Second Language Acquisition.

[61]  D. Larsen-Freeman Chaos/Complexity Science and Second Language Acquisition , 1997 .

[62]  J. Pine,et al.  Slot and frame patterns and the development of the determiner category , 1997, Applied Psycholinguistics.

[63]  N. Spada Form-Focussed Instruction and Second Language Acquisition: A Review of Classroom and Laboratory Research , 1997, Language Teaching.

[64]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[65]  Mark S. Seidenberg,et al.  Language Acquisition and Use: Learning and Applying Probabilistic Constraints , 1997, Science.

[66]  Aydin Y Durgunoglu,et al.  Beginning to read in Turkish: A phonologically transparent orthography , 1997, Applied Psycholinguistics.

[67]  B. MacWhinney Second language acquisition and the competition model , 1997 .

[68]  J. Hulstijn,et al.  Testing SLA theory in the research labatory , 1997 .

[69]  E. Tarone Analyzing IL in natural settings: A sociolinguistic perspective on second-language acquisition , 1997 .

[70]  R N Aslin,et al.  Statistical Learning by 8-Month-Old Infants , 1996, Science.

[71]  Max Coltheart,et al.  Assessment of Lexical and Nonlexical Reading Abilities in Children: Some Normative Data , 1996 .

[72]  Nick C. Ellis,et al.  Analyzing Language Sequence in the Sequence of Language Acquisition: Some Comments on Major and Ioup , 1996, Studies in Second Language Acquisition.

[73]  S. Goldinger Words and voices: episodic traces in spoken word identification and recognition memory. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[74]  J. Trueswell THE ROLE OF LEXICAL FREQUENCY IN SYNTACTIC AMBIGUITY RESOLUTION , 1996 .

[75]  Daniel Jurafsky,et al.  A Probabilistic Model of Lexical and Syntactic Access and Disambiguation , 1996, Cogn. Sci..

[76]  Nick C. Ellis,et al.  Sequencing in SLA , 1996, Studies in Second Language Acquisition.

[77]  Douglas Biber Investigating language use through corpusbased analyses of association patterns , 1996 .

[78]  Friedrich Ungerer,et al.  An introduction to cognitive linguistics , 1999 .

[79]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[80]  Marc Brysbaert,et al.  Exposure-based models of human parsing: Evidence for the use of coarse-grained (nonlexical) statistical records , 1995 .

[81]  Koenraad Kuiper Smooth Talkers: The Linguistic Performance of Auctioneers and Sportscasters , 1995 .

[82]  Joan L. Bybee,et al.  Regular morphology and the lexicon. , 1995 .

[83]  W. Bruce Croft,et al.  Autonomy and Functionalist Linguistics , 1995 .

[84]  Wolfgang Klein,et al.  The acquisition of English , 1995 .

[85]  Michael Collins,et al.  Prepositional Phrase Attachment through a Backed-off Model , 1995, VLC@ACL.

[86]  J. Debernardi,et al.  Sociolinguistic Perspectives on Register , 1995 .

[87]  Julie C. Sedivy,et al.  Resolving attachment ambiguities with multiple constraints , 1995, Cognition.

[88]  Mark S. Seidenberg,et al.  The special role of rimes in the description, use, and acquisition of English orthography. , 1995, Journal of experimental psychology. General.

[89]  David Brazil,et al.  口语语法 = A grammar of speech , 1995 .

[90]  A. Goldberg Constructions: A Construction Grammar Approach to Argument Structure , 1995 .

[91]  Eric Kellerman,et al.  Crosslinguistic Influence: Transfer to Nowhere? , 1995, Annual Review of Applied Linguistics.

[92]  Chris Brew,et al.  Stochastic HPSG , 1995, EACL.

[93]  D. Shanks IMPLICIT LEARNING AND TACIT KNOWLEDGE - AN ESSAY ON THE COGNITIVE UNCONSCIOUS - REBER,A , 1995 .

[94]  W. Chafe Discourse, Consciousness, and Time: The Flow and Displacement of Conscious Experience in Speaking and Writing , 1996 .

[95]  Rod Ellis,et al.  The Study of Second Language Acquisition , 1994 .

[96]  M. Just,et al.  A capacity approach to syntactic comprehension disorders: making normal adults perform like aphasic patients , 1994 .

[97]  Mark S. Seidenberg,et al.  Beyond Rules and Exceptions: A Connectionist Approach to Inflectional Morphology , 1994 .

[98]  Maryellen C. MacDonald,et al.  The lexical nature of syntactic ambiguity resolution , 1994 .

[99]  Susan M. Garnsey,et al.  Semantic Influences On Parsing: Use of Thematic Role Information in Syntactic Ambiguity Resolution , 1994 .

[100]  Maryellen C. MacDonald,et al.  Probabilistic constraints and syntactic ambiguity resolution , 1994 .

[101]  X. LingCharles Learning the past tense of English verbs , 1994 .

[102]  Nick C. Ellis Implicit and explicit processes in language acquisition: An introduction. , 1994 .

[103]  Michael K. Tanenhaus,et al.  Semantic effects on syntactic ambiguity resolution: Evidence for a constraint-based resolution process. , 1994 .

[104]  Garrison W. Cottrell,et al.  Acquiring the Mapping from Meaning to Sounds , 1994, Connect. Sci..

[105]  M L Rice,et al.  Plural acquisition in children with specific language impairment. , 1993, Journal of speech and hearing research.

[106]  Paul W. B. Atkins,et al.  Models of reading aloud: Dual-route and parallel-distributed-processing approaches. , 1993 .

[107]  J. Pine,et al.  Reanalysing rote-learned phrases: individual differences in the transition to multi-word speech , 1993, Journal of Child Language.

[108]  N. Ellis Rules and instances in foreign language learning: Interactions of explicit and implicit knowledge , 1993 .

[109]  M. Nippold,et al.  Familiarity and transparency in idiom explanation: a developmental study of children and adolescents. , 1993, Journal of speech and hearing research.

[110]  V. Marchman,et al.  From rote learning to system building: acquiring verb morphology in children and connectionist nets , 1993, Cognition.

[111]  V. Marchman Constraints on Plasticity in a Connectionist Model of the English Past Tense , 1993, Journal of Cognitive Neuroscience.

[112]  Patricia J. Brooks,et al.  Acquisition of Gender-like Noun Subclasses in an Artificial Language: The Contribution of Phonological Markers to Learning , 1993 .

[113]  P. Jusczyk From general to language-specific capacities: the WRAPSA Model of how speech perception develops , 1993 .

[114]  Tim Curran,et al.  Attentional and Nonattentional Forms of Sequence Learning , 1993 .

[115]  J. Pine,et al.  Individual differences in early vocabulary development: redefining the referential-expressive distinction , 1992, Journal of Child Language.

[116]  Brian MacWhinney,et al.  Transfer and competition in second language learning , 1992 .

[117]  Richard Hudson,et al.  English word grammar , 1995 .

[118]  M. Tomasello First Verbs: A Case Study of Early Grammatical Development , 1994 .

[119]  V. Coltheart,et al.  Some Bodies are Easier to Read: The Effect of Consistency and Regularity on Children's Reading , 1991 .

[120]  B. MacWhinney,et al.  Implementations are not conceptualizations: Revising the verb learning model , 1991, Cognition.

[121]  Roger W. Andersen,et al.  Developmental sequences: the emergence of aspect marking in second language acquisition , 1991 .

[122]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[123]  Mats Rooth,et al.  Structural Ambiguity and Lexical Relations , 1991, ACL.

[124]  Michael Hoey,et al.  Patterns of Lexis In Text , 1991 .

[125]  Michael H. Long Focus on Form: A Design Feature in Language Teaching Methodology , 1991 .

[126]  T. D. Terrell The Role of Grammar Instruction in a Communicative Approach. , 1991 .

[127]  William D. Marslen-Wilson,et al.  Activation, competition, and frequency in lexical access , 1991 .

[128]  John Sinclair,et al.  Corpus, Concordance, Collocation , 1991 .

[129]  Mark S. Seidenberg,et al.  The basis of consistency effects in word naming , 1990 .

[130]  James L. McClelland,et al.  Learning and Applying Contextual Constraints in Sentence Comprehension , 1990, Artif. Intell..

[131]  S. Harnad Categorical Perception: The Groundwork of Cognition , 1990 .

[132]  R. Schmidt The role of consciousness in second language learning , 1990 .

[133]  K. Bock,et al.  Framing sentences , 1990, Cognition.

[134]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[135]  G. Lakoff Women, fire, and dangerous things : what categories reveal about the mind , 1988, Dialogue.

[136]  N. Ellis,et al.  The role of spelling in learning to read , 1990 .

[137]  Steven Pinker,et al.  Some evidence that irregular forms are retrieved from memory but regular forms are rule generated , 1990 .

[138]  Mark S. Seidenberg,et al.  Consistency effects in the generation of past tense morphology , 1990 .

[139]  R. Lado Toward a Lexico-Semantic Theory of Language and Language Learning. , 1990 .

[140]  R. Bornstein Exposure and affect: Overview and meta-analysis of research, 1968–1987. , 1989 .

[141]  James L. McClelland,et al.  Constituent Attachment and Thematic Role Assignment in Sentence Processing: Influences of Content-Based Expectations , 1988 .

[142]  Douglas L. Hintzman,et al.  Judgments of frequency and recognition memory in a multiple-trace memory model. , 1988 .

[143]  T. Bever,et al.  The relation between linguistic structure and associative theories of language learning—A constructive critique of some connectionist learning models , 1988, Cognition.

[144]  S. Pinker,et al.  On language and connectionism: Analysis of a parallel distributed processing model of language acquisition , 1988, Cognition.

[145]  Christopher Barry,et al.  Lexical Priming and Sound-to-Spelling Contingency Effects in Nonword Spelling , 1988 .

[146]  Elaine Tarone,et al.  Variation In Interlanguage , 1988 .

[147]  R Treiman,et al.  Short-term memory errors for spoken syllables are affected by the linguistic structure of the syllables. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[148]  G. Logan Toward an instance theory of automatization. , 1988 .

[149]  James L. McClelland,et al.  Conspiracy effects in word pronunciation. , 1987 .

[150]  Kenneth Ward Church,et al.  PRELIMINARY ANALYSIS OF A BREADTH-FIRST PARSING ALGORITHM: THEORETICAL AND EXPERIMENTAL RESULTS , 1987 .

[151]  Lyn Frazier,et al.  Sentence processing: A tutorial review. , 1987 .

[152]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[153]  Geoffrey Sampson,et al.  A Stochastic Approach to Parsing , 1986, COLING.

[154]  J. K. Bock Syntactic persistence in language production , 1986, Cognitive Psychology.

[155]  P. Luce,et al.  A computational analysis of uniqueness points in auditory word recognition , 1986, Perception & psychophysics.

[156]  B MacWhinney,et al.  Frequency and the lexical storage of regularly inflected forms , 1986, Memory & cognition.

[157]  Stephen Krashen,et al.  The Input Hypothesis: Issues and Implications , 1986 .

[158]  Karl J. Krahnke The Natural Approach: Language Acquisition in the Classroom , 1985 .

[159]  L Hasher,et al.  Automatic processing of fundamental information: the case of frequency of occurrence. , 1984, The American psychologist.

[160]  Mark S. Seidenberg,et al.  When does irregular spelling or pronunciation influence word recognition , 1984 .

[161]  D. Balota,et al.  Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. , 1984, Journal of experimental psychology. Human perception and performance.

[162]  A. Becker TOWARD A POST‐STRUCTURALIST VIEW OF LANGUAGE LEARNING: A SHORT ESSAY , 1984 .

[163]  L. Brooks,et al.  Nonanalytic Cognition: Memory, Perception, and Concept Learning , 1984 .

[164]  J. Michael Verbal behavior. , 1984, Journal of the experimental analysis of behavior.

[165]  Michael H. Long Does Second Language Instruction Make a Difference? A Review of Research , 1983 .

[166]  Kenneth Ward Church,et al.  Coping with Syntactic Ambiguity or How to Put the Block in the Box on the Table , 1982, CL.

[167]  John R. Anderson Acquisition of cognitive skill. , 1982 .

[168]  M. Smith Consciousness-Raising and the Second Language Learner1 , 1981 .

[169]  James R. Nattinger,et al.  A Lexical Phrase Grammar for ESL. , 1980 .

[170]  G. Sampson Schools of Linguistics , 1980 .

[171]  John R. Anderson Cognitive Psychology and Its Implications , 1980 .

[172]  R. Glushko The Organization and Activation of Orthographic Knowledge in Reading Aloud. , 1979 .

[173]  M. Coltheart Lexical access in simple reading tasks , 1978 .

[174]  A. Tversky Features of Similarity , 1977 .

[175]  Lynn Hasher,et al.  The Processing of Frequency Information: An Automatic Mechanism?. , 1977 .

[176]  Wayne D. Gray,et al.  Basic objects in natural categories , 1976, Cognitive Psychology.

[177]  D. Larsen-Freeman AN EXPLANATION FOR THE MORPHEME ACQUISITION ORDER OF SECOND LANGUAGE LEARNERS , 1976 .

[178]  M. Bowerman Semantic factors in the acquisition of rules for word use and sentence construction , 1976 .

[179]  E. Rosch Cognitive Representations of Semantic Categories. , 1975 .

[180]  William Labov,et al.  Empirical Foundations of Linguistic Theory , 1975 .

[181]  M. Posner,et al.  Attention and cognitive control. , 1975 .

[182]  K. Hakuta PREFABRICATED PATTERNS AND THE EMERGENCE OF STRUCTURE IN SECOND LANGUAGE ACQUISITION1 , 1974 .

[183]  K. Forster,et al.  Lexical Access and Naming Time. , 1973 .

[184]  Hans J. Eysenck,et al.  Contingencies of reinforcement: A theoretical analysis , 1970 .

[185]  M. Posner,et al.  Retention of Abstract Ideas. , 1970 .

[186]  Bernard J. Shapiro,et al.  The subjective estimation of relative word frequency , 1969 .

[187]  William Labov,et al.  A Study of Non-Standard English. , 1969 .

[188]  Zellig S. Harris,et al.  Mathematical structures of language , 1968, Interscience tracts in pure and applied mathematics.

[189]  J. Morton A Singular Lack of Incidental Learning , 1967, Nature.

[190]  R. Lado MEMORY SPAN AS A FACTOR IN SECOND LANGUAGE LEARNING , 1965 .

[191]  H. Savin Word‐Frequency Effect and Errors in the Perception of Speech , 1963 .

[192]  H. Simon,et al.  Models Of Man : Social And Rational , 1957 .

[193]  R. Lado,et al.  Linguistics Across Cultures: Applied Linguistics for Language Teachers , 1957 .

[194]  Zellig S. Harris,et al.  From Phoneme to Morpheme , 1955 .

[195]  F. Attneave Psychological probability as a function of experienced frequency. , 1953, Journal of experimental psychology.

[196]  Robert Lmo PATTERN PRACTICE-COMPLETELY ORAL , 1948 .