A Role for Chunk Formation in Statistical Learning of Second Language Syntax.

Humans are remarkably sensitive to the statistical structure of language. However, different mechanisms have been proposed to account for such statistical sensitivities. The present study compared adult learning of syntax and the ability of two models of statistical learning to simulate human performance: Simple Recurrent Networks, which learn by predictive computation, and PARSER, which learns chunks as a byproduct of general principles of associative learning and memory. In the first stage, a semiartificial language paradigm was used to gather human data. In the second stage, a simulation paradigm was then used to compare the patterns of performance of the SRN and PARSER. After the human adults and the computational models were trained on sentences from the semiartificial language with probabilistic syntax, their learning outcomes were compared. Neither model was able to fully reproduce the human data, which may indicate less robust statistical learning effects in adults; however, PARSER was able to simulate more of the adult learning data than the SRN, suggesting a possible role for chunk formation in early phases of adult learning of second language syntax.

[1]  Z. Dienes,et al.  Measuring Learning using an Untrained Control Group: Comment on R. Reber and Perruchet , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[2]  Nicole Ziegler,et al.  Implicit and explicit knowledge of form-meaning connections:evidence from subjective measures of awareness , 2013 .

[3]  Pierre Perruchet,et al.  Statistical approaches to language acquisition and the self-organizing consciousness: a reversal of perspective , 2005, Psychological research.

[4]  Arnaud Rey,et al.  Lexical and Sublexical Units in Speech Perception , 2009, Cogn. Sci..

[5]  Pierre Perruchet,et al.  A subjective unit formation account of implicit learning , 1997 .

[6]  Patrick Rebuschat,et al.  IMPLICIT LEARNING IN SECOND LANGUAGE ACQUISITION , 2012 .

[7]  Joseph H. Greenberg,et al.  Some Universals of Grammar with Particular Reference to the Order of Meaningful Elements , 1990, On Language.

[8]  Alexa R. Romberg,et al.  Statistical learning and language acquisition. , 2010, Wiley interdisciplinary reviews. Cognitive science.

[9]  E. Newport,et al.  Computation of Conditional Probability Statistics by 8-Month-Old Infants , 1998 .

[10]  G. Altmann Why emergentist accounts of cognition are more theoretically constraining than structured probability accounts: comment on Griffiths et al. and McClelland et al. , 2010, Trends in Cognitive Sciences.

[11]  Jelena Mirkovic,et al.  Incrementality and Prediction in Human Sentence Processing , 2009, Cogn. Sci..

[12]  G. Dell,et al.  Becoming syntactic. , 2006, Psychological review.

[13]  J. Saffran Statistical Language Learning , 2003 .

[14]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[15]  Barbara Tillmann,et al.  Exploiting Multiple Sources of Information in Learning an Artificial Language: Human Data and Modeling , 2009 .

[16]  N. Ellis Cognitive Perspectives on SLA: The Associative-Cognitive CREED , 2006 .

[17]  Simon J. Greenhill,et al.  Evolved structure of language shows lineage-specific trends in word-order universals , 2011, Nature.

[18]  Nick C. Ellis,et al.  USAGE-BASED AND FORM-FOCUSED LANGUAGE ACQUISITION: The associative learning of constructions, learned attention, and the limited L2 endstate , 2008 .

[19]  Gert Westermann,et al.  OXlearn: A new MATLAB-based simulation tool for connectionist models , 2009, Behavior research methods.

[20]  Phillip Hamrick Recognition memory for novel syntactic structures. , 2014, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[21]  David R. Shanks,et al.  The Psychology of Associative Learning , 1995 .

[22]  A. Reber,et al.  Implicit learning: An analysis of the form and structure of a body of tacit knowledge , 1977, Cognition.

[23]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[24]  Richard N Aslin,et al.  Bayesian learning of visual chunks by human observers , 2008, Proceedings of the National Academy of Sciences.

[25]  M. Ullman Contributions of memory circuits to language: the declarative/procedural model , 2004, Cognition.

[26]  M. Goldsmith,et al.  Statistical Learning by 8-Month-Old Infants , 1996 .

[27]  Nick C. Ellis,et al.  Sequencing in SLA , 1996, Studies in Second Language Acquisition.

[28]  John N. Williams Initial Incidental Acquisition of Word Order Regularities: Is It Just Sequence Learning? , 2010 .

[29]  J. Tenenbaum,et al.  Probabilistic models of cognition: exploring representations and inductive biases , 2010, Trends in Cognitive Sciences.

[30]  Pierre Perruchet,et al.  The exploitation of distributional information in syllable processing , 2004, Journal of Neurolinguistics.

[31]  Phillip Hamrick Development of conscious knowledge during early incidental learning of L2 syntax , 2013 .

[32]  John R. Anderson,et al.  Learning Artificial Grammars With Competitive Chunking , 1990 .

[33]  Chieko Kuribara,et al.  Comparing a nativist and emergentist approach to the initial stage of SLA: An investigation of Japanese scrambling , 2008 .

[34]  Morten H. Christiansen,et al.  Sequential Expectations: The Role of Prediction-Based Learning in Language , 2010, Top. Cogn. Sci..

[35]  Nick C. Ellis,et al.  MORPHOLOGY AND LONGER DISTANCE DEPENDENCIES , 1997, Studies in Second Language Acquisition.

[36]  Pierre Perruchet,et al.  Synthetic grammar learning: Implicit rule abstraction or explicit fragmentary knowledge? Journal of , 1990 .

[37]  P. Robinson COGNITIVE ABILITIES, CHUNK-STRENGTH, AND FREQUENCY EFFECTS IN IMPLICIT ARTIFICIAL GRAMMAR AND INCIDENTAL L2 LEARNING: REPLICATIONS OF REBER, WALKENFELD, AND HERNSTADT (1991) AND KNOWLTON AND SQUIRE (1996) AND THEIR RELEVANCE FOR SLA , 2005, Studies in Second Language Acquisition.

[38]  Nick Chater,et al.  Finite models of infinite language: A connectionist approach to recursion , 2001 .

[39]  R. Schmidt The role of consciousness in second language learning , 1990 .

[40]  Peter W. Culicover,et al.  The simpler syntax hypothesis , 2006, Trends in Cognitive Sciences.

[41]  A. Gopnik,et al.  A computational foundation for cognitive development: comment on Griffths et al. and McLelland et al. , 2010, Trends in Cognitive Sciences.

[42]  A. Vinter,et al.  The self-organizing consciousness. , 2002, The Behavioral and brain sciences.

[43]  N. Chater,et al.  Transfer in artificial grammar learning : A reevaluation , 1996 .

[44]  Nick C. Ellis,et al.  Constructions, Chunking, and Connectionism: The Emergence of Second Language Structure , 2008 .

[45]  Zoltan Dienes,et al.  Two ways of learning associations , 2003, Cogn. Sci..

[46]  J. Saffran The Use of Predictive Dependencies in Language Learning , 2001 .

[47]  P. Robinson Learning Simple and Complex Second Language Rules Under Implicit, Incidental, Rule-Search, and Instructed Conditions , 1996, Studies in Second Language Acquisition.

[48]  P. Hagoort On Broca, brain, and binding: a new framework , 2005, Trends in Cognitive Sciences.

[49]  R. Reber,et al.  The use of Control Groups in Artificial Grammar Learning , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[50]  A. Goldberg Constructions at Work: The Nature of Generalization in Language , 2006 .

[51]  R. Gómez,et al.  Artificial grammar learning by 1-year-olds leads to specific and abstract knowledge , 1999, Cognition.

[52]  Linda B. Smith,et al.  Rapid Word Learning Under Uncertainty via Cross-Situational Statistics , 2007, Psychological science.

[53]  A. Vinter,et al.  PARSER: A Model for Word Segmentation , 1998 .

[54]  Nuria Sagarra,et al.  THE BOUNDS OF ADULT LANGUAGE ACQUISITION , 2010, Studies in Second Language Acquisition.

[55]  L. Squire,et al.  Artificial grammar learning depends on implicit acquisition of both abstract and exemplar-specific information. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[56]  P. Robinson GENERALIZABILITY AND AUTOMATICITY OF SECOND LANGUAGE LEARNING UNDER IMPLICIT, INCIDENTAL, ENHANCED, AND INSTRUCTED CONDITIONS , 1997, Studies in Second Language Acquisition.

[57]  Ivan A. Sag,et al.  Book Reviews: Head-driven Phrase Structure Grammar and German in Head-driven Phrase-structure Grammar , 1996, CL.

[58]  Elissa L. Newport,et al.  Statistical Learning of Syntax: The Role of Transitional Probability , 2007 .