Two ways of learning associations

How people learn chunks or associations between adjacent items in sequences was modelled. Two previously successful models of how people learn artificial grammars were contrasted: the CCN, a network version of the competitive chunker of Servan-Schreiber and Anderson [J. Exp. Psychol.: Learn. Mem. Cogn. 16 (1990) 592], which produces local and compositionally-structured chunk representations acquired incrementally; and the simple recurrent network (SRN) of Elman [Cogn. Sci. 14 (1990) 179], which acquires distributed representations through error correction. The models' susceptibility to two types of interference was determined: prediction conflicts, in which a given letter can predict two other letters that appear next with an unequal frequency; and retroactive interference, in which the prediction made by a letter changes in the second half of training. The predictions of the models were determined by exploring parameter space and seeing how densely different regions of the space of possible experimental outcomes were populated by model outcomes. For both types of interference, human data fell squarely in regions characteristic of CCN performance but not characteristic of SRN performance.

[1]  William D. Marslen-Wilson,et al.  Integrating Form and Meaning: A Distributed Model of Speech Perception. , 1997 .

[2]  Thierry Meulemans,et al.  Associative chunk strength in artificial grammar learning , 1997 .

[3]  D. Berry.  How implicit is implicit learning , 1997 .

[4]  W. Estes,et al.  Toward a framework for combining connectionist and symbol-processing models☆ , 1988 .

[5]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[6]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[7]  David C. Plaut.  A Connectionist Approach to Word Reading and Acquired Dyslexia: Extension to Sequential Processing , 1999 .

[8]  A. Reber.  Implicit learning and tacit knowledge , 1993 .

[9]  John K. Kruschke,et al.  Human Category Learning: Implications for Backpropagation Models , 1993 .

[10]  J. Elman.  Learning and development in neural networks: the importance of starting small , 1993, Cognition.

[11]  Geoffrey K. Pullum,et al.  Generalized Phrase Structure Grammar , 1985 .

[12]  Josef Perner,et al.  Implicit knowledge in people and connectionist networks , 1996 .

[13]  Cheng Chan,et al.  Implicit cognitive processes : theoretical issues and applications in computer systems design , 1991 .

[14]  Mapping across Domains Without Feedback: A Neural Network Model of Transfer of Implicit Knowledge , 1999 .

[15]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[16]  M. Linden,et al.  Associative chunk strength in artificial grammar learning. , 1997 .

[17]  Zoltan Dienes,et al.  Mapping across domains without feedback: A neural network model of implicit learning , 1999 .

[18]  A. Vinter,et al.  The self-organizing consciousness. , 2002, The Behavioral and brain sciences.

[19]  D Broadbent,et al.  Implicit and explicit knowledge bases in artificial grammar learning. , 1991, Journal of experimental psychology. Learning, memory, and cognition.

[20]  Z. Dienes,et al.  Modality Independence of Implicitly Learned Grammatical Knowledge , 2004 .

[21]  J. Kruschke,et al.  ALCOVE: an exemplar-based connectionist model of category learning. , 1992, Psychological review.

[22]  David R. Shanks,et al.  Configural processes in human associative learning , 1998 .

[23]  G. Bower,et al.  From conditioning to category learning: an adaptive network model. , 1988, Journal of experimental psychology. General.

[24]  Zoltan Dienes,et al.  Connectionist and Memory-Array Models of Artificial Grammar Learning , 1992, Cogn. Sci..

[25]  Carol A. Seger,et al.  Two Forms of Sequential Implicit Learning , 1997, Consciousness and Cognition.

[26]  Z. Dienes,et al.  UNCONSCIOUS KNOWLEDGE OF ARTIFICIAL GRAMMARS IS APPLIED STRATEGICALLY , 1995 .

[27]  Axel Cleeremans,et al.  Implicit Learning and Consciousness: An Empirical , 2002 .

[28]  M. Gareth Gaskell,et al.  Ambiguity, competition, and blending in spoken word recognition , 1999, Cogn. Sci..

[29]  Roger C. Schank,et al.  Dynamic memory - a theory of reminding and learning in computers and people , 1983 .

[30]  L R Squire,et al.  The information acquired during artificial grammar learning. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[31]  Josef Perner,et al.  A theory of the implicit nature of implicit learning , 2002 .

[32]  I. J. Myung,et al.  Applying Occam’s razor in modeling cognition: A Bayesian approach , 1997 .

[33]  Peter M. Vishton,et al.  Rule learning by seven-month-old infants. , 1999, Science.

[34]  R. Horton.  Rules and representations , 1993, The Lancet.

[35]  John R. Anderson,et al.  Learning Artificial Grammars With Competitive Chunking , 1990 .

[36]  Richard Reviewer-Granger.  Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[37]  D R Shanks,et al.  Connectionism and the Learning of Probabilistic Concepts , 1990, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[38]  M. Page,et al.  Connectionist modelling in psychology: A localist manifesto , 2000, Behavioral and Brain Sciences.

[39]  Nick Chater,et al.  Connectionist natural language processing: the state of the art , 1999, Cogn. Sci..

[40]  G. Altmann.  Learning and development in neural networks – the importance of prior experience , 2002, Cognition.

[41]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[42]  Z. Dienes,et al.  On the modality independence of implicitly learned grammatical knowledge , 1995 .

[43]  Z. Dienes,et al.  Rule learning by seven-month-old infants and neural networks , 1999 .

[44]  Edward A. Wasserman,et al.  Response-outcome contingency: Behavioral and judgmental effects of appetitive and aversive outcomes with college students , 1985 .

[45]  Axel Cleeremans,et al.  The Unity of Consciousness: Binding, Integration, and Dissociation , 2003 .

[46]  Nick Chater,et al.  Toward a connectionist model of recursion in human linguistic performance , 1999, Cogn. Sci..

[47]  Elizabeth Bates,et al.  On the inseparability of grammar and the lexicon: Evidence from acquisition. , 1997 .

[48]  E. Newport,et al.  Computation of Conditional Probability Statistics by 8-Month-Old Infants , 1998 .

[49]  Josef Perner,et al.  The Metacognitive Implications of the Implicit-Explicit Distinction , 2002 .

[50]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[51]  Edmund T. Rolls,et al.  Introduction to Connectionist Modelling of Cognitive Processes , 1998 .

[52]  R. A. Carlson,et al.  A case of syntactical learning and judgment: How conscious and how abstract? , 1984 .

[53]  James L. McClelland,et al.  Graded state machines: the representation of temporal contingencies in feedback networks , 1995 .

[54]  N. Chater,et al.  Transfer in artificial grammar learning : A reevaluation , 1996 .

[55]  Yves Chauvin,et al.  Backpropagation: theory, architectures, and applications , 1995 .

[56]  Axel Cleeremans,et al.  Mechanisms of Implicit Learning: Connectionist Models of Sequence Processing , 1993 .

[57]  Robert F. Hadley.  Systematicity in Connectionist Language Learning , 1994 .

[58]  David R. Shanks,et al.  Amnesia and the Declarative/Nondeclarative Distinction: A Recurrent Network Model of Classification, Recognition, and Repetition Priming , 2001, Journal of Cognitive Neuroscience.

[59]  A. Reber.  The cognitive unconscious: An evolutionary perspective , 1992, Consciousness and Cognition.

[60]  A. Vinter,et al.  PARSER: A Model for Word Segmentation , 1998 .

[61]  M. McCloskey.  Networks and Theories: The Place of Connectionism in Cognitive Science , 1991 .

[62]  A. Reber.  Implicit learning of artificial grammars , 1967 .

[63]  James L. McClelland,et al.  Learning the structure of event sequences. , 1991, Journal of experimental psychology. General.

[64]  David R. Shanks,et al.  The Psychology of Associative Learning , 1995 .

[65]  D. Massaro.  Some criticisms of connectionist models of human performance , 1988 .

[66]  Pierre Perruchet,et al.  Synthetic grammar learning: Implicit rule abstraction or explicit fragmentary knowledge? Journal of , 1990 .

[67]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[68]  Michael R. Waldmann,et al.  Predictive and diagnostic learning within causal models: asymmetries in cue competition. , 1992, Journal of experimental psychology. General.

[69]  D. Medin,et al.  Problem structure and the use of base-rate information from experience. , 1988, Journal of experimental psychology. General.

[70]  C SchankRoger,et al.  Dynamic Memory: A Theory of Reminding and Learning in Computers and People , 1983 .

[71]  Gary James Jason,et al.  The Logic of Scientific Discovery , 1988 .

[72]  Pierre Perruchet,et al.  Synthetic Grammar Learning : Implicit Rule Abstraction or Explicit Fragmentary Knowledge ? Pierre Perruchet and Chantal Pacteau , 1990 .

[73]  Z Dienes,et al.  The Role of Implicit Memory in Controlling a Dynamic System , 1998, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[74]  A. Buchner.  Indirect effects of synthetic grammar learning in an identification task. , 1994 .

[75]  Carol A. Seger,et al.  Implicit learning. , 1994, Psychological bulletin.

[76]  Dean Allemang,et al.  Information processing abstractions: The message still counts more than the medium , 1988, Behavioral and Brain Sciences.

[77]  K. Holyoak,et al.  Implicit Learning and Generalization of the "Mere Exposure" Effect , 1983 .

[78]  Pierre-Jean Marescaux,et al.  Metacognition : process, function and use , 2002 .

[79]  D. Shanks,et al.  Characteristics of dissociable human learning systems , 1994, Behavioral and Brain Sciences.

[80]  Axel Cleeremans,et al.  Implicit learning: news from the front , 1998, Trends in Cognitive Sciences.

[81]  Robert F. Hadley.  Systematicity revisited : reply to Christiansen and Chater and Niklasson and van Gelder , 1994 .

[82]  M. Kendall,et al.  The Logic of Scientific Discovery. , 1959 .

[83]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[84]  Josef Perner,et al.  Unifying consciousness with explicit knowledge , 2003 .

[85]  Alan Richardson-Klavehn,et al.  Implicit learning: Theoretical and empirical issues , 1995 .

[86]  David C. Plaut,et al.  A connectionist approach to word reading and acquired dyslexia: extension to sequential processing , 1999, Cogn. Sci..

[87]  L. Squire,et al.  Artificial grammar learning depends on implicit acquisition of both abstract and exemplar-specific information. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[88]  Z. Dienes,et al.  A theory of implicit and explicit knowledge , 1999, Behavioral and Brain Sciences.

[89]  R. Nosofsky,et al.  Rule-plus-exception model of classification learning. , 1994, Psychological review.

[90]  J. Kruschke,et al.  A model of probabilistic category learning. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[91]  David Mackay,et al.  Probable networks and plausible predictions - a review of practical Bayesian methods for supervised neural networks , 1995 .

[92]  Regina Bernhaupt,et al.  Application of implicit knowledge: deterministic or probabilistic? , 1997 .

[93]  G. Miller,et al.  Cognitive science. , 1981, Science.

[94]  Morten H. Christiansen,et al.  Generalization and connectionist language learning , 1994 .

[95]  R. Gómez,et al.  Transfer and Complexity in Artificial Grammar Learning , 1997, Cognitive Psychology.

[96]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[97]  Dianne C. Berry,et al.  Implicit Learning , 1993 .

[98]  David R. Shanks,et al.  Associative versus contingency accounts of category learning: Reply to Melz, Cheng, Holyoak, and Waldmann (1993). , 1993 .

[99]  D. Shanks,et al.  Two mechanisms in implicit artificial grammar learning? Comment on Meulemans and Van der Linden (1997). , 1999 .

[100]  Carol A. Seger,et al.  Independent Judgment-Linked and Motor-Linked Forms of Artificial Grammar Learning , 1998, Consciousness and Cognition.

[101]  Patricia W. Cheng,et al.  Cue Competition in Human Categorization: Contingency or the Rescorla-Wagner Learning Rule? Comment on Shanks (1991) , 1993 .

[102]  N. Ellis,et al.  Implicit and explicit learning of languages , 1997 .