Computational Models of Implicit Learning

Implicit learning – broadly construed as learning without awareness – is a complex, multifaceted phenomenon that defies easy definition. Frensch (1998) listed as many as eleven definitions in an overview, a diversity that is undoubtedly symptomatic of the conceptual and methodological challenges that continue to pervade the field forty years after the term first appeared in the literature (Reber, 1967). According to Berry and Dienes (1993), learning is implicit when an individual acquires new information without intending to do so and in such a way that the resulting knowledge is difficult to express. In this, implicit learning thus contrasts strongly with explicit learning (e.g., as when learning how to solve a problem or learning a concept), which is typically hypothesisdriven and fully conscious. Implicit learning is the process through which one becomes sensitive to certain regularities in the environment: (1) without trying to learn regularities, (2) without knowing that one is learning regularities, and (3) in such a way that the resulting knowledge is unconscious. Over the last twenty years, the field of implicit learning has come to embody ongoing questioning about three fundamental issues in the cognitive sciences: (1) consciousness (how one should conceptualize and measure the relationships between conscious and unconscious cognition); (2) mental representation (in particular, the complex issue of abstraction); and (3) modularity and the architecture of the cognitive system (whether one should think of implicit and explicit learning as being subtended by separable systems of the brain or not). Computational modeling plays a central role in addressing these issues.

[1]  Axel Cleeremans,et al.  Implicit learning: news from the front , 1998, Trends in Cognitive Sciences.

[2]  R. O’Reilly,et al.  Computational Explorations in Cognitive Neuroscience: Understanding the Mind by Simulating the Brain , 2000 .

[3]  A. Reber Transfer of syntactic structure in synthetic languages. , 1969 .

[4]  S Pinker,et al.  Out of the Minds of Babes , 1999, Science.

[5]  Zoltan Dienes,et al.  Two ways of learning associations , 2003, Cogn. Sci..

[6]  L. Jacoby A process dissociation framework: Separating automatic from intentional uses of memory , 1991 .

[7]  D. Broadbent,et al.  On the Relationship between Task Performance and Associated Verbalizable Knowledge , 1984 .

[8]  Douglas L. Hintzman,et al.  "Schema Abstraction" in a Multiple-Trace Memory Model , 1986 .

[9]  Richard B. Millward,et al.  Event-recall in probability learning , 1968 .

[10]  James L. McClelland,et al.  Graded state machines: The representation of temporal contingencies in simple recurrent networks , 1991, Machine Learning.

[11]  D R Shanks,et al.  Evaluating the relationship between explicit and implicit knowledge in a sequential reaction time task. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[12]  D. Broadbent,et al.  Interactive tasks and the implicit‐explicit distinction , 1988 .

[13]  Axel Cleeremans,et al.  Processing abstract sequence structure: learning without knowing, or knowing without learning? , 2005, Psychological research.

[14]  A. Reber,et al.  Implicit learning: An analysis of the form and structure of a body of tacit knowledge , 1977, Cognition.

[15]  L. Jiménez Attention and implicit learning , 2003 .

[16]  Tim Curran,et al.  Attentional and Nonattentional Forms of Sequence Learning , 1993 .

[17]  D. Plaut Double dissociation without modularity: evidence from connectionist neuropsychology. , 1995, Journal of clinical and experimental neuropsychology.

[18]  J. Perner Understanding the Representational Mind , 1993 .

[19]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[20]  Dianne C. Berry,et al.  Implicit Learning , 1993 .

[21]  Donald W. Mathis,et al.  Conscious and unconscious perception: A computational theory , 1996 .

[22]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[23]  Terrence J. Sejnowski,et al.  Parallel Networks that Learn to Pronounce English Text , 1987, Complex Syst..

[24]  Gerry Altmann,et al.  Mapping across Domains Without Feedback: A Neural Network Model of Transfer of Implicit Knowledge , 1999, Cogn. Sci..

[25]  D. Plaut,et al.  Learning in Dynamic Decision Tasks: Computational Model and Empirical Evidence , 1997 .

[26]  James L. McClelland,et al.  Finite State Automata and Simple Recurrent Networks , 1989, Neural Computation.

[27]  N. Chater,et al.  Transfer in artificial grammar learning : A reevaluation , 1996 .

[28]  Axel Cleeremans,et al.  Mechanisms of Implicit Learning: Connectionist Models of Sequence Processing , 1993 .

[29]  Z. Dienes,et al.  Implicit learning of nonlocal musical rules: implicitly learning more than chunks. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[30]  John R. Anderson,et al.  Learning Artificial Grammars With Competitive Chunking , 1990 .

[31]  A. Karmiloff-Smith,et al.  The cognizer's innards: A psychological and philosophical perspective on the development of thought. , 1993 .

[32]  Peter Ford Dominey,et al.  Influences of temporal organization on sequence learning and transfer : Comments on Stadler (1995) and Curran and Keele (1993) , 1998 .

[33]  Pawel Lewicki,et al.  Processing Information About Covariations That Cannot Be Articulated , 1986 .

[34]  D. Shanks,et al.  Does opposition logic provide evidence for conscious and unconscious processes in artificial grammar learning? , 2003, Consciousness and Cognition.

[35]  J. van Leeuwen,et al.  Sequence Learning , 2001, Lecture Notes in Computer Science.

[36]  D. Rosenthal Consciousness and mind , 2005 .

[37]  A. Reber Implicit learning of synthetic languages: The role of instructional set. , 1976 .

[38]  Axel Cleeremans,et al.  Implicit learning out of the lab: the case of orthographic regularities. , 2001, Journal of experimental psychology. General.

[39]  P. Hanson Information, language, and cognition , 1993 .

[40]  Peter A. Frensch,et al.  One concept, multiple meanings: On how to define the concept of implicit learning. , 1998 .

[41]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[42]  Michael McCloskey,et al.  Catastrophic Interference in Connectionist Networks: The Sequential Learning Problem , 1989 .

[43]  A. Reber Implicit learning and tacit knowledge , 1993 .

[44]  Axel Cleeremans,et al.  Comparing direct and indirect measures of sequence learning , 1996 .

[45]  A. Newell Unified Theories of Cognition , 1990 .

[46]  R. Mathews,et al.  Role of Implicit and Explicit Processes in Learning From Examples: A Synergistic Effect , 1989 .

[47]  E. Newport,et al.  Computation of Conditional Probability Statistics by 8-Month-Old Infants , 1998 .

[48]  R. A. Carlson,et al.  A case of syntactical learning and judgment: How conscious and how abstract? , 1984 .

[49]  P. Lewicki,et al.  Nonconscious acquisition of information. , 1992, The American psychologist.

[50]  Christian Lebiere,et al.  Implicit and explicit learning in ACT-R , 1998 .

[51]  B. Baars A cognitive theory of consciousness , 1988 .

[52]  C. L. Hull Quantitative aspects of evolution of concepts: An experimental study. , 1920 .

[53]  R. Dekeyser Implicit and Explicit Learning , 2008 .

[54]  Pierre Perruchet,et al.  A subjective unit formation account of implicit learning , 1997 .

[55]  David R. Shanks,et al.  Amnesia and the Declarative/Nondeclarative Distinction: A Recurrent Network Model of Classification, Recognition, and Repetition Priming , 2001, Journal of Cognitive Neuroscience.

[56]  G. Marcus The Algebraic Mind: Integrating Connectionism and Cognitive Science , 2001 .

[57]  H. Hoffman,et al.  Unconscious acquisition of complex procedural knowledge. , 1987 .

[58]  Ron Sun,et al.  Effects of model-based and memory-based processing on speed and accuracy of grammar string generation. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[59]  Michael A. Stadler,et al.  Handbook of implicit learning , 1998 .

[60]  G. Edelman,et al.  Consciousness and Complexity , 1998 .

[61]  David Kirsh,et al.  When is Information Explicitly Represented , 1990 .

[62]  Seth J. Ramus,et al.  Intact Artificial Grammar Learning in Amnesia: Dissociation of Classification Learning and Explicit Memory for Specific Instances , 1992 .

[63]  Nick Chater,et al.  Knowledge Representation and Transfer in Artificial Grammar Learning , 2002 .

[64]  Zoltan Dienes,et al.  Connectionist and Memory-Array Models of Artificial Grammar Learning , 1992, Cogn. Sci..

[65]  P. Perruchet,et al.  Implicit learning and statistical learning: one phenomenon, two approaches , 2006, Trends in Cognitive Sciences.

[66]  K. Kirsner,et al.  Discovering functionally independent mental processes: the principle of reversed association. , 1988, Psychological review.

[67]  A. Vinter,et al.  PARSER: A Model for Word Segmentation , 1998 .

[68]  Philip A. Higham,et al.  Opposition logic and neural network models in artificial grammar learning , 2004, Consciousness and Cognition.

[69]  Timothy D. Wilson,et al.  Telling more than we can know: Verbal reports on mental processes. , 1977 .

[70]  James L. McClelland,et al.  Learning the structure of event sequences. , 1991, Journal of experimental psychology. General.

[71]  Z. Dienes,et al.  The role of specific instances in controlling a dynamic system , 1995 .

[72]  J. Changeux,et al.  A neuronal network model linking subjective reports and objective physiological data during conscious perception , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[73]  Michael I. Jordan,et al.  Task Decomposition through Competition in A , 1990 .

[74]  John R. Anderson,et al.  Rules of the Mind , 1993 .

[75]  P. Smolensky On the proper treatment of connectionism , 1988, Behavioral and Brain Sciences.

[76]  Pierre Perruchet,et al.  The exploitation of distributional information in syllable processing , 2004, Journal of Neurolinguistics.

[77]  D. Shanks,et al.  Characteristics of dissociable human learning systems , 1994, Behavioral and Brain Sciences.

[78]  Ron Sun,et al.  Duality of the Mind , 2002 .

[79]  W. Estes Toward a Statistical Theory of Learning. , 1994 .

[80]  N. Block On a confusion about a function of consciousness , 1995, Behavioral and Brain Sciences.

[81]  G. Tononi Consciousness, information integration, and the brain. , 2005, Progress in brain research.

[82]  R. Sun,et al.  The interaction of the explicit and the implicit in skill learning: a dual-process approach. , 2005, Psychological review.

[83]  Arnaud Destrebecqz,et al.  The effect of explicit knowledge on sequence learning: A graded account , 2004 .

[84]  D. Schacter Implicit memory: History and current status. , 1987 .

[85]  Douglas L. Medin,et al.  Context theory of classification learning. , 1978 .

[86]  Ron Sun,et al.  Learning, action and consciousness: a hybrid approach toward modelling consciousness , 1997, Neural Networks.

[87]  Luis Jiménez,et al.  Temporal effects in sequence learning , 2003 .

[88]  M. Chun,et al.  Top-Down Attentional Guidance Based on Implicit Learning of Visual Covariation , 1999 .

[89]  A. Reber Implicit learning of artificial grammars , 1967 .

[90]  Z. Dienes,et al.  Learning non-local dependencies , 2008, Cognition.

[91]  Axel Cleeremans Computational correlates of consciousness. , 2005, Progress in brain research.

[92]  Axel Cleeremans,et al.  Can sequence learning be implicit? New evidence with the process dissociation procedure , 2001, Psychonomic bulletin & review.

[93]  Pierre Perruchet,et al.  Synthetic grammar learning: Implicit rule abstraction or explicit fragmentary knowledge? Journal of , 1990 .