Dual learning processes in interactive skill acquisition.

Acquisition of interactive skills involves the use of internal and external cues. Experiment 1 showed that when actions were interdependent, learning was effective with and without external cues in the single-task condition but was effective only with the presence of external cues in the dual-task condition. In the dual-task condition, actions closer to the feedback were learned faster than actions farther away but this difference was reversed in the single-task condition. Experiment 2 tested how knowledge acquired in single and dual-task conditions would transfer to a new reward structure. Results confirmed the two forms of learning mediated by the secondary task: A declarative memory encoding process that simultaneously assigned credits to actions and a reinforcement-learning process that slowly propagated credits backward from the feedback. The results showed that both forms of learning were engaged during training, but only at the response selection stage, one form of knowledge may dominate over the other depending on the availability of attentional resources.

[1]  John R. Anderson,et al.  Solving the credit assignment problem: explicit and implicit learning of action sequences with probabilistic outcomes , 2008, Psychological research.

[2]  Hau-San Wong,et al.  Human Computer Interaction , 2008, Encyclopedia of Multimedia.

[3]  Wai-Tat Fu,et al.  SNIF-ACT: A Cognitive Model of User Navigation on the World Wide Web , 2007, Hum. Comput. Interact..

[4]  Russell A Poldrack,et al.  Modulation of competing memory systems by distraction. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[5]  Wayne D. Gray,et al.  The soft constraints hypothesis: a rational analysis approach to resource allocation for interactive behavior. , 2006, Psychological review.

[6]  Wayne D. Gray,et al.  Suboptimal tradeoffs in information seeking , 2006, Cognitive Psychology.

[7]  John R. Anderson,et al.  From recurrent choice to skill learning: a reinforcement-learning model. , 2006, Journal of experimental psychology. General.

[8]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[9]  Charles R. Gallistel,et al.  Deconstructing the law of effect , 2005, Games Econ. Behav..

[10]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[11]  Wai-Tat Fu,et al.  Resolving the paradox of the active user: stable suboptimal performance in interactive tasks , 2004, Cogn. Sci..

[12]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[13]  Wai-Tat Fu,et al.  Soft constraints in interactive behavior: the case of ignoring perfect knowledge in-the-world for imperfect knowledge in-the-head , 2004, Cogn. Sci..

[14]  Richard I. Ivry,et al.  Attention and Structure in Sequence Learning , 2004 .

[15]  S. Keele,et al.  The cognitive and neural architecture of sequence representation. , 2003, Psychological review.

[16]  J. Gabrieli,et al.  Direct comparison of neural systems mediating conscious and unconscious skill learning. , 2002, Journal of neurophysiology.

[17]  Corey J Bohil,et al.  Observational versus feedback training in rule-based and information-integration category learning , 2002, Memory & cognition.

[18]  W. Estes,et al.  Traps in the route to models of memory and decision , 2002, Psychonomic bulletin & review.

[19]  B. Knowlton,et al.  Learning and memory functions of the Basal Ganglia. , 2002, Annual review of neuroscience.

[20]  M. Gluck,et al.  Interactive memory systems in the human brain , 2001, Nature.

[21]  F. Ashby,et al.  The effects of concurrent task interference on category learning: Evidence for multiple category learning systems , 2001, Psychonomic bulletin & review.

[22]  Nir Vulkan.  An Economist's Perspective on Probability Matching , 2000 .

[23]  Thomas Schiex,et al.  Soft Constraints , 2000, WLP.

[24]  Wai-Tat Fu,et al.  Memory versus Perceptual-Motor Tradeoffs in a Blocks World Task , 2000 .

[25]  Patricia M. Berretty,et al.  On the dominance of unidimensional rules in unsupervised categorization , 1999, Perception & psychophysics.

[26]  Gregory Ashby,et al.  A neuropsychological theory of multiple systems in category learning. , 1998, Psychological review.

[27]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[28]  Rajesh P. N. Rao,et al.  Embodiment is the foundation, not a level , 1996, Behavioral and Brain Sciences.

[29]  Jennifer A. Mangels,et al.  A Neostriatal Habit Learning System in Humans , 1996, Science.

[30]  A. Graybiel.  Building action repertoires: memory and learning functions of the basal ganglia , 1995, Current Opinion in Neurobiology.

[31]  Scott T. Grafton,et al.  Functional Mapping of Sequence Learning in Normal Humans , 1995, Journal of Cognitive Neuroscience.

[32]  M. Gluck,et al.  Probabilistic classification learning in amnesia. , 1994, Learning & memory.

[33]  T. Leahey,et al.  Learning and cognition , 1993 .

[34]  Tim Curran,et al.  Attentional and Nonattentional Forms of Sequence Learning , 1993 .

[35]  Stellan Ohlsson,et al.  The Interaction Between Knowledge and Practice in the Acquisition of Cognitive Skills , 1993 .

[36]  L. Squire.  Memory and the hippocampus: a synthesis from findings with rats, monkeys, and humans. , 1992, Psychological review.

[37]  R. Herrnstein,et al.  Melioration: A Theory of Distributed Choice , 1991 .

[38]  L. Brooks,et al.  Specializing the operation of an explicit rule , 1991 .

[39]  Daniel B. Willingham,et al.  On the development of procedural knowledge. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[40]  Kenneth Kotovsky,et al.  Complex Information Processing: The Impact of Herbert A. Simon , 1989 .

[41]  J. H. Larkin,et al.  Display-based problem solving , 1989 .

[42]  John Sweller,et al.  Cognitive Load During Problem Solving: Effects on Learning , 1988, Cogn. Sci..

[43]  Colin Potts,et al.  Design of Everyday Things , 1988 .

[44]  Gregory Ashby,et al.  Decision rules in the perception and categorization of multidimensional stimuli. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[45]  G. Logan.  Toward an instance theory of automatization. , 1988 .

[46]  M. Nissen,et al.  Attentional requirements of learning: Evidence from performance measures , 1987, Cognitive Psychology.

[47]  Herbert A. Simon,et al.  Why a Diagram is (Sometimes) Worth Ten Thousand Words , 1987, Cogn. Sci..

[48]  Stephen W. Draper,et al.  Display Managers as the Basis for User-Machine Communication , 1986 .

[49]  Donald A. Norman,et al.  User Centered System Design , 1986 .

[50]  Allen Newell,et al.  The psychology of human-computer interaction , 1983 .

[51]  Allen and Rosenbloom Paul S. Newell,et al.  Mechanisms of Skill Acquisition and the Law of Practice , 1993 .

[52]  John R. Anderson.  Acquisition of cognitive skill. , 1982 .

[53]  W Vaughan,et al.  Melioration, matching, and maximization. , 1981, Journal of the experimental analysis of behavior.

[54]  W. F. Prokasy,et al.  Classical conditioning II: Current research and theory. , 1972 .

[55]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[56]  J. Yellott.  Probability learning with noncontingent success , 1969 .

[57]  R. Atkinson.  Studies in mathematical psychology , 1964 .

[58]  A. W. Melton.  Categories of Human Learning , 1964 .

[59]  M E Bitterman,et al.  Probability Learning. , 1962, Science.