Learning latent structure: carving nature at its joints

[1]  Jonathan D. Cohen,et al.  Prefrontal cortex and flexible cognitive control: rules without symbols. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[2]  D. Blei,et al.  Context, learning, and extinction. , 2010, Psychological review.

[3]  Peter Dayan,et al.  A Neural Substrate of Prediction and Reward , 1997, Science.

[4]  Joel L. Davis,et al.  A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement , 1994 .

[5]  R. Rescorla.  Spontaneous recovery. , 2004, Learning & memory.

[6]  Aaron C. Courville,et al.  The pigeon as particle filter , 2007, NIPS 2007.

[7]  Leslie Pack Kaelbling,et al.  Learning Policies with External Memory , 1999, ICML.

[8]  R. Bolles,et al.  Contextual control of the extinction of conditioned fear , 1979 .

[9]  Paul R. Schrater,et al.  Structure Learning in Human Sequential Decision-Making , 2008, NIPS.

[10]  Ronald J. Williams,et al.  Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning , 2004, Machine Learning.

[11]  Michael D. Lee,et al.  Modeling Human Performance in Restless Bandits with Particle Filters , 2009, J. Probl. Solving.

[12]  M. Egan,et al.  Set-Shifting Ability and Schizophrenia: A Marker of Clinical Illness or an Intermediate Phenotype? , 2008, Biological Psychiatry.

[13]  M. Pessiglione,et al.  Brain Hemispheres Selectively Track the Expected Value of Contralateral Options , 2009, The Journal of Neuroscience.

[14]  T. Robbins,et al.  Contrasting mechanisms of impaired attentional set-shifting in patients with frontal lobe damage or Parkinson's disease. , 1993, Brain : a journal of neurology.

[15]  Jadin C. Jackson,et al.  Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling. , 2007, Psychological review.

[16]  K. Urushihara,et al.  Renewal of Extinguished Lever-Press Responses upon Return to the Training Context , 2000 .

[17]  Jonathan D. Cohen,et al.  Learning to Use Working Memory in Partially Observable Environments through Dopaminergic Reinforcement , 2008, NIPS.

[18]  Michael J. Frank,et al.  Making Working Memory Work: A Computational Model of Learning in the Prefrontal Cortex and Basal Ganglia , 2006, Neural Computation.

[19]  Samuel B. Hutton,et al.  Discrimination Learning, Reversal, and Set-Shifting in First-Episode Schizophrenia: Stability Over Six Years and Specific Associations with Medication Type and Disorganization Syndrome , 2009, Biological Psychiatry.

[20]  P. Dayan,et al.  Uncertainty-based competition between prefrontal and dorsolateral striatal systems for behavioral control , 2005, Nature Neuroscience.

[21]  B. Milner.  Effects of Different Brain Lesions on Card Sorting: The Role of the Frontal Lobes , 1963 .

[22]  George A. Alvarez,et al.  Explaining human multiple object tracking as resource-constrained approximate inference in a dynamic probabilistic model , 2009, NIPS.

[23]  P. Schrimpf,et al.  Dynamic Programming , 2011 .

[24]  R. Rescorla,et al.  Reinstatement of fear to an extinguished conditioned stimulus. , 1975, Journal of experimental psychology. Animal behavior processes.

[25]  Sandra Jazbec,et al.  Intra-dimensional/extra-dimensional set-shifting performance in schizophrenia: Impact of distractors , 2007, Schizophrenia Research.

[26]  David S. Touretzky,et al.  Model Uncertainty in Classical Conditioning , 2003, NIPS.

[27]  Timothy E. J. Behrens,et al.  Learning the value of information in an uncertain world , 2007, Nature Neuroscience.

[28]  Jonathan D. Cohen,et al.  Cognition and control in schizophrenia: a computational model of dopamine and prefrontal function , 1999, Biological Psychiatry.

[29]  N. Daw,et al.  Human Reinforcement Learning Subdivides Structured Action Spaces by Learning Effector-Specific Values , 2009, The Journal of Neuroscience.

[30]  David S. Touretzky,et al.  Similarity and Discrimination in Classical Conditioning: A Latent Variable Account , 2004, NIPS.

[31]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[32]  Ernst Mach,et al.  The Analysis of Sensations. , 1916 .

[33]  R. Richardson,et al.  Extinction in the developing rat: an examination of renewal effects. , 2007, Developmental psychobiology.

[34]  R. Rescorla,et al.  A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement , 1972 .

[35]  R. Bolles,et al.  Role of conditioned contextual stimuli in reinstatement of extinguished fear. , 1979, Journal of experimental psychology. Animal behavior processes.

[36]  Daniel A. Braun,et al.  Motor Task Variation Induces Structural Learning , 2009, Current Biology.

[37]  S. Robbins.  Mechanisms underlying spontaneous recovery in autoshaping. , 1990 .

[38]  Joel L. Davis,et al.  Adaptive Critics and the Basal Ganglia , 1995 .

[39]  J. Tenenbaum,et al.  Structured statistical models of inductive reasoning. , 2009, Psychological review.

[40]  N. Chater,et al.  The probabilistic mind: prospects for Bayesian cognitive science , 2008 .

[41]  David S. Touretzky,et al.  Representation and Timing in Theories of the Dopamine System , 2006, Neural Computation.

[42]  R. Rescorla,et al.  Spontaneous recovery varies inversely with the training-extinction interval , 2004, Learning & behavior.

[43]  Jonathan D. Cohen,et al.  On the Control of Control: The Role of Dopamine in Regulating Prefrontal Function and Working Memory , 2007 .

[44]  Jonathan D. Cohen,et al.  Dissociating working memory from task difficulty in human prefrontal cortex , 1997, Neuropsychologia.

[45]  W. F. Prokasy,et al.  Classical conditioning II: Current research and theory. , 1972 .

[46]  Schrater Paul.  Structure learning in human sequential decision-making , 2009 .

[47]  Daniel A. Braun,et al.  Structure learning in action , 2010, Behavioural Brain Research.

[48]  M. Bouton.  Context, time, and memory retrieval in the interference paradigms of Pavlovian learning. , 1993, Psychological bulletin.

[49]  J. Driver,et al.  Control of Cognitive Processes: Attention and Performance XVIII , 2000 .

[50]  Peter Dayan,et al.  Bilinearity, Rules, and Prefrontal Cortex , 2007, Frontiers Comput. Neurosci..

[51]  Stephen Maren,et al.  Electrolytic lesions of the dorsal hippocampus disrupt renewal of conditional fear after extinction. , 2005, Learning & memory.

[52]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[53]  Eric A. Zilli,et al.  Modeling the role of working memory and episodic memory in behavioral tasks , 2008, Hippocampus.

[54]  Joshua B. Tenenbaum,et al.  Perceptual Multistability as Markov Chain Monte Carlo Inference , 2009, NIPS.