Bayesian analysis of interleaved learning and response bias in behavioral experiments.

Accurate characterizations of behavior during learning experiments are essential for understanding the neural bases of learning. Whereas learning experiments often give subjects multiple tasks to learn simultaneously, most analyze subject performance separately on each individual task. This analysis strategy ignores the true interleaved presentation order of the tasks and cannot distinguish learning behavior from response preferences that may represent a subject's biases or strategies. We present a Bayesian analysis of a state-space model for characterizing simultaneous learning of multiple tasks and for assessing behavioral biases in learning experiments with interleaved task presentations. Under the Bayesian analysis the posterior probability densities of the model parameters and the learning state are computed using Monte Carlo Markov Chain methods. Measures of learning, including the learning curve, the ideal observer curve, and the learning trial translate directly from our previous likelihood-based state-space model analyses. We compare the Bayesian and current likelihood-based approaches in the analysis of a simulated conditioned T-maze task and of an actual object-place association task. Modeling the interleaved learning feature of the experiments along with the animal's response sequences allows us to disambiguate actual learning from response biases. The implementation of the Bayesian analysis using the WinBUGS software provides an efficient way to test different models without developing a new algorithm for each model. The new state-space model and the Bayesian estimation procedure suggest an improved, computationally efficient approach for accurately characterizing learning in behavioral experiments.

[1]  A. Graybiel,et al.  Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories , 2005, Nature.

[2]  Patrick Suppes On deriving models in the social sciences , 1990 .

[3]  Emery N Brown,et al.  Behavioral and neurophysiological analyses of dynamic learning processes. , 2005, Behavioral and cognitive neuroscience reviews.

[4]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[5]  Jochen Ditterich,et al.  Stochastic models of decisions about motion direction: Behavior and physiology , 2006, Neural Networks.

[6]  W. Estes Handbook of Learning and Cognitive Processes (Volume 4) : Attention and Memory , 1977 .

[7]  D. N.,et al.  DYNAMIC GENERALIZATION OF THE RASCH MODEL , 2000 .

[8]  H Eichenbaum,et al.  Normal olfactory discrimination learning set and facilitation of reversal learning after medial-temporal damage in rats: implications for an account of preserved learning abilities in amnesia , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Eugene Galanter,et al.  Handbook of mathematical psychology: I. , 1963 .

[10]  Philip L. Smith Psychophysically principled models of visual simple reaction time. , 1995 .

[11]  Melvin J. Hinich,et al.  Time Series Analysis by State Space Methods , 2001 .

[12]  T. Robbins,et al.  Dissociable Forms of Inhibitory Control within Prefrontal Cortex with an Analog of the Wisconsin Card Sort Test: Restriction to Novel Situations and Independence from “On-Line” Processing , 1997, The Journal of Neuroscience.

[13]  Richard H. Jones,et al.  Longitudinal Data with Serial Correlation : A State-Space Approach , 1994 .

[15]  C. Büchel,et al.  Dissociable Retrosplenial and Hippocampal Contributions to Successful Formation of Survey Representations , 2005, The Journal of Neuroscience.

[16]  Pia Veldt Larsen,et al.  In All Likelihood: Statistical Modelling and Inference Using Likelihood , 2003 .

[17]  Harry F. Baker,et al.  Visual discrimination learning impairments produced by combined transections of the anterior temporal stem, amygdala and fornix in marmoset monkeys , 2001, Brain Research.

[18]  L. Frank,et al.  Single Neurons in the Monkey Hippocampus and Learning of New Associations , 2003, Science.

[19]  J. Ware,et al.  Random-effects models for longitudinal data. , 1982, Biometrics.

[20]  Morgan D Barense,et al.  Perceptual Attentional Set-Shifting Is Impaired in Rats with Neurotoxic Lesions of Posterior Parietal Cortex , 2003, The Journal of Neuroscience.

[21]  Emery N. Brown,et al.  Estimating a State-space Model from Point Process Observations Emery N. Brown , 2022 .

[22]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[23]  Emery N Brown,et al.  Behavioral / Systems / Cognitive Functional Magnetic Resonance Imaging Activity during the Gradual Acquisition and Expression of Paired-Associate Memory , 2005 .

[24]  Emery N Brown,et al.  Analysis and design of behavioral experiments to characterize population learning. , 2005, Journal of neurophysiology.

[25]  I Q Whishaw,et al.  Acquisition and retention by hippocampal rats of simple, conditional, and configural tasks using tactile and olfactory cues: implications for hippocampal function. , 1991, Behavioral neuroscience.

[26]  Joseph J. Paton,et al.  The primate amygdala represents the positive and negative value of visual stimuli during learning , 2006, Nature.

[27]  James L. McClelland,et al.  Loss aversion and inhibition in dynamical models of multialternative choice. , 2004, Psychological review.

[28]  C. Gallistel,et al.  The learning curve: implications of a quantitative analysis. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[29]  F. Roman,et al.  Learning and memory of odor-reward association: selective impairment following horizontal diagonal band lesions. , 1993, Behavioral neuroscience.

[30]  S. Kakade,et al.  Acquisition and extinction in autoshaping. , 2002, Psychological review.

[31]  G. Loftus,et al.  Sensory and cognitive components of visual information acquisition. , 1994, Psychological review.

[32]  R. Rosenfeld Nature , 2009, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[33]  Andrew Thomas,et al.  WinBUGS - A Bayesian modelling framework: Concepts, structure, and extensibility , 2000, Stat. Comput..

[34]  Emery N. Brown,et al.  Dynamic Analysis of Neural Encoding by Point Process Adaptive Filtering , 2004, Neural Computation.

[35]  Stephen P. Brooks,et al.  Review of Markov chain Monte Carlo in practice by WR Gilks, S Richardson & DJ Spiegelhalter , 1997 .

[36]  S. Kakade,et al.  Learning and selective attention , 2000, Nature Neuroscience.

[37]  M. Stone,et al.  Studies in mathematical learning theory. , 1960 .

[38]  Peter Dayan,et al.  Expected and Unexpected Uncertainty: ACh and NE in the Neocortex , 2002, NIPS.

[39]  Emery N Brown,et al.  Dynamic Analysis of Learning in Behavioral Experiments , 2004, The Journal of Neuroscience.

[40]  J. Ware,et al.  Random-effects models for serial observations with binary response. , 1984, Biometrics.

[41]  D. Rubin,et al.  Inference from Iterative Simulation Using Multiple Sequences , 1992 .

[42]  B. Moghaddam,et al.  Rule Learning and Reward Contingency Are Associated with Dissociable Patterns of Dopamine Activation in the Rat Prefrontal Cortex, Nucleus Accumbens, and Dorsal Striatum , 2006, The Journal of Neuroscience.

[43]  Jeffrey N. Rouder,et al.  A diffusion model account of masking in two-choice letter identification. , 2000, Journal of experimental psychology. Human perception and performance.

[44]  Tom Verguts,et al.  A Rasch Model for Detecting Learning While Solving an Intelligence Test , 2000 .

[45]  Ziv M. Williams,et al.  Selective enhancement of associative learning by microstimulation of the anterior caudate , 2006, Nature Neuroscience.

[46]  S. Tonegawa,et al.  CA1-specific N-methyl-d-aspartate receptor knockout mice are deficient in solving a nonspatial transverse patterning task , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[47]  J. Townsend,et al.  Decision field theory: a dynamic-cognitive approach to decision making in an uncertain environment. , 1993, Psychological review.

[48]  Zoubin Ghahramani,et al.  A Unifying Review of Linear Gaussian Models , 1999, Neural Computation.

[49]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[50]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[51]  S. Ishii,et al.  Resolution of Uncertainty in Prefrontal Cortex , 2006, Neuron.

[52]  Bradley P. Carlin,et al.  Markov Chain Monte Carlo in Practice: A Roundtable Discussion , 1998 .