Dynamic Analysis of Learning in Behavioral Experiments

Understanding how an animal's ability to learn relates to neural activity or is altered by lesions, different attentional states, pharmacological interventions, or genetic manipulations are central questions in neuroscience. Although learning is a dynamic process, current analyses do not use dynamic estimation methods, require many trials across many animals to establish the occurrence of learning, and provide no consensus as how best to identify when learning has occurred. We develop a state-space model paradigm to characterize learning as the probability of a correct response as a function of trial number (learning curve). We compute the learning curve and its confidence intervals using a state-space smoothing algorithm and define the learning trial as the first trial on which there is reasonable certainty (>0.95) that a subject performs better than chance for the balance of the experiment. For a range of simulated learning experiments, the smoothing algorithm estimated learning curves with smaller mean integrated squared error and identified the learning trials with greater reliability than commonly used methods. The smoothing algorithm tracked easily the rapid learning of a monkey during a single session of an association learning experiment and identified learning 2 to 4 d earlier than accepted criteria for a rat in a 47 d procedural learning experiment. Our state-space paradigm estimates learning curves for single animals, gives a precise definition of learning, and suggests a coherent statistical framework for the design and analysis of learning experiments that could reduce the number of animals and trials per animal that these studies require.

[1]  S. Wise,et al.  Role of the Hippocampal System in Conditional Motor Learning: Mapping Antecedents to Action , 1999, Hippocampus.

[2]  C. Gallistel,et al.  The rat approximates an ideal detector of changes in rates of reward: implications for the law of effect. , 2001, Journal of experimental psychology. Animal behavior processes.

[3]  P. Usherwood,et al.  Glutamate Receptors in Eucaryotes , 1979 .

[4]  J. Maunsell,et al.  Attentional Modulation of Behavioral Performance and Neuronal Responses in Middle Temporal and Ventral Intraparietal Areas of Macaque Monkey , 2002, The Journal of Neuroscience.

[5]  S. Siegel,et al.  Nonparametric Statistics for the Behavioral Sciences. , 1957 .

[6]  I Q Whishaw,et al.  Acquisition and retention by hippocampal rats of simple, conditional, and configural tasks using tactile and olfactory cues: implications for hippocampal function. , 1991, Behavioral neuroscience.

[7]  H Eichenbaum,et al.  Normal olfactory discrimination learning set and facilitation of reversal learning after medial-temporal damage in rats: implications for an account of preserved learning abilities in amnesia , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  F. Roman,et al.  Learning and memory of odor-reward association: selective impairment following horizontal diagonal band lesions. , 1993, Behavioral neuroscience.

[9]  Bita Moghaddam,et al.  Glutamate receptors in the rat medial prefrontal cortex regulate set-shifting ability. , 2003, Behavioral neuroscience.

[10]  Morgan D Barense,et al.  Perceptual Attentional Set-Shifting Is Impaired in Rats with Neurotoxic Lesions of Posterior Parietal Cortex , 2003, The Journal of Neuroscience.

[11]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[12]  J. Rustagi Optimization Techniques in Statistics , 1994 .

[13]  L. Fahrmeir,et al.  Multivariate statistical modelling based on generalized linear models , 1994 .

[14]  Piet de Jong,et al.  Covariances for smoothed estimates in state space models , 1988 .

[15]  Sheldon M. Ross Introduction to Probability Models. , 1995 .

[16]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[17]  R. Shumway,et al.  AN APPROACH TO TIME SERIES SMOOTHING AND FORECASTING USING THE EM ALGORITHM , 1982 .

[18]  L. Frank,et al.  Single Neurons in the Monkey Hippocampus and Learning of New Associations , 2003, Science.

[19]  Brian Everitt,et al.  Statistical Aspects Of The Design And Analysis Of Clinical Trials , 2000 .

[20]  Peter Green,et al.  Markov chain Monte Carlo in Practice , 1996 .

[21]  George E. P. Box,et al.  Sampling and Bayes' inference in scientific modelling and robustness , 1980 .

[22]  C. I. Connolly,et al.  Building neural representations of habits. , 1999, Science.

[23]  S. Tonegawa,et al.  CA1-specific N-methyl-d-aspartate receptor knockout mice are deficient in solving a nonspatial transverse patterning task , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Peter Dayan,et al.  Expected and Unexpected Uncertainty: ACh and NE in the Neocortex , 2002, NIPS.

[25]  T. Robbins,et al.  Dissociable Forms of Inhibitory Control within Prefrontal Cortex with an Analog of the Wisconsin Card Sort Test: Restriction to Novel Situations and Independence from “On-Line” Processing , 1997, The Journal of Neuroscience.

[26]  Richard H. Jones,et al.  Longitudinal Data with Serial Correlation : A State-Space Approach , 1994 .

[27]  H. Eichenbaum,et al.  The hippocampus and memory for orderly stimulus relations. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[28]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[29]  Emery N. Brown,et al.  Estimating a State-space Model from Point Process Observations Emery N. Brown , 2022 .

[30]  J. Mendel Lessons in Estimation Theory for Signal Processing, Communications, and Control , 1995 .

[31]  S. Kakade,et al.  Acquisition and extinction in autoshaping. , 2002, Psychological review.

[32]  Zoubin Ghahramani,et al.  A Unifying Review of Linear Gaussian Models , 1999, Neural Computation.