Hidden Markov Models Predict the Future Choice Better Than a PSTH-Based Method

Beyond average firing rate, other measurable signals of neuronal activity are fundamental to an understanding of behavior. Recently, hidden Markov models (HMMs) have been applied to neural recordings and have described how neuronal ensembles process information by going through sequences of different states. Such collective dynamics are impossible to capture by just looking at the average firing rate. To estimate how well HMMs can decode information contained in single trials, we compared HMMs with a recently developed classification method based on the peristimulus time histogram (PSTH). The accuracy of the two methods was tested by using the activity of prefrontal neurons recorded while two monkeys were engaged in a strategy task. In this task, the monkeys had to select one of three spatial targets based on an instruction cue and on their previous choice. We show that by using the single trial's neural activity in a period preceding action execution, both models were able to classify the monkeys' choice with an accuracy higher than by chance. Moreover, the HMM was significantly more accurate than the PSTH-based method, even in cases in which the HMM performance was low, although always above chance. Furthermore, the accuracy of both methods was related to the number of neurons exhibiting spatial selectivity within an experimental session. Overall, our study shows that neural activity is better described when not only the mean activity of individual neurons is considered and that therefore, the study of other signals rather than only the average firing rate is fundamental to an understanding of the dynamics of neuronal ensembles.

[1]  Encarni Marcos,et al.  Coding of Self and Other's Future Choices in Dorsal Premotor Cortex during Social Interaction. , 2018, Cell reports.

[2]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[3]  M. Weliky,et al.  Small modulation of ongoing cortical dynamics by sensory input during natural vision , 2004, Nature.

[4]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[5]  Gustavo Deco,et al.  Neural Variability in Premotor Cortex Is Modulated by Trial History and Predicts Behavioral Performance , 2013, Neuron.

[6]  Aldo Genovesio,et al.  Outcome Modulation Across Tasks in the Primate Dorsolateral Prefrontal Cortex , 2018, Neuroscience.

[7]  L. Baum,et al.  A Maximization Technique Occurring in the Statistical Analysis of Probabilistic Functions of Markov Chains , 1970 .

[8]  Miguel A. L. Nicolelis,et al.  Principles of neural ensemble physiology underlying the operation of brain–machine interfaces , 2009, Nature Reviews Neuroscience.

[9]  E. Seidemann,et al.  Simultaneously recorded single units in the frontal cortex go through sequences of discrete and stable states in monkeys performing a delayed localization task , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  S. Ferraina,et al.  Heterogeneous Attractor Cell Assemblies for Motor Planning in Premotor Cortex , 2013, The Journal of Neuroscience.

[11]  K. Harris,et al.  Spontaneous Events Outline the Realm of Possible Sensory Responses in Neocortical Populations , 2009, Neuron.

[12]  Christopher R. Stambaugh,et al.  Simultaneous encoding of tactile information by three primate cortical areas , 1998, Nature Neuroscience.

[13]  S. Wise,et al.  Encoding problem‐solving strategies in prefrontal cortex: activity during strategic errors , 2008, The European journal of neuroscience.

[14]  E T Rolls,et al.  Information about spatial view in an ensemble of primate hippocampal cells. , 1998, Journal of neurophysiology.

[15]  A. Treves,et al.  The representational capacity of the distributed encoding of information provided by populations of neurons in primate temporal visual cortex , 1997, Experimental Brain Research.

[16]  Nicole C. Rust,et al.  Selectivity and Tolerance (“Invariance”) Both Increase as Visual Information Propagates from Cortical Area V4 to IT , 2010, The Journal of Neuroscience.

[17]  Eric Shea-Brown,et al.  Impact of Network Structure and Cellular Response on Spike Time Correlations , 2011, PLoS Comput. Biol..

[18]  Naftali Tishby,et al.  Cortical activity flips among quasi-stationary states. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Liam Paninski,et al.  Hidden Markov Models for the Stimulus-Response Relationships of Multistate Neural Systems , 2011, Neural Computation.

[20]  Lloyd H. Michael,et al.  The Guide for the Care and Use of Laboratory Animals. , 2016, ILAR journal.

[21]  S. Wise,et al.  Neuronal activity related to elapsed time in prefrontal cortex. , 2006, Journal of neurophysiology.

[22]  Solaiman Shokur,et al.  A Brain-Machine Interface Enables Bimanual Arm Movements in Monkeys , 2013, Science Translational Medicine.

[23]  Matthew T. Kaufman,et al.  A category-free neural population supports evolving demands during decision-making , 2014, Nature Neuroscience.

[24]  G. La Camera,et al.  Dynamics of Multistable States during Ongoing and Evoked Cortical Activity , 2015, The Journal of Neuroscience.

[25]  M A Nicolelis,et al.  Neonatal whisker removal reduces the discrimination of tactile stimuli by thalamic ensembles in adult rats. , 1997, Journal of neurophysiology.

[26]  Aldo Genovesio,et al.  Transient neuronal correlations underlying goal selection and maintenance in prefrontal cortex. , 2008, Cerebral cortex.

[27]  Stefan Rotter,et al.  How Structure Determines Correlations in Neuronal Networks , 2011, PLoS Comput. Biol..

[28]  Moritz Helias,et al.  The Correlation Structure of Local Neuronal Networks Intrinsically Results from Recurrent Dynamics , 2013, PLoS Comput. Biol..

[29]  J. Chapin Using multi-neuron population recordings for neural prosthetics , 2004, Nature Neuroscience.

[30]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[31]  Encarni Marcos,et al.  Determining Monkey Free Choice Long before the Choice Is Made: The Principal Role of Prefrontal Neurons Involved in Both Decision and Motor Processes , 2016, Front. Neural Circuits.

[32]  Christopher R. Stambaugh,et al.  Encoding of Tactile Stimulus Location by Somatosensory Thalamocortical Ensembles , 2000, The Journal of Neuroscience.

[33]  Aldo Genovesio,et al.  Independent coding of absolute duration and distance magnitudes in the prefrontal cortex. , 2017, Journal of neurophysiology.

[34]  Hongkui Zeng,et al.  Genetic approaches to neural circuits in the mouse. , 2013, Annual review of neuroscience.

[35]  C. Gross,et al.  Neural ensemble coding in inferior temporal cortex. , 1994, Journal of neurophysiology.

[36]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[37]  Rossella Falcone,et al.  Neural activity in macaque medial frontal cortex represents others’ choices , 2017, Scientific Reports.

[38]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[39]  Mikhail A. Lebedev,et al.  How to read neuron-dropping curves? , 2014, Front. Syst. Neurosci..

[40]  Brent Doiron,et al.  The mechanics of state-dependent neural correlations , 2016, Nature Neuroscience.

[41]  Baldwin Goodell,et al.  A Large-Scale Semi-Chronic Microdrive Recording System for Non-Human Primates , 2017, Neuron.

[42]  Nicole C. Rust,et al.  Signals in inferotemporal and perirhinal cortex suggest an “untangling” of visual target information , 2013, Nature Neuroscience.

[43]  Mikhail A. Lebedev,et al.  Chronic, Wireless Recordings of Large Scale Brain Activity in Freely Moving Rhesus Monkeys , 2014, Nature Methods.

[44]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[45]  Mikhail A. Lebedev,et al.  Brain-machine interfaces: an overview , 2014 .

[46]  Andrew R. Mitz,et al.  Prefrontal Cortex Activity Related to Abstract Response Strategies , 2005, Neuron.

[47]  M. Diamond,et al.  The Role of Spike Timing in the Coding of Stimulus Location in Rat Somatosensory Cortex , 2001, Neuron.

[48]  R. Romo,et al.  Dynamics of Cortical Neuronal Ensembles Transit from Decision Making to Storage for Later Report , 2012, The Journal of Neuroscience.

[49]  Aldo Genovesio,et al.  Representation of Future and Previous Spatial Goals by Separate Neural Populations in Prefrontal Cortex , 2006, The Journal of Neuroscience.

[50]  Jerald D. Kralik,et al.  Representation of Attended Versus Remembered Locations in Prefrontal Cortex , 2004, PLoS biology.

[51]  Alexa Riehle,et al.  Dynamic sequences of states in ensembles of motor cortical neurons , 2008 .

[52]  Paul Miller,et al.  Natural stimuli evoke dynamic sequences of states in sensory cortical ensembles , 2007, Proceedings of the National Academy of Sciences.

[53]  Guglielmo Foffani,et al.  PSTH-based classification of sensory stimuli using ensembles of single neurons , 2004, Journal of Neuroscience Methods.

[54]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[55]  Jerald D. Kralik,et al.  Chronic, multisite, multielectrode recordings in macaque monkeys , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[56]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.