The Ising decoder: reading out the activity of large neural ensembles

The Ising model has recently received much attention for the statistical description of neural spike train data. In this paper, we propose and demonstrate its use for building decoders capable of predicting, on a millisecond timescale, the stimulus represented by a pattern of neural activity. After fitting to a training dataset, the Ising decoder can be applied “online” for instantaneous decoding of test data. While such models can be fit exactly using Boltzmann learning, this approach rapidly becomes computationally intractable as neural ensemble size increases. We show that several approaches, including the Thouless–Anderson–Palmer (TAP) mean field approach from statistical physics, and the recently developed Minimum Probability Flow Learning (MPFL) algorithm, can be used for rapid inference of model parameters in large-scale neural ensembles. Use of the Ising model for decoding, unlike other problems such as functional connectivity estimation, requires estimation of the partition function. As this involves summation over all possible responses, this step can be limiting. Mean field approaches avoid this problem by providing an analytical expression for the partition function. We demonstrate these decoding techniques by applying them to simulated neural ensemble responses from a mouse visual cortex model, finding an improvement in decoder performance for a model with heterogeneous as opposed to homogeneous neural tuning and response properties. Our results demonstrate the practicality of using the Ising model to read out, or decode, spatial patterns of activity comprised of many hundreds of neurons.

[1]  Jonathon Shlens,et al.  The Structure of Multi-Neuron Firing Patterns in Primate Retina , 2006, The Journal of Neuroscience.

[2]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[3]  Toshiyuki TANAKA Mean-field theory of Boltzmann machine learning , 1998 .

[4]  W. Bair,et al.  Correlated Firing in Macaque Visual Area MT: Time Scales and Relationship to Behavior , 2001, The Journal of Neuroscience.

[5]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[6]  M. A. Smith,et al.  Correlations and brain states: from electrophysiology to functional imaging , 2009, Current Opinion in Neurobiology.

[7]  John A. Michon,et al.  The Processing of Temporal Information , 1984 .

[8]  Y. Ogata,et al.  Likelihood Analysis of Spatial Point Patterns , 1984 .

[9]  Ifije E. Ohiorhenuan,et al.  Sparse coding and high-order correlations in fine-scale cortical networks , 2010, Nature.

[10]  L. Abbott,et al.  Responses of neurons in primary and inferior temporal visual cortices to natural scenes , 1997, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[11]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[12]  John Apergis-Schoute,et al.  Maximum entropy decoding of multivariate neural spike trains , 2009, BMC Neuroscience.

[13]  E T Rolls,et al.  Correlations and the encoding of information in the nervous system , 1999, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[14]  R. Palmer,et al.  Solution of 'Solvable model of a spin glass' , 1977 .

[15]  Stefano Panzeri,et al.  A Unified Approach to the Study of Temporal, Correlational, and Rate Coding , 1999, Neural Computation.

[16]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[17]  Wolf Singer,et al.  Features of neuronal synchrony in mouse visual cortex. , 2003, Journal of neurophysiology.

[18]  Christof Koch,et al.  Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey , 1999, Neural Computation.

[19]  S. Panzeri,et al.  An exact method to quantify the information transmitted by different mechanisms of correlational coding. , 2003, Network.

[20]  N. Higham Computing the nearest correlation matrix—a problem from finance , 2002 .

[21]  Yosihiko Ogata,et al.  Comparison of Two Methods for Calculating the Partition Functions of Various Spatial Statistical Models , 2001 .

[22]  Mehdi Aghagolzadeh,et al.  Synergistic Coding by Cortical Neural Ensembles , 2010, IEEE Transactions on Information Theory.

[23]  Alexander S. Ecker,et al.  Decorrelated Neuronal Firing in Cortical Microcircuits , 2010, Science.

[24]  W. M. Keck,et al.  Highly Selective Receptive Fields in Mouse Visual Cortex , 2008, The Journal of Neuroscience.

[25]  Robert E. Schapire,et al.  Faster solutions of the inverse pairwise Ising problem , 2008 .

[26]  J. Hertz,et al.  Ising model for neural data: model quality and approximate methods for extracting functional connectivity. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[27]  P. Földiák,et al.  The ‘Ideal Homunculus’: Statistical Inference from Neural Population Responses , 1993 .

[28]  Hilbert J. Kappen,et al.  Efficient Learning in Boltzmann Machines Using Linear Response Theory , 1998, Neural Computation.

[29]  S Panzeri,et al.  Temporal correlations and neural spike train entropy. , 2001, Physical review letters.

[30]  C E Carr,et al.  Processing of temporal information in the brain. , 1993, Annual review of neuroscience.

[31]  Jonathon Shlens,et al.  The Structure of Large-Scale Synchronized Firing in Primate Retina , 2009, The Journal of Neuroscience.

[32]  Stefano Panzeri,et al.  On Decoding the Responses of a Population of Neurons from Short Time Windows , 1999, Neural Computation.

[33]  C. Gilbert,et al.  Topography of contextual modulations mediated by short-range interactions in primary visual cortex , 1999, Nature.

[34]  T Plefka Expansion of the Gibbs potential for quantum many-body systems: general formalism with applications to the spin glass and the weakly nonideal Bose gas. , 2006, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  Peter E. Latham,et al.  Pairwise Maximum Entropy Models for Studying Large Biological Systems: When They Can Work and When They Can't , 2008, PLoS Comput. Biol..

[36]  Jascha Sohl-Dickstein,et al.  Minimum Probability Flow Learning , 2009, ICML.

[37]  M. Häusser,et al.  Spatial Pattern Coding of Sensory Information by Climbing Fiber-Evoked Calcium Signals in Networks of Neighboring Cerebellar Purkinje Cells , 2009, The Journal of Neuroscience.

[38]  E. Jaynes Information Theory and Statistical Mechanics , 1957 .

[39]  M. A. Smith,et al.  Stimulus Dependence of Neuronal Correlation in Primary Visual Cortex of the Macaque , 2005, The Journal of Neuroscience.

[40]  J. Hertz,et al.  Adjacent visual cortical complex cells share about 20% of their stimulus-related information. , 1996, Cerebral cortex.

[41]  J. Wolpaw,et al.  Clinical Applications of Brain-Computer Interfaces: Current State and Future Prospects , 2009, IEEE Reviews in Biomedical Engineering.

[42]  Erik Aurell,et al.  Frontiers in Computational Neuroscience , 2022 .

[43]  E. Seidemann,et al.  Optimal decoding of correlated neural population responses in the primate visual cortex , 2006, Nature Neuroscience.

[44]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[45]  Chun-I Yeh,et al.  Temporal precision in the neural code and the timescales of natural vision , 2007, Nature.

[46]  D. Perrett,et al.  The `Ideal Homunculus': decoding neural population signals , 1998, Trends in Neurosciences.

[47]  F. Mechler,et al.  Independent and Redundant Information in Nearby Cortical Neurons , 2001, Science.

[48]  Ehud Zohary,et al.  Correlated neuronal discharge rate and its implications for psychophysical performance , 1994, Nature.

[49]  Erik Aurell,et al.  Inferring network connectivity using kinetic Ising models , 2010, BMC Neuroscience.

[50]  Byron M. Yu,et al.  Factor-analysis methods for higher-performance neural prostheses. , 2009, Journal of neurophysiology.

[51]  M. A. Smith,et al.  The Role of Correlations in Direction and Contrast Coding in the Primary Visual Cortex , 2007, The Journal of Neuroscience.

[52]  M. Diamond,et al.  Population Coding of Stimulus Location in Rat Somatosensory Cortex , 2001, Neuron.

[53]  J. Hertz,et al.  Mean field theory for nonequilibrium network reconstruction. , 2010, Physical review letters.

[54]  Measuring Salivary Cortisol Comparison of Two Methods for , 2002 .

[55]  Alexander S. Ecker,et al.  Generating Spike Trains with Specified Correlation Coefficients , 2009, Neural Computation.

[56]  Adam L. Berger,et al.  A Maximum Entropy Approach to Natural Language Processing , 1996, CL.

[57]  A. B. Bonds,et al.  Gamma oscillation maintains stimulus structure-dependent synchronization in cat visual cortex. , 2005, Journal of neurophysiology.

[58]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .