Probabilistic models for neural populations that naturally capture global coupling and criticality

Advances in multi-unit recordings pave the way for statistical modeling of activity patterns in large neural populations. Recent studies have shown that the summed activity of all neurons strongly shapes the population response. A separate recent finding has been that neural populations also exhibit criticality, an anomalously large dynamic range for the probabilities of different population activity patterns. Motivated by these two observations, we introduce a class of probabilistic models which takes into account the prior knowledge that the neural population could be globally coupled and close to critical. These models consist of an energy function which parametrizes interactions between small groups of neurons, and an arbitrary positive, strictly increasing, and twice differentiable function which maps the energy of a population pattern to its probability. We show that: 1) augmenting a pairwise Ising model with a nonlinearity yields an accurate description of the activity of retinal ganglion cells which outperforms previous models based on the summed activity of neurons; 2) prior knowledge that the population is critical translates to prior expectations about the shape of the nonlinearity; 3) the nonlinearity admits an interpretation in terms of a continuous latent variable globally coupling the system whose distribution we can infer from data. Our method is independent of the underlying system’s state space; hence, it can be applied to other systems such as natural scenes or amino acid sequences of proteins which are also known to exhibit criticality.

[1]  Klaus Obermayer,et al.  Approximate Inference for Time-Varying Interactions and Macroscopic Dynamics of Neural Populations , 2016, PLoS Comput. Biol..

[2]  Matthias Bethge,et al.  Correlations and signatures of criticality in neural population models , 2015, NIPS 2015.

[3]  Thierry Mora,et al.  Dynamical criticality in the collective activity of a population of retinal neurons. , 2014, Physical review letters.

[4]  Simon R. Schultz,et al.  Statistical modelling of higher-order correlations in pools of neural activity , 2012, 1211.6348.

[5]  Radford M. Neal Annealed importance sampling , 1998, Stat. Comput..

[6]  Saeed Saremi,et al.  Hierarchical model of natural images and the origin of scale invariance , 2013, Proceedings of the National Academy of Sciences.

[7]  David J Schwab,et al.  Zipf's law and criticality in multivariate data without fine-tuning. , 2013, Physical review letters.

[8]  Michael J. Berry,et al.  Thermodynamics and signatures of criticality in a network of neurons , 2015, Proceedings of the National Academy of Sciences.

[9]  R. Segev,et al.  Sparse low-order interaction network underlies a highly correlated and learnable neural population code , 2011, Proceedings of the National Academy of Sciences.

[10]  Cian O'Donnell,et al.  The population tracking model: A simple, scalable statistical model for neural population data , 2016, bioRxiv.

[11]  Jens Timmer,et al.  Summary of the DREAM8 Parameter Estimation Challenge: Toward Parameter Identification for Whole-Cell Models , 2015, PLoS Comput. Biol..

[12]  O. Marre,et al.  A Tractable Method for Describing Complex Couplings between Neurons and Population Rate , 2016, eNeuro.

[13]  Matthias Bethge,et al.  Modeling Natural Image Statistics , 2015 .

[14]  Tijmen Tieleman,et al.  Training restricted Boltzmann machines using approximations to the likelihood gradient , 2008, ICML '08.

[15]  Michael J. Berry,et al.  Multi-electrode array recording from salamander retinal ganglion cells , 2017 .

[16]  Stefan Thurner,et al.  When do generalized entropies apply? How phase space volume determines entropy , 2011, 1104.2064.

[17]  Matthias Bethge,et al.  Signatures of criticality arise from random subsampling in simple population models , 2016, PLoS Comput. Biol..

[18]  E. Kandel,et al.  Proceedings of the National Academy of Sciences of the United States of America. Annual subject and author indexes. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[19]  Georg Martius,et al.  Nonlinear decoding of a complex movie from the mammalian retina , 2016, PLoS Comput. Biol..

[20]  J. Ramsay Estimating smooth monotone functions , 1998 .

[21]  Michael J. Berry,et al.  Error-Robust Modes of the Retinal Population Code , 2016, PLoS Comput. Biol..

[22]  W. Bialek,et al.  Are Biological Systems Poised at Criticality? , 2010, 1012.2242.

[23]  I. Mastromatteo,et al.  On the criticality of inferred models , 2011, 1102.1624.

[24]  Jonathon Shlens,et al.  The Structure of Multi-Neuron Firing Patterns in Primate Retina , 2006, The Journal of Neuroscience.

[25]  Michael Small,et al.  Dynamical Modeling of Collective Behavior from Pigeon Flight Data: Flock Cohesion and Dispersion , 2011, PLoS Comput. Biol..

[26]  Michael J. Berry,et al.  Weak pairwise correlations imply strongly correlated network states in a neural population , 2005, Nature.

[27]  D. Thouless Introduction to Phase Transitions and Critical Phenomena , 1972 .

[28]  Michael J. Berry,et al.  High Accuracy Decoding of Dynamical Motion from a Large Retinal Population , 2014, PLoS Comput. Biol..

[29]  Michael J. Berry,et al.  Noise-robust modes of the retinal population code geometrically correspond with "ridges" , 2016 .

[30]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[31]  Fernando Montani,et al.  Quantifying higher-order correlations in a neuronal pool , 2015 .

[32]  Liam Paninski,et al.  Statistical models for neural encoding, decoding, and optimal stimulus design. , 2007, Progress in brain research.

[33]  J. M. Herrmann,et al.  Dynamical synapses causing self-organized criticality in neural networks , 2007, 0712.1003.

[34]  Fernando Montani,et al.  Higher-order correlations in common input shapes the output spiking activity of a neural population , 2017 .

[35]  M. Carandini,et al.  Population Rate Dynamics and Multineuron Firing Patterns in Sensory Cortex , 2012, The Journal of Neuroscience.

[36]  Michael J. Berry,et al.  The simplest maximum entropy model for collective behavior in a neural network , 2012, 1207.6319.

[37]  Jeffrey Shaman,et al.  Retrospective Parameter Estimation and Forecast of Respiratory Syncytial Virus in the United States , 2016, PLoS Comput. Biol..

[38]  Kimmo Kaski,et al.  Tracking urban human activity from mobile phone calling patterns , 2017, PLoS Comput. Biol..

[39]  Matteo Marsili,et al.  On sampling and modeling complex systems , 2013, 1301.3622.

[40]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[41]  W. Bialek,et al.  Maximum entropy models for antibody diversity , 2009, Proceedings of the National Academy of Sciences.

[42]  Yutaka Sakai,et al.  Synchronous Firing and Higher-Order Interactions in Neuron Pool , 2003, Neural Computation.

[43]  Peter E. Latham,et al.  Zipf’s Law Arises Naturally When There Are Underlying, Unobserved Variables , 2016, PLoS Comput. Biol..

[44]  Emery N. Brown,et al.  State-Space Analysis of Time-Varying Higher-Order Spike Correlation for Multiple Neural Spike Train Data , 2012, PLoS Comput. Biol..

[45]  William Bialek,et al.  Reading a Neural Code , 1991, NIPS.

[46]  Bruno A. Olshausen,et al.  Modeling Higher-Order Correlations within Cortical Microcolumns , 2014, PLoS Comput. Biol..

[47]  H. Stanley,et al.  Introduction to Phase Transitions and Critical Phenomena , 1972 .

[48]  Nicholas A. Steinmetz,et al.  Diverse coupling of neurons to populations in sensory cortex , 2015, Nature.

[49]  Elad Schneidman,et al.  Towards the design principles of neural population codes , 2016, Current Opinion in Neurobiology.

[50]  Berend Smit,et al.  Understanding molecular simulation: from algorithms to applications , 1996 .

[51]  William Bialek,et al.  Inverse spin glass and related maximum entropy problems. , 2013, Physical review letters.

[52]  Michael J. Berry,et al.  Searching for Collective Behavior in a Large Network of Sensory Neurons , 2013, PLoS Comput. Biol..

[53]  Eero P. Simoncelli,et al.  Reducing statistical dependencies in natural signals using radial Gaussianization , 2008, NIPS.

[54]  W. Bialek,et al.  Statistical thermodynamics of natural images. , 2008, Physical review letters.

[55]  Yuji Ikegaya,et al.  Simultaneous silence organizes structured higher-order interactions in neural populations , 2015, Scientific Reports.

[56]  Shan Yu,et al.  Higher-Order Interactions Characterized in Cortical Activity , 2011, The Journal of Neuroscience.

[57]  Michael J. Berry,et al.  Ising models for networks of real neurons , 2006, q-bio/0611072.

[58]  M. Bethge,et al.  Common input explains higher-order correlations and entropy in a simple model of neural population activity. , 2011, Physical review letters.

[59]  D. Landau,et al.  Efficient, multiple-range random walk algorithm to calculate the density of states. , 2000, Physical review letters.

[60]  John M. Beggs,et al.  Neuronal Avalanches in Neocortical Circuits , 2003, The Journal of Neuroscience.

[61]  Ifije E. Ohiorhenuan,et al.  Sparse coding and high-order correlations in fine-scale cortical networks , 2010, Nature.