Neural field models for latent state inference: Application to large-scale neuronal recordings

Large-scale neural recordings are becoming increasingly better at providing a window into functional neural networks in the living organism. Interpreting such rich data sets, however, poses fundamental statistical challenges. The neural field models of Wilson, Cowan and colleagues remain the mainstay of mathematical population modeling owing to their interpretable, mechanistic parameters and amenability to mathematical analysis. We developed a method based on moment closure to interpret neural field models as latent state-space point-process models, making mean field models amenable to statistical inference. We demonstrate that this approach can infer latent neural states, such as active and refractory neurons, in large populations. After validating this approach with synthetic data, we apply it to high-density recordings of spiking activity in the developing mouse retina. This confirms the essential role of a long lasting refractory state in shaping spatio-temporal properties of neonatal retinal waves. This conceptual and methodological advance opens up new theoretical connections between mathematical theory and point-process state-space models in neural data analysis. Significance Developing statistical tools to connect single-neuron activity to emergent collective dynamics is vital for building interpretable models of neural activity. Neural field models relate single-neuron activity to emergent collective dynamics in neural populations, but integrating them with data remains challenging. Recently, latent state-space models have emerged as a powerful tool for constructing phenomenological models of neural population activity. The advent of high-density multi-electrode array recordings now enables us to examine large-scale collective neural activity. We show that classical neural field approaches can yield latent statespace equations and demonstrate inference for a neural field model of excitatory spatiotemporal waves that emerge in the developing retina.

[1]  John P. Cunningham,et al.  Linear dynamical neural population models through nonlinear embeddings , 2016, NIPS.

[2]  Viktor K. Jirsa,et al.  Predicting the spatiotemporal diversity of seizure propagation and termination in human focal epilepsy , 2017, Nature Communications.

[3]  Eero P. Simoncelli,et al.  Spatio-temporal correlations and visual signalling in a complete neuronal population , 2008, Nature.

[4]  D. Sherrington Stochastic Processes in Physics and Chemistry , 1983 .

[5]  Mehdi Aghagolzadeh,et al.  Inference and Decoding of Motor Cortex Low-Dimensional Dynamics via Latent State-Space Models , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[6]  Nicholas V. Swindale,et al.  Retinal Wave Behavior through Activity-Dependent Refractory Periods , 2007, PLoS Comput. Biol..

[7]  S. Eglen,et al.  Developmental Modulation of Retinal Wave Dynamics: Shedding Light on the GABA Saga , 2003, The Journal of Neuroscience.

[8]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[9]  Razvan Pascanu,et al.  On the difficulty of training recurrent neural networks , 2012, ICML.

[10]  R. Kötter,et al.  Connecting Mean Field Models of Neural Activity to EEG and fMRI Data , 2010, Brain Topography.

[11]  J. Donoghue,et al.  Collective dynamics in human and monkey sensorimotor cortex: predicting single neuron spikes , 2009, Nature Neuroscience.

[12]  Bryan C. Daniels,et al.  Perspective: Sloppiness and emergent theories in physics, biology, and beyond. , 2015, The Journal of chemical physics.

[13]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[14]  Wilson Truccolo,et al.  From point process observations to collective neural dynamics: Nonlinear Hawkes process GLMs, low-dimensional dynamics and coarse graining , 2016, Journal of Physiology-Paris.

[15]  Visakan Kadirkamanathan,et al.  Point process modelling of the Afghan War Diary , 2012, Proceedings of the National Academy of Sciences.

[16]  D. Copenhagen,et al.  Synaptic and Extrasynaptic Factors Governing Glutamatergic Retinal Waves , 2009, Neuron.

[17]  M. Golubitsky,et al.  Geometric visual hallucinations, Euclidean symmetry and the functional architecture of striate cortex. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[18]  Karl J. Friston,et al.  Dynamic causal modeling with neural fields , 2012, NeuroImage.

[19]  G. Sanguinetti,et al.  Cox process representation and inference for stochastic reaction–diffusion processes , 2016, Nature Communications.

[20]  J. Nathan Kutz,et al.  A reaction-diffusion model of cholinergic retinal waves and self-organized criticality , 2013, BMC Neuroscience.

[21]  Yoshua Bengio,et al.  Gradient Flow in Recurrent Nets: the Difficulty of Learning Long-Term Dependencies , 2001 .

[22]  Honghui Zhang,et al.  Seizure Dynamics of Coupled Oscillators with Epileptor Field Model , 2018, Int. J. Bifurc. Chaos.

[23]  Alain Destexhe,et al.  A Master Equation Formalism for Macroscopic Modeling of Asynchronous Irregular Activity States , 2009, Neural Computation.

[24]  Sydney S. Cash,et al.  A Biologically Constrained, Mathematical Model of Cortical Wave Propagation Preceding Seizure Termination , 2015, PLoS Comput. Biol..

[25]  P. M. Lundquist,et al.  Organic Glasses: A New Class of Photorefractive Materials , 1996, Science.

[26]  Yuan Zhao,et al.  Variational Latent Gaussian Process for Recovering Single-Trial Dynamics from Population Spike Trains , 2016, Neural Computation.

[27]  R. E. Kalman,et al.  Contributions to the Theory of Optimal Control , 1960 .

[28]  Karl J. Friston,et al.  Neural masses and fields in dynamic causal modeling , 2013, Front. Comput. Neurosci..

[29]  Scott W. Linderman,et al.  BAYESIAN LATENT STATE SPACE MODELS OF NEURAL ACTIVITY , 2015 .

[30]  Jonathan Touboul,et al.  Finite-size and correlation-induced effects in mean-field dynamics , 2010, Journal of Computational Neuroscience.

[31]  A. Beaudet,et al.  Mice Lacking Specific Nicotinic Acetylcholine Receptor Subunits Exhibit Dramatically Altered Spontaneous Activity Patterns and Reveal a Limited Role for Retinal Waves in Forming ON and OFF Circuits in the Inner Retina , 2000, The Journal of Neuroscience.

[32]  Matthias H Hennig,et al.  Early-Stage Waves in the Retinal Network Emerge Close to a Critical State Transition between Local and Global Functional Connectivity , 2009, The Journal of Neuroscience.

[33]  Il Memming Park,et al.  Recursive Variational Bayesian Dual Estimation for Nonlinear Dynamics and Non-Gaussian Observations , 2017 .

[34]  Luca Berdondini,et al.  Sloppiness in Spontaneously Active Neuronal Networks , 2015, The Journal of Neuroscience.

[35]  Il Memming Park,et al.  Variational Joint Filtering , 2017, 1707.09049.

[36]  Guido Sanguinetti,et al.  The complex chemical Langevin equation. , 2014, The Journal of chemical physics.

[37]  Eric Shea-Brown,et al.  Linking structure and activity in nonlinear spiking networks , 2016 .

[38]  Bard Ermentrout,et al.  A Model for the Origin and Properties of Flicker-Induced Geometric Phosphenes , 2011, PLoS Comput. Biol..

[39]  Michael A. Buice,et al.  Systematic Fluctuation Expansion for Neural Network Activity Equations , 2009, Neural Computation.

[40]  Matthias H Hennig,et al.  Age-dependent Homeostatic Plasticity of GABAergic Signaling in Developing Retinal Networks , 2011, The Journal of Neuroscience.

[41]  W. Ebeling Stochastic Processes in Physics and Chemistry , 1995 .

[42]  Botond Cseke,et al.  Sparse Approximate Inference for Spatio-Temporal Point Process Models , 2013, 1305.4152.

[43]  P. Bressloff Spatiotemporal dynamics of continuum neural fields , 2012 .

[44]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[45]  F. Werblin,et al.  Requirement for Cholinergic Synaptic Transmission in the Propagation of Spontaneous Retinal Waves , 1996, Science.

[46]  John P. Cunningham,et al.  Empirical models of spiking in neural populations , 2011, NIPS.

[47]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[48]  Elijah Roberts,et al.  Approximation and inference methods for stochastic biochemical kinetics—a tutorial review , 2017 .

[49]  AmariShun-Ichi Dynamics of pattern formation in lateral-inhibition type neural fields , 1977 .

[50]  Z. J. Zhou,et al.  Coordinated Transitions in Neurotransmitter Systems for the Initiation and Propagation of Spontaneous Retinal Waves , 2000, The Journal of Neuroscience.

[51]  T. Sejnowski,et al.  Neurocomputational models of working memory , 2000, Nature Neuroscience.

[52]  Grant M. Fiddyment,et al.  Human seizures couple across spatial scales through travelling wave dynamics , 2017, Nature Communications.

[53]  Cheng Ly,et al.  Critical Analysis of Dimension Reduction by a Moment Closure Method in a Population Density Approach to Neural Network Modeling , 2007, Neural Computation.

[54]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[55]  Guido Sanguinetti,et al.  Autoregressive Point Processes as Latent State-Space Models: A Moment-Closure Approach to Fluctuations and Autocorrelations , 2018, Neural Computation.

[56]  J. Cowan,et al.  A mathematical theory of visual hallucination patterns , 1979, Biological Cybernetics.

[57]  J. Cowan,et al.  Field-theoretic approach to fluctuation effects in neural networks. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[58]  Chethan Pandarinath,et al.  LFADS - Latent Factor Analysis via Dynamical Systems , 2016, ArXiv.

[59]  Wei Wu,et al.  A new look at state-space models for neural data , 2010, Journal of Computational Neuroscience.

[60]  N. Kampen,et al.  Stochastic processes in physics and chemistry , 1981 .

[61]  Guido Sanguinetti,et al.  Corrigendum: Approximation and inference methods for stochastic biochemical kinetics—a tutorial review (2017 J. Phys. A: Math. Theor. 50 093001 ) , 2018 .

[62]  Jack D. Cowan,et al.  A Personal Account of the Development of the Field Theory of Large-Scale Brain Activity from 1945 Onward , 2014 .

[63]  R. Masland,et al.  The Major Cell Populations of the Mouse Retina , 1998, The Journal of Neuroscience.

[64]  Seunghoon Lee,et al.  A transient network of intrinsically bursting starburst cells underlies the generation of retinal waves , 2006, Nature Neuroscience.

[65]  Kianoush Nazarpour,et al.  EMG Prediction From Motor Cortical Recordings via a Nonnegative Point-Process Filter , 2012, IEEE Transactions on Biomedical Engineering.

[66]  Paul C. Bressloff,et al.  Stochastic Neural Field Theory and the System-Size Expansion , 2009, SIAM J. Appl. Math..

[67]  G. Verghese,et al.  Mass fluctuation kinetics: capturing stochastic effects in systems of chemical reactions through coupled mean-variance computations. , 2007, The Journal of chemical physics.

[68]  Emery N. Brown,et al.  Estimating a State-space Model from Point Process Observations Emery N. Brown , 2022 .

[69]  Leo A. Goodman,et al.  Population Growth of the Sexes , 1953 .

[70]  Evelyn Buckwar,et al.  Laws of Large Numbers and Langevin Approximations for Stochastic Neural Field Equations , 2013, Journal of mathematical neuroscience.

[71]  J. Cowan,et al.  Statistical mechanics of the neocortex. , 2009, Progress in biophysics and molecular biology.

[72]  Michael P H Stumpf,et al.  A general moment expansion method for stochastic kinetic models. , 2013, The Journal of chemical physics.

[73]  Ohira,et al.  Master-equation approach to stochastic neurodynamics. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[74]  P. Whittle On the Use of the Normal Approximation in the Treatment of Stochastic Processes , 1957 .

[75]  L. Paninski Maximum likelihood estimation of cascade point-process neural encoding models , 2004, Network.

[76]  Luca Berdondini,et al.  Following the ontogeny of retinal waves: pan-retinal recordings of population dynamics in the neonatal mouse , 2013, The Journal of physiology.

[77]  C. Shatz,et al.  Dynamic Processes Shape Spatiotemporal Properties of Retinal Waves , 1997, Neuron.

[78]  D. Baylor,et al.  Synchronous bursts of action potentials in ganglion cells of the developing mammalian retina. , 1991, Science.

[79]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.