Efficient Inference of Flexible Interaction in Spiking-neuron Networks

Hawkes process provides an effective statistical framework for analyzing the time-dependent interaction of neuronal spiking activities. Although utilized in many real applications, the classic Hawkes process is incapable of modelling inhibitory interactions among neurons. Instead, the nonlinear Hawkes process allows for a more flexible influence pattern with excitatory or inhibitory interactions. In this paper, three sets of auxiliary latent variables (Polya-Gamma variables, latent marked Poisson processes and sparsity variables) are augmented to make functional connection weights in a Gaussian form, which allows for a simple iterative algorithm with analytical updates. As a result, an efficient expectation-maximization (EM) algorithm is derived to obtain the maximum a posteriori (MAP) estimate. We demonstrate the accuracy and efficiency performance of our algorithm on synthetic and real data. For real neural recordings, we show our algorithm can estimate the temporal dynamics of interaction and reveal the interpretable functional connectivity underlying neural spike trains.

[1]  G. Mongillo,et al.  Inhibitory connectivity defines the realm of excitatory plasticity , 2018, Nature Neuroscience.

[2]  Y. Ogata.  Space-Time Point-Process Models for Earthquake Occurrences , 1998 .

[3]  L. Paninski.  Maximum likelihood estimation of cascade point-process neural encoding models , 2004, Network.

[4]  Manfred Opper,et al.  Inverse Ising problem in continuous time: A latent variable approach. , 2017, Physical review. E.

[5]  Manfred Opper,et al.  Efficient Bayesian Inference of Sigmoidal Gaussian Cox Processes , 2018, J. Mach. Learn. Res..

[6]  Didier Sornette,et al.  Apparent criticality and calibration issues in the Hawkes self-excited point process model: application to high-frequency financial data , 2013, 1308.6756.

[7]  A. Hawkes.  Spectra of some self-exciting and mutually exciting point processes , 1971 .

[8]  Emery N. Brown,et al.  Dynamic Analysis of Neural Encoding by Point Process Adaptive Filtering , 2004, Neural Computation.

[9]  Le Song,et al.  Learning Triggering Kernels for Multi-dimensional Hawkes Processes , 2013, ICML.

[10]  P. Brémaud,et al.  STABILITY OF NONLINEAR HAWKES PROCESSES , 1996 .

[11]  D. Sornette,et al.  Generating functions and stability study of multivariate self-excited epidemic processes , 2011, 1101.5564.

[12]  Swapnil Mishra,et al.  SIR-Hawkes: Linking Epidemic Models and Hawkes Processes to Model Diffusions in Finite Populations , 2017, WWW.

[13]  Y. Ogata.  Seismicity Analysis through Point-process Modeling: A Review , 1999 .

[14]  James G. Scott,et al.  Bayesian Inference for Logistic Models Using Pólya–Gamma Latent Variables , 2012, 1205.0310.

[15]  S. Nelson,et al.  Selective reconfiguration of layer 4 visual cortical circuitry by visual deprivation , 2004, Nature Neuroscience.

[16]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[17]  Daryl J. Daley,et al.  An Introduction to the Theory of Point Processes , 2013 .

[18]  Massimiliano Pontil,et al.  On the Noise Model of Support Vector Machines Regression , 2000, ALT.

[19]  Erik A. Lewis,et al.  Self-exciting point process models of civilian deaths in Iraq , 2011, Security Journal.

[20]  Felipe Gerhard,et al.  On the stability and dynamics of stochastic spiking neuron models: Nonlinear Hawkes process and point process GLMs , 2017, PLoS Comput. Biol..

[21]  R. Kass,et al.  Multiple neural spike train data analysis: state-of-the-art and future challenges , 2004, Nature Neuroscience.

[22]  T. Ozaki.  Maximum likelihood estimation of Hawkes' self-exciting point processes , 1979 .

[23]  Scott W. Linderman.  Bayesian Methods for Discovering Structure in Neural Spike Trains , 2016 .

[24]  Scott W. Linderman,et al.  Mutually Regressive Point Processes , 2019, NeurIPS.

[25]  George E. Tita,et al.  Self-Exciting Point Process Modeling of Crime , 2011 .

[26]  Vincent Rivoirard,et al.  Inference of functional connectivity in Neurosciences via Hawkes processes , 2013, 2013 IEEE Global Conference on Signal and Information Processing.

[27]  Robert E. Kass,et al.  A Spike-Train Probability Model , 2001, Neural Computation.

[28]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. , 1967, Biophysical journal.

[29]  E. Bacry,et al.  Hawkes Processes in Finance , 2015, 1502.04592.

[30]  A. Thomson,et al.  Interlaminar connections in the neocortex. , 2003, Cerebral cortex.