Approximate Bayesian Estimation of Varying Binomial Process

Bayesian methods are often applied for estimating the event rate from a series of event occurrences. However, the Bayesian posterior distribution requires the computation of the marginal likelihood which generally involves an analytically intractable integration. As an event rate is defined in a very high dimensional space, it is computationally demanding to obtain the Bayesian posterior distribution for the rate. We estimate the rate underlying a sequence of event counts by deriving an approximate Bayesian inference algorithm for the time-varying binomial process. This enables us to calculate the posterior distribution analytically. We also provide a method for estimating the prior hyperparameter, which determines the smoothness of the estimated event rate. Moreover, we provide an efficient method to compute the upper and lower bounds of the marginal likelihood, which evaluate the approximation accuracy. Numerical experiments demonstrate the effectiveness of the proposed method in terms of the estimation accuracy.

[1]  Emery N. Brown,et al.  Estimating a State-space Model from Point Process Observations Emery N. Brown , 2022 .

[2]  Kazuho Watanabe,et al.  Transfer Matrix Method for Instantaneous Spike Rate Estimation , 2009, IEICE Trans. Inf. Syst..

[3]  J. Heikkinen,et al.  An algorithm for nonparametric Bayesian estimation of a Poisson intensity , 1996 .

[4]  Kazuho Watanabe,et al.  Firing Rate Estimation Using an Approximate Bayesian Method , 2008, International Conference on Neural Information Processing.

[5]  Ludwig Fahrmeir,et al.  9. Dynamic Discrete-Time Duration Models: Estimation Viamarkov Chain Monte Carlo , 1997 .

[6]  Kazuho Watanabe,et al.  Divergence measures and a general framework for local variational approximation , 2011, Neural Networks.

[7]  A. Davison,et al.  Some Models for Discretized Series of Events , 1996 .

[8]  Shigeru Shinomoto,et al.  Empirical Bayes interpretations of random point events , 2005 .

[9]  Shigeru Shinomoto,et al.  Phase transitions in the estimation of event rate: a path integral analysis , 2007 .

[10]  Shigeru Shinomoto,et al.  A Method for Selecting the Bin Size of a Time Histogram , 2007, Neural Computation.

[11]  Michael I. Jordan,et al.  Bayesian parameter estimation via variational methods , 2000, Stat. Comput..

[12]  Yasuhiro Omori DISCRETE DURATION MODEL HAVING AUTOREGRESSIVE RANDOM EFFECTS WITH APPLICATION TO JAPANESE DIFFUSION INDEX , 2003 .

[13]  Michael I. Jordan,et al.  Computing upper and lower bounds on likelihoods in intractable networks , 1996, UAI.

[14]  John P. Cunningham,et al.  Fast Gaussian process methods for point process intensity estimation , 2008, ICML '08.

[15]  D. Rubin,et al.  Maximum likelihood from incomplete data via the EM - algorithm plus discussions on the paper , 1977 .

[16]  John P. Cunningham,et al.  Methods for estimating neural firing rates, and their application to brain-machine interfaces , 2009, Neural Networks.