Approximate Methods for State-Space Models

State-space models provide an important body of techniques for analyzing time series, but their use requires estimating unobserved states. The optimal estimate of the state is its conditional expectation given the observation histories, and computing this expectation is hard when there are nonlinearities. Existing filtering methods, including sequential Monte Carlo, tend to be either inaccurate or slow. In this paper, we study a nonlinear filter for nonlinear/non-Gaussian state-space models, which uses Laplace’s method, an asymptotic series expansion, to approximate the state’s conditional mean and variance, together with a Gaussian conditional distribution. This Laplace Gaussian filter (LGF) gives fast, recursive, deterministic state estimates, with an error which is set by the stochastic characteristics of the model and is, we show, stable over time. We illustrate the estimation ability of the LGF by applying it to the problem of neural decoding and compare it to sequential Monte Carlo both in simulations and with real data. We find that the LGF can deliver superior results in a small fraction of the computing time. This article has supplementary material online.

[1]  B. Anderson,et al.  Optimal Filtering , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[2]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[3]  R. E. Kass Computing observed information by finite differences , 1987 .

[4]  G. Kitagawa Non-Gaussian State—Space Modeling of Nonstationary Time Series , 1987 .

[5]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. III. Positional gradients and population coding of movement direction from various movement origins , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  L. Tierney,et al.  Fully Exponential Laplace Approximations to Expectations and Variances of Nonpositive Functions , 1989 .

[7]  L. Tierney,et al.  The validity of posterior expansions based on Laplace''s method , 1990 .

[8]  M. Evans,et al.  Methods for Approximating Integrals in Statistics with Special Emphasis on Bayesian Integration Problems , 1995 .

[9]  G. Kitagawa Monte Carlo Filter and Smoother for Non-Gaussian Nonlinear State Space Models , 1996 .

[10]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[11]  Bernard Hanzon,et al.  A differential geometric approach to nonlinear filtering: the projection filter , 1998, IEEE Trans. Autom. Control..

[12]  E N Brown,et al.  A Statistical Paradigm for Neural Spike Train Decoding Applied to Position Prediction from Ensemble Firing Patterns of Rat Hippocampal Place Cells , 1998, The Journal of Neuroscience.

[13]  N. U. Ahmed,et al.  Linear and Nonlinear Filtering for Scientists and Engineers , 1999 .

[14]  P. Moral,et al.  Branching and interacting particle systems. Approximations of Feynman-Kac formulae with applications to non-linear filtering , 2000 .

[15]  Emery N. Brown,et al.  The Time-Rescaling Theorem and Its Application to Neural Spike Train Data Analysis , 2002, Neural Computation.

[16]  Nicholas G. Hatsopoulos,et al.  Brain-machine interface: Instant neural control of a movement signal , 2002, Nature.

[17]  David S. Stoffer Time series analysis by state space models: J. Durbin and S. J. Koopman; Oxford University Press, Oxford, 2001, pp 253 + xvii, ISBN: 0 19 852354 8 , 2003, Autom..

[18]  Timothy J. Robinson,et al.  Sequential Monte Carlo Methods in Practice , 2003 .

[19]  Andrew B Schwartz,et al.  Cortical neural prosthetics. , 2004, Annual review of neuroscience.

[20]  R E Kass,et al.  Recursive bayesian decoding of motor cortical signals by particle filtering. , 2004, Journal of neurophysiology.

[21]  Emery N. Brown,et al.  Dynamic Analysis of Neural Encoding by Point Process Adaptive Filtering , 2004, Neural Computation.

[22]  L. Paninski,et al.  Spatiotemporal tuning of motor cortical neurons for hand position and velocity. , 2004, Journal of neurophysiology.

[23]  P. S. Krishnaprasad,et al.  Approximate nonlinear filtering and its application in navigation , 2005, Autom..

[24]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[25]  Arnaud Doucet,et al.  Sequential Monte Carlo Methods , 2006, Handbook of Graphical Models.

[26]  R. Serfling,et al.  Asymptotic Expansions—I , 2006 .

[27]  John Wojdylo,et al.  On the coefficients that arise from Laplace's method , 2006 .

[28]  Michael J. Black,et al.  Decoding grasp aperture from motor-cortical population activity , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[29]  Matthew A. Wilson,et al.  Construction of Point Process Adaptive Filter Algorithms for Neural Systems Using Sequential Monte Carlo Methods , 2007, IEEE Transactions on Biomedical Engineering.

[30]  Sherwin S Chan,et al.  Motor cortical representation of position and velocity during reaching. , 2007, Journal of neurophysiology.

[31]  Robert E. Kass,et al.  Statistical Signal Processing and the Motor Cortex , 2007, Proceedings of the IEEE.

[32]  Andrew S. Whitford,et al.  Cortical control of a prosthetic arm for self-feeding , 2008, Nature.