A Monte Carlo Sequential Estimation for Point Process Optimum Filtering

Adaptive filtering is normally utilized to estimate system states or outputs from continuous valued observations, and it is of limited use when the observations are discrete events. Recently a Bayesian approach to reconstruct the state from the discrete point observations has been proposed. However, it assumes the posterior density of the state given the observations is Gaussian distributed, which is in general restrictive. We propose a Monte Carlo sequential estimation methodology to estimate directly the posterior density. Sample observations are generated at each time to recursively evaluate the posterior density more accurately. The state estimation is obtained easily by collapse, i.e. by smoothing the posterior density with Gaussian kernels to estimate its mean. The algorithm is tested in a simulated neural spike train decoding experiment and reconstructs better the velocity when compared with point process adaptive filtering algorithm with the Gaussian assumption.

[1]  M. Hinich.  Testing for Gaussianity and Linearity of a Stationary Time Series. , 1982 .

[2]  Michael J. Black,et al.  Modeling and decoding motor cortical activity using a switching Kalman filter , 2004, IEEE Transactions on Biomedical Engineering.

[3]  T. Rao,et al.  An Introduction to Bispectral Analysis and Bilinear Time Series Models , 1984 .

[4]  G. Weiss.  TIME-REVERSIBILITY OF LINEAR STOCHASTIC PROCESSES , 1975 .

[5]  Tohru Ozaki,et al.  Testing for nonlinearity in high-dimensional time series from continuous dynamics , 2001 .

[6]  Cees Diks,et al.  Reversibility as a criterion for discriminating time series , 1995 .

[7]  T. Schreiber.  Interdisciplinary application of nonlinear time series methods , 1998, chao-dyn/9807001.

[8]  S. Sheather.  Density Estimation , 2004 .

[9]  Simon J. Godsill,et al.  On sequential Monte Carlo sampling methods for Bayesian filtering , 2000, Stat. Comput..

[10]  E. Lorenz.  Deterministic nonperiodic flow , 1963 .

[11]  Danilo P. Mandic,et al.  A novel method for determining the nature of time series , 2004, IEEE Transactions on Biomedical Engineering.

[12]  P. Grassberger,et al.  Measuring the Strangeness of Strange Attractors , 1983 .

[13]  R E Kass,et al.  Recursive bayesian decoding of motor cortical signals by particle filtering. , 2004, Journal of neurophysiology.

[14]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[15]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[16]  José Carlos Príncipe,et al.  Generalized correlation function: definition, properties, and application to blind equalization , 2006, IEEE Transactions on Signal Processing.

[17]  P. P. Pokharel,et al.  Correntropy Based Matched Filtering , 2005, 2005 IEEE Workshop on Machine Learning for Signal Processing.

[18]  José Carlos Príncipe,et al.  Correntropy as a Novel Measure for Nonlinearity Tests , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[19]  Petre Stoica,et al.  Spectral Analysis of Signals , 2009 .

[20]  S. Basu,et al.  Detection of nonlinearity and chaoticity in time series using the transportation distance function , 2002 .

[21]  T. Schreiber,et al.  Discrimination power of measures for nonlinearity in a time series , 1997, chao-dyn/9909043.

[22]  Brian Warner,et al.  Whole Earth Telescope observations of the interacting binary white dwarf V803 CEN in its low state. , 1990 .

[23]  Deniz Erdoğmuş.  INFORMATION THEORETIC LEARNING: RENYI'S ENTROPY AND ITS APPLICATIONS TO ADAPTIVE SYSTEM TRAINING , 2002 .

[24]  Nello Cristianini,et al.  The Kernel-Adatron : A fast and simple learning procedure for support vector machines , 1998, ICML 1998.

[25]  Schreiber,et al.  Improved Surrogate Data for Nonlinearity Tests. , 1996, Physical review letters.

[26]  James Theiler,et al.  Detecting Nonlinearity in Data with Long Coherence Times , 1993, comp-gas/9302003.

[27]  Philip Rothman,et al.  Time Irreversibility and Business Cycle Asymmetry , 1996 .

[28]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[29]  Steven M. Pincus,et al.  A regularity statistic for medical data analysis , 1991, Journal of Clinical Monitoring.

[30]  T. Schreiber,et al.  Surrogate time series , 1999, chao-dyn/9909037.

[31]  M. Hinich,et al.  Detecting Nonlinearity in Time Series: Surrogate and Bootstrap Approaches , 2005 .

[32]  P. Fearnhead,et al.  An improved particle filter for non-linear problems , 1999 .

[33]  J. Yorke,et al.  Chaos: An Introduction to Dynamical Systems , 1997 .

[34]  Niclas Bergman,et al.  Recursive Bayesian Estimation : Navigation and Tracking Applications , 1999 .

[35]  Michael I. Jordan,et al.  Kernel independent component analysis , 2003 .

[36]  E N Brown,et al.  An analysis of neural receptive field plasticity by point process adaptive filtering , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[37]  P. Fearnhead,et al.  Improved particle filter for nonlinear problems , 1999 .

[38]  Radhakrishnan Nagarajan,et al.  Surrogate testing of linear feedback processes with non-Gaussian innovations , 2005, cond-mat/0510517.

[39]  Hübner,et al.  Dimensions and entropies of chaotic intensity pulsations in a single-mode far-infrared NH3 laser. , 1989, Physical review. A, General physics.

[40]  Emery N. Brown,et al.  The Time-Rescaling Theorem and Its Application to Neural Spike Train Data Analysis , 2002, Neural Computation.

[41]  Emery N. Brown,et al.  Dynamic Analysis of Neural Encoding by Point Process Adaptive Filtering , 2004, Neural Computation.

[42]  M. Hulle,et al.  The Delay Vector Variance Method for Detecting Determinism and Nonlinearity in Time Series , 2004 .

[43]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[44]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[45]  Donald O. Walter,et al.  Mass action in the nervous system , 1975 .

[46]  N. Gordon,et al.  Novel approach to nonlinear/non-Gaussian Bayesian state estimation , 1993 .

[47]  A B Schwartz,et al.  Motor cortical representation of speed and direction during reaching. , 1999, Journal of neurophysiology.

[48]  M. Quirk,et al.  Experience-Dependent Asymmetric Shape of Hippocampal Receptive Fields , 2000, Neuron.

[49]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[50]  Holger Kantz,et al.  Practical implementation of nonlinear time series methods: The TISEAN package. , 1998, Chaos.

[51]  Leon Glass,et al.  Coarse-grained embeddings of time series: random walks, Gaussian random processes, and deterministic chaos , 1993 .

[52]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[53]  J M Nichols,et al.  Detecting nonlinearity in structural systems using the transfer entropy. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  C. Diks.  Nonlinear time series analysis , 1999 .

[55]  H. Kantz,et al.  Nonlinear time series analysis , 1997 .

[56]  H. Kantz,et al.  Dimension estimates and physiological data. , 1995, Chaos.