A Reproducing Kernel Hilbert Space Framework for Spike Train Signal Processing

This letter presents a general framework based on reproducing kernel Hilbert spaces (RKHS) to mathematically describe and manipulate spike trains. The main idea is the definition of inner products to allow spike train signal processing from basic principles while incorporating their statistical description as point processes. Moreover, because many inner products can be formulated, a particular definition can be crafted to best fit an application. These ideas are illustrated by the definition of a number of spike train inner products. To further elicit the advantages of the RKHS framework, a family of these inner products, the cross-intensity (CI) kernels, is analyzed in detail. This inner product family encapsulates the statistical description from the conditional intensity functions of spike trains. The problem of their estimation is also addressed. The simplest of the spike train kernels in this family provide an interesting perspective to others' work, as will be demonstrated in terms of spike train distance measures. Finally, as an application example, the RKHS framework is used to derive a clustering algorithm for spike trains from simple principles.

[1]  Robert Jenssen,et al.  Information Theoretic Learning and Kernel Methods , 2009 .

[2]  Rolf-Dieter Reiss,et al.  A Course on Point Processes , 1992 .

[3]  Mark C. W. van Rossum,et al.  A Novel Spike Distance , 2001, Neural Computation.

[4]  G. Wahba.  Spline models for observational data , 1990 .

[5]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[6]  Daniel Richardson,et al.  Linear Algebra for Time Series of Spikes , 2005, ESANN.

[7]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[8]  Benjamin Schrauwen,et al.  Linking non-binned spike train kernels to several existing spike train metrics , 2006, ESANN.

[9]  G. P. Moore,et al.  Neuronal spike trains and stochastic point processes. II. Simultaneous spike trains. , 1967, Biophysical journal.

[10]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[11]  Bernhard Schölkopf,et al.  Nonlinear Component Analysis as a Kernel Eigenvalue Problem , 1998, Neural Computation.

[12]  S. R. Jammalamadaka,et al.  Directional Statistics, I , 2011 .

[13]  J. Marron,et al.  Equivalence of Smoothing Parameter Selectors in Density and Intensity Estimation , 1988 .

[14]  Jonathan D. Victor,et al.  Metric-space analysis of spike trains: theory, algorithms and application , 1998, q-bio/0309031.

[15]  H. Spitzer,et al.  Temporal encoding of two-dimensional patterns by single units in primate primary visual cortex. I. Stimulus-response relations. , 1990, Journal of neurophysiology.

[16]  Uri T Eden,et al.  A point process framework for relating neural spiking activity to spiking history, neural ensemble, and extrinsic covariate effects. , 2005, Journal of neurophysiology.

[17]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[18]  Thomas Kailath,et al.  An RKHS approach to detection and estimation problems-II: Gaussian signal detection , 1975, IEEE Trans. Inf. Theory.

[19]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[20]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[21]  C. Berg,et al.  Harmonic Analysis on Semigroups: Theory of Positive Definite and Related Functions , 1984 .

[22]  Grace Wahba,et al.  Spline Models for Observational Data , 1990 .

[23]  Robert E. Kass,et al.  A Spike-Train Probability Model , 2001, Neural Computation.

[24]  R. Kass,et al.  Statistical smoothing of neuronal data. , 2003, Network.

[25]  Il Memming Park,et al.  Optimization in Reproducing kernel Hilbert Spaces of Spike Trains , 2010 .

[26]  Zhiyi Chi,et al.  Temporal Precision and Temporal Drift in Brain and Behavior of Zebra Finch Song , 2001, Neuron.

[27]  Paul H. E. Tiesinga,et al.  A New Correlation-Based Measure of Spike Timing Reliability , 2002, Neurocomputing.

[28]  M. Teich,et al.  Fractal-Based Point Processes , 2005 .

[29]  C. Berg,et al.  Harmonic Analysis on Semigroups , 1984 .

[30]  Robert E Kass,et al.  Statistical issues in the analysis of neuronal data. , 2005, Journal of neurophysiology.

[31]  Steven B. Lowen,et al.  Fractal-Based Point Processes: Teich/Fractal-Based , 2005 .

[32]  D. Harville.  Matrix Algebra From a Statistician's Perspective , 1998 .

[33]  José Carlos Príncipe,et al.  Reproducing kernel Hilbert spaces for spike train analysis , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[34]  Charles N. Moore,et al.  On the developments in Bessel's functions , 1916 .

[35]  Jonathan D Victor,et al.  Spike train metrics , 2005, Current Opinion in Neurobiology.

[37]  Nicholas G Hatsopoulos,et al.  Template-based spike pattern identification with linear convolution and dynamic time warping. , 2007, Journal of neurophysiology.

[38]  Sander M. Bohte,et al.  Error-backpropagation in temporally encoded networks of spiking neurons , 2000, Neurocomputing.

[39]  Thomas Kailath,et al.  RKHS approach to detection and estimation problems-I: Deterministic signals in Gaussian noise , 1971, IEEE Trans. Inf. Theory.

[40]  E. Parzen.  On Estimation of a Probability Density Function and Mode , 1962 .

[41]  José Carlos Príncipe,et al.  Spectral Clustering of Synchronous Spike Trains , 2007, 2007 International Joint Conference on Neural Networks.

[42]  José Carlos Príncipe,et al.  Kernel Principal Components Are Maximum Entropy Projections , 2006, ICA.

[43]  N. Aronszajn.  Theory of Reproducing Kernels. , 1950 .

[44]  R. Kass,et al.  Multiple neural spike train data analysis: state-of-the-art and future challenges , 2004, Nature Neuroscience.