System identification of point-process neural systems using Probability Based Volterra kernels

BACKGROUND Neural information processing involves a series of nonlinear dynamical input/output transformations between the spike trains of neurons/neuronal ensembles. Understanding and quantifying these transformations is critical both for understanding neural physiology such as short-term potentiation and for developing cognitive neural prosthetics. NEW METHOD A novel method for estimating Volterra kernels for systems with point-process inputs and outputs is developed based on elementary probability theory. These Probability Based Volterra (PBV) kernels essentially describe the probability of an output spike given q input spikes at various lags t1, t2, …, tq. RESULTS The PBV kernels are used to estimate both synthetic systems where ground truth is available and data from the CA3 and CA1 regions rodent hippocampus. The PBV kernels give excellent predictive results in both cases. Furthermore, they are shown to be quite robust to noise and to have good convergence and overfitting properties. Through a slight modification, the PBV kernels are shown to also deal well with correlated point-process inputs. COMPARISON WITH EXISTING METHODS The PBV kernels were compared with kernels estimated through least squares estimation (LSE) and through the Laguerre expansion technique (LET). The LSE kernels were shown to fair very poorly with real data due to the large amount of input noise. Although the LET kernels gave the best predictive results in all cases, they require prior parameter estimation. It was shown how the PBV and LET methods can be combined synergistically to maximize performance. CONCLUSIONS The PBV kernels provide a novel and intuitive method of characterizing point-process input-output nonlinear systems.

[1]  V.Z. Marmarelis,et al.  Modeling of neural systems by use of neuronal modes , 1993, IEEE Transactions on Biomedical Engineering.

[2]  A. W. Liley,et al.  An electrical investigation of effects of repetitive stimulation on mammalian neuromuscular junction. , 1953, Journal of neurophysiology.

[3]  B. Katz,et al.  The role of calcium in neuromuscular facilitation , 1968, The Journal of physiology.

[4]  V. Z. Marmarelis,et al.  Modeling of Nonlinear Physiological Systems with Fast and Slow Dynamics. II. Application to Cerebral Autoregulation , 2002, Annals of Biomedical Engineering.

[5]  Alice K. Cho,et al.  Retinal prostheses: current clinical results and future needs. , 2011, Ophthalmology.

[6]  Robert E. Hampson,et al.  A Hippocampal Cognitive Prosthesis: Multi-Input, Multi-Output Nonlinear Modeling and VLSI Implementation , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[7]  I. Hunter,et al.  The identification of nonlinear biological systems: Volterra kernel approaches , 1996, Annals of Biomedical Engineering.

[8]  J. Touryan,et al.  Spatial Structure of Complex Cell Receptive Fields Measured with Natural Images , 2005, Neuron.

[9]  Theodore W. Berger,et al.  Nonlinear Dynamic Modeling of Synaptically Driven Single Hippocampal Neuron Intracellular Activity , 2011, IEEE Transactions on Biomedical Engineering.

[10]  Theodore W. Berger,et al.  Boolean Modeling of Neural Systems with Point-Process Inputs and Outputs. Part I: Theory and Simulations , 2009, Annals of Biomedical Engineering.

[11]  W. Betz,et al.  Depression of transmitter release at the neuromuscular junction of the frog , 1970, The Journal of physiology.

[12]  J. Eggermont Wiener and Volterra analyses applied to the auditory system , 1993, Hearing Research.

[13]  P. Z. Marmarelis,et al.  Analysis of Physiological Systems: The White-Noise Approach , 2011 .

[14]  N. Wiener,et al.  Nonlinear Problems in Random Theory , 1964 .

[15]  Silvestro Micera,et al.  Development of a closed-loop neural prosthesis for vestibular disorders , 2010 .

[16]  E. Brown,et al.  A point-process model of human heartbeat intervals: new definitions of heart rate and heart rate variability. , 2005, American journal of physiology. Heart and circulatory physiology.

[17]  Theodore W. Berger,et al.  Parametric and non-parametric modeling of short-term synaptic plasticity. Part I: computational study , 2009, Journal of Computational Neuroscience.

[18]  Theodoros P. Zanos,et al.  Nonlinear Modeling of Causal Interrelationships in Neuronal Ensembles , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Jon A. Mukand,et al.  Neuronal ensemble control of prosthetic devices by a human with tetraplegia , 2006, Nature.

[20]  V. Z. Marmarelis,et al.  Modeling of Nonlinear Physiological Systems with Fast and Slow Dynamics. I. Methodology , 2002, Annals of Biomedical Engineering.

[21]  B. Melamed,et al.  Traffic modeling for telecommunications networks , 1994, IEEE Communications Magazine.

[22]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[23]  Joaquín Rapela,et al.  Estimating nonlinear receptive fields from natural images. , 2006, Journal of vision.

[24]  S A Deadwyler,et al.  Design of optimal stimulation patterns for neuronal ensembles based on Volterra-type hierarchical modeling , 2012, Journal of neural engineering.

[25]  Luca Citi,et al.  Point-Process Nonlinear Models With Laguerre and Volterra Expansions: Instantaneous Assessment of Heartbeat Dynamics , 2013, IEEE Transactions on Signal Processing.

[26]  Jonathan D. Victor,et al.  Metric-space analysis of spike trains: theory, algorithms and application , 1998, q-bio/0309031.

[27]  K. Naka,et al.  Identification of multi-input biological systems. , 1974, IEEE transactions on bio-medical engineering.

[28]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[29]  Marija Cotic,et al.  Transformation of neuronal modes associated with low-Mg2 + /high-K +  conditions in an in vitro model of epilepsy , 2010, Journal of biological physics.

[30]  Anatol C. Kreitzer,et al.  Interplay between Facilitation, Depression, and Residual Calcium at Three Presynaptic Terminals , 2000, The Journal of Neuroscience.

[31]  Robert E. Hampson,et al.  Nonlinear modeling of dynamic interactions within neuronal ensembles using Principal Dynamic Modes , 2012, Journal of Computational Neuroscience.

[32]  N. C. Singh,et al.  Estimating spatio-temporal receptive fields of auditory and visual neurons from their responses to natural stimuli , 2001 .

[33]  Lucas M. Santos,et al.  Facilitation and restoration of cognitive function in primate prefrontal cortex by a neuroprosthesis that utilizes minicolumn-specific neural firing , 2012, Journal of neural engineering.

[34]  Eero P. Simoncelli,et al.  Spike-triggered neural characterization. , 2006, Journal of vision.

[35]  M. C. Citron,et al.  Minimum-order Wiener modelling of spike-output systems , 2004, Biological Cybernetics.

[36]  Torsten Söderström,et al.  Identification of stochastic linear systems in presence of input noise , 1981, Autom..

[37]  Attahiru Sule Alfa,et al.  Modelling Vehicular Traffic Using the Discrete Time Markovian Arrival Process , 1995, Transp. Sci..

[38]  T. Berger,et al.  General methodology for nonlinear modeling of neural systems with Poisson point-process inputs. , 2005, Mathematical biosciences.

[39]  William Bialek,et al.  Real-time performance of a movement-sensitive neuron in the blowfly visual system: coding and information transfer in short spike sequences , 1988, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[40]  Vasilis Z. Marmarelis,et al.  Nonlinear Dynamic Modeling of Physiological Systems , 2004 .

[41]  P Kuyper,et al.  Triggered correlation. , 1968, IEEE transactions on bio-medical engineering.

[42]  P Z Marmarelis,et al.  Nonlinear analysis and synthesis of receptive-field responses in the catfish retina. I. Horizontal cell leads to ganglion cell chain. , 1973, Journal of neurophysiology.

[43]  Adrienne L Fairhall,et al.  Two-Dimensional Time Coding in the Auditory Brainstem , 2005, The Journal of Neuroscience.

[44]  Mark C. W. van Rossum,et al.  A Novel Spike Distance , 2001, Neural Computation.

[45]  Zhuo Wang,et al.  Parametric and non-parametric modeling of short-term synaptic plasticity. Part II: Experimental study , 2009, Journal of Computational Neuroscience.

[46]  H. Gundersen,et al.  Unbiased stereological estimation of the total number of neurons in the subdivisions of the rat hippocampus using the optical fractionator , 1991, The Anatomical record.

[47]  H. I. Krausz,et al.  Identification of nonlinear systems using random impulse train inputs , 1975, Biological Cybernetics.

[48]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[49]  G E Loeb,et al.  BION system for distributed neural prosthetic interfaces. , 2001, Medical engineering & physics.

[50]  Y. W. Lee,et al.  Measurement of the Wiener Kernels of a Non-linear System by Cross-correlation† , 1965 .

[51]  M. Korenberg,et al.  Exact orthogonal kernel estimation from finite data records: Extending Wiener's identification of nonlinear systems , 1988, Annals of Biomedical Engineering.

[52]  Robert E. Hampson,et al.  Nonlinear Dynamic Modeling of Spike Train Transformations for Hippocampal-Cortical Prostheses , 2007, IEEE Transactions on Biomedical Engineering.