Information Geometry of Multiple Spike Trains

Information geometry studies a family probability distributions by using modern geometry. Since a stochastic model of multiple spike trains is described by a family of probability distributions, information geometry provides not only intuitive understanding, but also useful tools to analyze complex spike trains. A stochastic model of neuronal spikes represents average firing rates and correlations of spikes. We separate correlations of spikes from their firing rates orthogonally. We further separate higher-order correlations from lower-order ones, and thus the effect of correlations is decomposed orthogonally. However, a general model is too complicated and is not adequate for practical use. So we study characteristics of various tractable models. We study among them a mixture model, which is simple and tractable and has many interesting properties. We also study a marginal model and its characteristics.

[1]  Yutaka Sakai,et al.  Synchronous Firing and Higher-Order Interactions in Neuron Pool , 2003, Neural Computation.

[2]  Masato Okada,et al.  Estimating Spiking Irregularities Under Changing Environments , 2006, Neural Computation.

[3]  N. N. Chent︠s︡ov.  Statistical decision rules and optimal inference , 1982 .

[4]  Shun-ichi Amari,et al.  A Comparison of Descriptive Models of a Single Spike Train by Information-Geometric Measure , 2006 .

[5]  Shun-ichi Amari,et al.  $\alpha$ -Divergence Is Unique, Belonging to Both $f$-Divergence and Bregman Divergence Classes , 2009, IEEE Transactions on Information Theory.

[6]  Stefan Rotter,et al.  Correlated input spike trains and their effects on the response of the leaky integrate-and-fire neuron , 2002, Neurocomputing.

[7]  Shun-ichi Amari,et al.  Discrimination with Spike Times and ISI Distributions , 2008, Neural Computation.

[8]  Robert E Kass,et al.  Statistical issues in the analysis of neuronal data. , 2005, Journal of neurophysiology.

[9]  Shun-ichi Amari,et al.  Conditional Mixture Model for Correlated Neuronal Spikes , 2010, Neural Computation.

[10]  Ernst Niebur,et al.  Generation of Synthetic Spike Trains with Defined Pairwise Correlations , 2007, Neural Computation.

[11]  Shun-ichi Amari,et al.  Measure of Correlation Orthogonal to Change in Firing Rate , 2009, Neural Computation.

[12]  Shun-ichi Amari,et al.  Information geometry of Boltzmann machines , 1992, IEEE Trans. Neural Networks.

[13]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[14]  Romain Brette,et al.  Generation of Correlated Spike Trains , 2009, Neural Computation.

[15]  Shun-ichi Amari,et al.  Information-Geometric Measure for Neural Spikes , 2002, Neural Computation.

[16]  Shun-ichi Amari,et al.  Methods of information geometry , 2000 .

[17]  Jianfeng Feng,et al.  Impact of Correlated Inputs on the Output of the Integrate-and-Fire Model , 2000, Neural Computation.

[18]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[19]  Stefano Panzeri,et al.  The impact of high-order interactions on the rate of synchronous discharge and information transmission in somatosensory cortex , 2009, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[20]  Stefan Rotter,et al.  Higher-Order Statistics of Input Ensembles and the Response of Simple Model Neurons , 2003, Neural Computation.

[21]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[22]  Amari Shun-ichi.  Analysis of subsets of higher-order correlated neurons based on marginal correlation coordinates , 2010 .

[23]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[24]  Shigeru Shinomoto,et al.  Differences in Spiking Patterns Among Cortical Neurons , 2003, Neural Computation.

[25]  S. Amari,et al.  Information geometry of estimating functions in semi-parametric statistical models , 1997 .

[26]  Pieter R. Roelfsema,et al.  The Effects of Pair-wise and Higher-order Correlations on the Firing Rate of a Postsynaptic Neuron , 1998, Neural Computation.

[27]  Shun-ichi Amari,et al.  Information geometry on hierarchy of probability distributions , 2001, IEEE Trans. Inf. Theory.