A frequency-resolved mutual information rate and its application to neural systems.

The encoding and processing of time-dependent signals into sequences of action potentials of sensory neurons is still a challenging theoretical problem. Although, with some effort, it is possible to quantify the flow of information in the model-free framework of Shannon's information theory, this yields just a single number, the mutual information rate. This rate does not indicate which aspects of the stimulus are encoded. Several studies have identified mechanisms at the cellular and network level leading to low- or high-pass filtering of information, i.e., the selective coding of slow or fast stimulus components. However, these findings rely on an approximation, specifically, on the qualitative behavior of the coherence function, an approximate frequency-resolved measure of information flow, whose quality is generally unknown. Here, we develop an assumption-free method to measure a frequency-resolved information rate about a time-dependent Gaussian stimulus. We demonstrate its application for three paradigmatic descriptions of neural firing: an inhomogeneous Poisson process that carries a signal in its instantaneous firing rate; an integrator neuron (stochastic integrate-and-fire model) driven by a time-dependent stimulus; and the synchronous spikes fired by two commonly driven integrator neurons. In agreement with previous coherence-based estimates, we find that Poisson and integrate-and-fire neurons are broadband and low-pass filters of information, respectively. The band-pass information filtering observed in the coherence of synchronous spikes is confirmed by our frequency-resolved information measure in some but not all parameter configurations. Our results also explicitly show how the response-response coherence can fail as an upper bound on the information rate.

[1]  Brent Doiron,et al.  Non-classical receptive field mediates switch in a sensory neuron's frequency tuning , 2003, Nature.

[2]  Alexander Borst,et al.  Information theory and neural coding , 1999, Nature Neuroscience.

[3]  William Bialek,et al.  Coding and computation with neural spike trains , 1990 .

[4]  Stefano Panzeri,et al.  Correcting for the sampling bias problem in spike train information measures. , 2007, Journal of neurophysiology.

[5]  Don H. Johnson,et al.  Examining methods for estimating mutual information in spiking neural systems , 2005, Neurocomputing.

[6]  W. Singer,et al.  Integrator or coincidence detector? The role of the cortical neuron revisited , 1996, Trends in Neurosciences.

[7]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[8]  W. Gerstner,et al.  Dynamic I-V curves are reliable predictors of naturalistic pyramidal-neuron voltage traces. , 2008, Journal of neurophysiology.

[9]  William H. Press,et al.  Numerical Recipes 3rd Edition: The Art of Scientific Computing , 2007 .

[10]  Brent Doiron,et al.  Parallel Processing of Sensory Input by Bursts and Isolated Spikes , 2004, The Journal of Neuroscience.

[11]  C. Koch,et al.  Encoding of visual information by LGN bursts. , 1999, Journal of neurophysiology.

[12]  Benjamin Lindner,et al.  Interplay of two signals in a neuron with heterogeneous synaptic short-term plasticity , 2013, Front. Comput. Neurosci..

[13]  M. Chacron,et al.  Sub‐ and suprathreshold adaptation currents have opposite effects on frequency tuning , 2012, The Journal of physiology.

[14]  Pamela Reinagel,et al.  Decoding visual information from a population of retinal ganglion cells. , 1997, Journal of neurophysiology.

[15]  R Krahe,et al.  Robustness and variability of neuronal coding by amplitude-sensitive afferents in the weakly electric fish eigenmannia. , 2000, Journal of neurophysiology.

[16]  Fabrizio Gabbiani,et al.  Coding of time-varying signals in spike trains of linear and half-wave rectifying neurons. , 1996, Network.

[17]  Wulfram Gerstner,et al.  Spiking Neuron Models , 2002 .

[18]  Alexander B Neiman,et al.  Sensory coding in oscillatory electroreceptors of paddlefish. , 2011, Chaos.

[19]  G. Pollack,et al.  Differential temporal coding of rhythmically diverse acoustic signals by a single interneuron. , 2004, Journal of neurophysiology.

[20]  R. G. Medhurst,et al.  Topics in the Theory of Random Noise , 1969 .

[21]  N. Stocks,et al.  Suprathreshold stochastic resonance in multilevel threshold systems , 2000, Physical review letters.

[22]  André Longtin,et al.  Routing the Flow of Sensory Signals Using Plastic Responses to Bursts and Isolated Spikes: Experiment and Theory , 2011, The Journal of Neuroscience.

[23]  M. Chacron,et al.  Information transmission and detection thresholds in the vestibular nuclei: single neurons vs. population encoding. , 2011, Journal of neurophysiology.

[24]  Benjamin Lindner,et al.  Information filtering by synchronous spikes in a neural population , 2012, Journal of Computational Neuroscience.

[25]  Patrick McGillivray,et al.  Parallel coding of first and second order stimulus attributes , 2012, BMC Neuroscience.

[26]  Jonathon Shlens,et al.  Estimating Information Rates with Confidence Intervals in Neural Spike Trains , 2007, Neural Computation.

[27]  Anthony N. Burkitt,et al.  A Review of the Integrate-and-fire Neuron Model: I. Homogeneous Synaptic Input , 2006, Biological Cybernetics.

[28]  André Longtin,et al.  Postsynaptic Receptive Field Size and Spike Threshold Determine Encoding of High-frequency Information via Sensitivity to Synchronous Presynaptic Activity , 2008 .

[29]  André Longtin,et al.  The cellular basis for parallel neural transmission of a high-frequency stimulus and its low-frequency envelope , 2006, Proceedings of the National Academy of Sciences.

[30]  William Bialek,et al.  Entropy and information in neural spike trains: progress on the sampling problem. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[31]  Christian K. Machens,et al.  Representation of Acoustic Communication Signals by Insect Auditory Receptor Neurons , 2001, The Journal of Neuroscience.

[32]  William Bialek,et al.  Bits and brains: Information flow in the nervous system , 1993 .

[33]  M. H. Quenouille NOTES ON BIAS IN ESTIMATION , 1956 .

[34]  Nicolas Brunel,et al.  Dynamics of the Firing Probability of Noisy Integrate-and-Fire Neurons , 2002, Neural Computation.

[35]  A. S. French,et al.  The frequency response, coherence, and information capacity of two neuronal models. , 1972, Biophysical journal.

[36]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[37]  J. Rogers Chaos , 1876 .

[38]  Maurice J Chacron,et al.  Temporal processing across multiple topographic maps in the electrosensory system. , 2008, Journal of neurophysiology.

[39]  Anthony N. Burkitt,et al.  A review of the integrate-and-fire neuron model: II. Inhomogeneous synaptic input and network properties , 2006, Biological Cybernetics.

[40]  Benjamin Lindner,et al.  Author's Accepted Manuscript , 2022 .

[41]  D. Rajan Probability, Random Variables, and Stochastic Processes , 2017 .

[42]  D. Hansel,et al.  How Spike Generation Mechanisms Determine the Neuronal Response to Fluctuating Inputs , 2003, The Journal of Neuroscience.

[43]  Liam Paninski,et al.  Estimation of Entropy and Mutual Information , 2003, Neural Computation.

[44]  Benjamin Lindner,et al.  Broadband coding with dynamic synapses , 2007, The Journal of Neuroscience.

[45]  Christopher L Passaglia,et al.  Information transmission rates of cat retinal ganglion cells. , 2004, Journal of neurophysiology.

[46]  Rüdiger Krahe,et al.  Species differences in group size and electrosensory interference in weakly electric fishes: Implications for electrosensory processing , 2010, Behavioural Brain Research.

[47]  B. Lindner,et al.  1 1 D ec 2 00 9 Are the input parameters of white-noise-driven integrate & fire neurons uniquely determined by rate and CV ? , 2014 .

[48]  W. Bialek,et al.  Naturalistic stimuli increase the rate and efficiency of information transmission by primary auditory afferents , 1995, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[49]  C E Carr,et al.  Processing of temporal information in the brain. , 1993, Annual review of neuroscience.

[50]  Rüdiger Krahe,et al.  Statistics of the Electrosensory Input in the Freely Swimming Weakly Electric Fish Apteronotus leptorhynchus , 2013, The Journal of Neuroscience.

[51]  Benjamin Lindner,et al.  Comparative study of different integrate-and-fire neurons: spontaneous activity, dynamical response, and stimulus-induced correlation. , 2009, Physical review. E, Statistical, nonlinear, and soft matter physics.

[52]  M. Chacron,et al.  Neural Variability, Detection Thresholds, and Information Transmission in the Vestibular System , 2007, Journal of Neuroscience.

[53]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[54]  André Longtin,et al.  Threshold fatigue and information transfer , 2007, Journal of Computational Neuroscience.

[55]  Ga Miller,et al.  Note on the bias of information estimates , 1955 .

[56]  William H. Press,et al.  Numerical recipes , 1990 .

[57]  John P. Miller,et al.  Assessing the Performance of Neural Encoding Models in the Presence of Noise , 2000, Journal of Computational Neuroscience.

[58]  Tomás Gedeon,et al.  Temporal Encoding in a Nervous System , 2011, PLoS Comput. Biol..

[59]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[60]  William Bialek,et al.  Entropy and Information in Neural Spike Trains , 1996, cond-mat/9603127.