Variable synaptic strengths controls the firing rate distribution in feedforward neural networks

Heterogeneity of firing rate statistics is known to have severe consequences on neural coding. Recent experimental recordings in weakly electric fish indicate that the distribution-width of superficial pyramidal cell firing rates (trial- and time-averaged) in the electrosensory lateral line lobe (ELL) depends on the stimulus, and also that network inputs can mediate changes in the firing rate distribution across the population. We previously developed theoretical methods to understand how two attributes (synaptic and intrinsic heterogeneity) interact and alter the firing rate distribution in a population of integrate-and-fire neurons with random recurrent coupling. Inspired by our experimental data, we extend these theoretical results to a delayed feedforward spiking network that qualitatively capture the changes of firing rate heterogeneity observed in in-vivo recordings. We demonstrate how heterogeneous neural attributes alter firing rate heterogeneity, accounting for the effect with various sensory stimuli. The model predicts how the strength of the effective network connectivity is related to intrinsic heterogeneity in such delayed feedforward networks: the strength of the feedforward input is positively correlated with excitability (threshold value for spiking) when firing rate heterogeneity is low and is negatively correlated with excitability with high firing rate heterogeneity. We also show how our theory can be used to predict effective neural architecture. We demonstrate that neural attributes do not interact in a simple manner but rather in a complex stimulus-dependent fashion to control neural heterogeneity and discuss how it can ultimately shape population codes.

[1]  Cheng Ly,et al.  Cellular and Circuit Mechanisms Maintain Low Spike Co-Variability and Enhance Population Coding in Somatosensory Cortex , 2012, Front. Comput. Neurosci..

[2]  M. J. Richardson,et al.  Firing-rate response of linear and nonlinear integrate-and-fire neurons to modulated current-based and conductance-based synaptic drive. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Haim Sompolinsky,et al.  Implications of Neuronal Diversity on Population Coding , 2006, Neural Computation.

[4]  André Longtin,et al.  Learning Contrast-Invariant Cancellation of Redundant Signals in Neural Systems , 2013, PLoS Comput. Biol..

[5]  E. Marder,et al.  Variability, compensation and homeostasis in neuron and network function , 2006, Nature Reviews Neuroscience.

[6]  Leonard Maler,et al.  Neural strategies for optimal processing of sensory signals. , 2007, Progress in brain research.

[7]  Valentin Dragoi,et al.  Efficient coding in heterogeneous neuronal populations , 2008, Proceedings of the National Academy of Sciences.

[8]  J. Bastian.  Gain control in the electrosensory system mediated by descending inputs to the electrosensory lateral line lobe , 1986, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Leonard Maler,et al.  Frequency-Tuned Cerebellar Channels and Burst-Induced LTD Lead to the Cancellation of Redundant Sensory Inputs , 2011, The Journal of Neuroscience.

[10]  L. Maler,et al.  Plastic and Nonplastic Pyramidal Cells Perform Unique Roles in a Network Capable of Adaptive Redundancy Reduction , 2004, Neuron.

[11]  S. Kay.  Fundamentals of statistical signal processing: estimation theory , 1993 .

[12]  Joseph Bastian,et al.  The physiology and morphology of two types of electrosensory neurons in the weakly electric fishApteronotus leptorhynchus , 1984, Journal of Comparative Physiology A.

[13]  Duane Q. Nykamp,et al.  A Population Density Approach That Facilitates Large-Scale Modeling of Neural Networks: Analysis and an Application to Orientation Tuning , 2004, Journal of Computational Neuroscience.

[14]  Eric Shea-Brown,et al.  Stimulus-Dependent Correlations and Population Codes , 2008, Neural Computation.

[15]  Alex M Thomson,et al.  Binomial parameters differ across neocortical layers and with different classes of connections in adult rat and cat neocortex , 2007, Proceedings of the National Academy of Sciences.

[16]  Nicolas Brunel,et al.  Analytical approximations of the firing rate of an adaptive exponential integrate-and-fire neuron in the presence of synaptic noise , 2014, Front. Comput. Neurosci..

[17]  K. Frank,et al.  CHAPTER 2 – MICROELECTRODES FOR RECORDING AND STIMULATION , 1964 .

[18]  Wulfram Gerstner,et al.  Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking , 2000, Neural Computation.

[19]  Brent Doiron,et al.  The Spatial Structure of Stimuli Shapes the Timescale of Correlations in Population Spiking Activity , 2012, PLoS Comput. Biol..

[20]  W. John Wilbur,et al.  An analysis of Stein's model for stochastic neuronal excitation , 1982, Biological Cybernetics.

[21]  J F Mejias,et al.  Optimal heterogeneity for coding in spiking neural networks. , 2012, Physical review letters.

[22]  Leonard Maler,et al.  Intrinsic frequency tuning in ELL pyramidal cells varies across electrosensory maps. , 2008, Journal of neurophysiology.

[23]  Leonard Maler,et al.  Neural heterogeneity and efficient population codes for communication signals. , 2010, Journal of neurophysiology.

[24]  L. Maler,et al.  Limits of linear rate coding of dynamic stimuli by electroreceptor afferents. , 2007, Journal of neurophysiology.

[25]  Magnus J. E. Richardson,et al.  Spike-train spectra and network response functions for non-linear integrate-and-fire neurons , 2008, Biological Cybernetics.

[26]  M. Scanziani,et al.  Equalizing Excitation-Inhibition Ratios across Visual Cortical Neurons , 2014, Nature.

[27]  Chris Eliasmith,et al.  The Competing Benefits of Noise and Heterogeneity in Neural Coding , 2014, Neural Computation.

[28]  Daniel Tranchina,et al.  Population Density Methods in Large-Scale Neural Network Modelling , 2010 .

[29]  J. Hoenig,et al.  Statistical Practice The Abuse of Power: The Pervasive Fallacy of Power Calculations for Data Analysis , 2001 .

[30]  Edgar Erdfelder,et al.  G*Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences , 2007, Behavior research methods.

[31]  Leonard Maler,et al.  Receptive field organization across multiple electrosensory maps. I. Columnar organization and estimation of receptive field size , 2009, The Journal of comparative neurology.

[32]  Maurice J. Chacron,et al.  Activation of Parallel Fiber Feedback by Spatially Diffuse Stimuli Reduces Signal and Noise Correlations via Independent Mechanisms in a Cerebellum-Like Structure , 2015, PLoS Comput. Biol..

[33]  Randy M Bruno,et al.  Feedforward Mechanisms of Excitatory and Inhibitory Cortical Receptive Fields , 2002, The Journal of Neuroscience.

[34]  Srdjan Ostojic,et al.  Two types of asynchronous activity in networks of excitatory and inhibitory spiking neurons , 2014, Nature Neuroscience.

[35]  Nicolas Brunel,et al.  Dynamics of the Firing Probability of Noisy Integrate-and-Fire Neurons , 2002, Neural Computation.

[36]  N. Urban,et al.  Intrinsic biophysical diversity decorrelates neuronal firing while increasing information content , 2010, Nature Neuroscience.

[37]  Maurice J Chacron,et al.  Feedback and Feedforward Control of Frequency Tuning to Naturalistic Stimuli , 2005, The Journal of Neuroscience.

[38]  D. Ferster,et al.  Neural mechanisms of orientation selectivity in the visual cortex. , 2000, Annual review of neuroscience.

[39]  Christopher J. Lee.  Open Peer Review by a Selected-Papers Network , 2011, Front. Comput. Neurosci..

[40]  Néstor Parga,et al.  Auto- and crosscorrelograms for the spike response of leaky integrate-and-fire neurons with slow synapses. , 2006, Physical review letters.

[41]  M. Scanziani,et al.  Enforcement of Temporal Fidelity in Pyramidal Cells by Somatic Feed-Forward Inhibition , 2001, Science.

[42]  J Ahn,et al.  Heterogeneity of intrinsic biophysical properties among cochlear nucleus neurons improves the population coding of temporal information. , 2014, Journal of neurophysiology.

[43]  Brent Doiron,et al.  The mechanics of state-dependent neural correlations , 2016, Nature Neuroscience.

[44]  Alexander S. Ecker,et al.  The Effect of Noise Correlations in Populations of Diversely Tuned Neurons , 2011, The Journal of Neuroscience.

[45]  A. P. Georgopoulos,et al.  Neuronal population coding of movement direction. , 1986, Science.

[46]  J. Bastian,et al.  Dendritic modulation of burst-like firing in sensory neurons. , 2001, Journal of neurophysiology.

[47]  Eric Shea-Brown,et al.  On the Phase Reduction and Response Dynamics of Neural Oscillator Populations , 2004, Neural Computation.

[48]  André Longtin,et al.  Postsynaptic Receptive Field Size and Spike Threshold Determine Encoding of High-frequency Information via Sensitivity to Synchronous Presynaptic Activity , 2008 .

[49]  A Longtin,et al.  Model of gamma frequency burst discharge generated by conditional backpropagation. , 2001, Journal of neurophysiology.

[50]  Len Thomas,et al.  Retrospective Power Analysis , 1997 .

[51]  Frances S. Chance,et al.  Effects of synaptic noise and filtering on the frequency response of spiking neurons. , 2001, Physical review letters.

[52]  Gregory D. Smith,et al.  A multivariate population density model of the dLGN/PGN relay , 2006, Journal of Computational Neuroscience.

[53]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[54]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[55]  Cheng Ly,et al.  Critical Analysis of Dimension Reduction by a Moment Closure Method in a Population Density Approach to Neural Network Modeling , 2007, Neural Computation.

[56]  P Erdi,et al.  Statistical model of the hippocampal CA3 region II. The population framework: model of rhythmic activity in the CA3 slice. , 1998, Biological cybernetics.

[57]  André Longtin,et al.  The cellular basis for parallel neural transmission of a high-frequency stimulus and its low-frequency envelope , 2006, Proceedings of the National Academy of Sciences.

[58]  Abbott,et al.  Asynchronous states in networks of pulse-coupled oscillators. , 1993, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[59]  J. Touboul,et al.  Heterogeneous connections induce oscillations in large-scale networks. , 2012, Physical review letters.

[60]  D. Parker.  Variable Properties in a Single Class of Excitatory Spinal Synapse , 2003, The Journal of Neuroscience.

[61]  Leonard Maler,et al.  Transient signals trigger synchronous bursts in an identified population of neurons. , 2009, Journal of neurophysiology.

[62]  Cheng Ly,et al.  One-Dimensional Population Density Approaches to Recurrently Coupled Networks of Neurons with Noise , 2015, SIAM J. Appl. Math..

[63]  Alla Borisyuk,et al.  Fluctuation-driven rhythmogenesis in an excitatory neuronal network with slow adaptation , 2008, Journal of Computational Neuroscience.

[64]  Brent Doiron,et al.  Spatial Profile and Differential Recruitment of GABAB Modulate Oscillatory Activity in Auditory Cortex , 2009, The Journal of Neuroscience.

[65]  Cheng Ly.  Population Density Approach to Neural Network Modeling , 2009 .

[66]  Péter Érdi,et al.  Statistical model of the hippocampal CA3 region , 1998, Biological Cybernetics.

[67]  L. Maler,et al.  Neural architecture of the electrosensory lateral line lobe: adaptations for coincidence detection, a sensory searchlight and frequency-dependent adaptive filtering , 1999, The Journal of experimental biology.

[68]  Maurice J Chacron,et al.  Population coding by electrosensory neurons. , 2008, Journal of neurophysiology.

[69]  E. Erdfelder,et al.  Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses , 2009, Behavior research methods.

[70]  André Longtin,et al.  Differential effects of excitatory and inhibitory heterogeneity on the gain and asynchronous state of sparse cortical networks , 2014, Front. Comput. Neurosci..

[71]  A. Pouget,et al.  Neural correlations, population coding and computation , 2006, Nature Reviews Neuroscience.

[72]  Cheng Ly,et al.  Analysis of Recurrent Networks of Pulse-Coupled Noisy Neural Oscillators , 2010, SIAM J. Appl. Dyn. Syst..

[73]  Brent Doiron,et al.  A Dynamic Dendritic Refractory Period Regulates Burst Discharge in the Electrosensory Lobe of Weakly Electric Fish , 2003, The Journal of Neuroscience.

[74]  Brent Doiron,et al.  Inhibitory feedback required for network oscillatory responses to communication but not prey stimuli , 2003, Nature.

[75]  B. Knight.  The Relationship between the Firing Rate of a Single Neuron and the Level of Activity in a Population of Neurons , 1972, The Journal of general physiology.

[76]  Lawrence Sirovich,et al.  On the Simulation of Large Populations of Neurons , 2004, Journal of Computational Neuroscience.

[77]  Shreejoy J Tripathy,et al.  Intermediate intrinsic diversity enhances neural population coding , 2013, Proceedings of the National Academy of Sciences.

[78]  C. Gray,et al.  Dynamic spike threshold reveals a mechanism for synaptic coincidence detection in cortical neurons in vivo. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[79]  Cheng Ly,et al.  Population density methods for stochastic neurons with realistic synaptic kinetics: Firing rate dynamics and fast computational methods , 2006, Network.

[80]  Nicholas J. Priebe,et al.  Inhibition, Spike Threshold, and Stimulus Selectivity in Primary Visual Cortex , 2008, Neuron.

[81]  Leonard Maler,et al.  Preparing for the unpredictable: adaptive feedback enhances the response to unexpected communication signals. , 2012, Journal of neurophysiology.

[82]  Cheng Ly,et al.  Firing rate dynamics in recurrent spiking neural networks with intrinsic and network heterogeneity , 2015, Journal of Computational Neuroscience.

[83]  Nicolas Brunel,et al.  Firing Rate of the Noisy Quadratic Integrate-and-Fire Neuron , 2003, Neural Computation.

[84]  L. Maler,et al.  An atlas of the brain of the electric fish Apteronotus leptorhynchus , 1991, Journal of Chemical Neuroanatomy.

[85]  André Longtin,et al.  Cellular and circuit properties supporting different sensory coding strategies in electric fish and other systems , 2012, Current Opinion in Neurobiology.