Mutual Information and Information Gating in Synfire Chains

Coherent neuronal activity is believed to underlie the transfer and processing of information in the brain. Coherent activity in the form of synchronous firing and oscillations has been measured in many brain regions and has been correlated with enhanced feature processing and other sensory and cognitive functions. In the theoretical context, synfire chains and the transfer of transient activity packets in feedforward networks have been appealed to in order to describe coherent spiking and information transfer. Recently, it has been demonstrated that the classical synfire chain architecture, with the addition of suitably timed gating currents, can support the graded transfer of mean firing rates in feedforward networks (called synfire-gated synfire chains—SGSCs). Here we study information propagation in SGSCs by examining mutual information as a function of layer number in a feedforward network. We explore the effects of gating and noise on information transfer in synfire chains and demonstrate that asymptotically, two main regions exist in parameter space where information may be propagated and its propagation is controlled by pulse-gating: a large region where binary codes may be propagated, and a smaller region near a cusp in parameter space that supports graded propagation across many layers.

[1]  Wulfram Gerstner,et al.  Stable Propagation of Activity Pulses in Populations of Spiking Neurons , 2002, Neural Computation.

[2]  William Bialek,et al.  Neural Coding of Natural Stimuli: Information at Sub-Millisecond Resolution , 2007, BMC Neuroscience.

[3]  Mark C. W. van Rossum,et al.  Fast Propagation of Firing Rates through Layered Networks of Noisy Neurons , 2002, The Journal of Neuroscience.

[4]  A. Aertsen,et al.  Spiking activity propagation in neuronal networks: reconciling different perspectives on neural coding , 2010, Nature Reviews Neuroscience.

[5]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[6]  Ranulfo Romo,et al.  Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations , 2003, Current Opinion in Neurobiology.

[7]  Christof Koch,et al.  Temporal Precision of Spike Trains in Extrastriate Cortex of the Behaving Macaque Monkey , 1999, Neural Computation.

[8]  William Bialek,et al.  Spikes: Exploring the Neural Code , 1996 .

[9]  J. Victor Binless strategies for estimation of information from neural data. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[10]  W. Singer,et al.  Integrator or coincidence detector? The role of the cortical neuron revisited , 1996, Trends in Neurosciences.

[11]  A. Lansner,et al.  The cortex as a central pattern generator , 2005, Nature Reviews Neuroscience.

[12]  M. DeWeese,et al.  Binary Spiking in Auditory Cortex , 2003, The Journal of Neuroscience.

[13]  T. Sejnowski,et al.  Synchrony of Thalamocortical Inputs Maximizes Cortical Reliability , 2010, Science.

[14]  Andrew T. Sornborger,et al.  A pulse-gated, predictive neural circuit , 2016, 2016 50th Asilomar Conference on Signals, Systems and Computers.

[15]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[16]  D H HUBEL,et al.  RECEPTIVE FIELDS AND FUNCTIONAL ARCHITECTURE IN TWO NONSTRIATE VISUAL AREAS (18 AND 19) OF THE CAT. , 1965, Journal of neurophysiology.

[17]  Jonathan Cannon,et al.  Analytical Calculation of Mutual Information between Weakly Coupled Poisson-Spiking Neurons in Models of Dynamically Gated Communication , 2017, Neural Computation.

[18]  R. Oostenveld,et al.  Tactile Spatial Attention Enhances Gamma-Band Activity in Somatosensory Cortex and Reduces Low-Frequency Activity in Parieto-Occipital Areas , 2006, The Journal of Neuroscience.

[19]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[20]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[21]  R. Romo,et al.  Timing and neural encoding of somatosensory parametric working memory in macaque prefrontal cortex. , 2003, Cerebral cortex.

[22]  P. Golshani,et al.  Frequency-invariant temporal ordering of interneuronal discharges during hippocampal oscillations in awake mice , 2012, Proceedings of the National Academy of Sciences.

[23]  M. Livingstone Oscillatory firing and interneuronal correlations in squirrel monkey striate cortex. , 1996, Journal of neurophysiology.

[24]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[25]  Edward Challis,et al.  Fisher and Shannon Information in Finite Neural Populations , 2012, Neural Computation.

[26]  T. Hafting,et al.  Frequency of gamma oscillations routes flow of information in the hippocampus , 2009, Nature.

[27]  J. Csicsvari,et al.  Mechanisms of Gamma Oscillations in the Hippocampus of the Behaving Rat , 2003, Neuron.

[28]  Jonathan E. Rubin,et al.  High Frequency Stimulation of the Subthalamic Nucleus Eliminates Pathological Thalamic Rhythmicity in a Computational Model , 2004, Journal of Computational Neuroscience.

[29]  D. Tank,et al.  Functional dissection of circuitry in a neural integrator , 2007, Nature Neuroscience.

[30]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[31]  B. McNaughton,et al.  Packet-based communication in the cortex , 2015, Nature Reviews Neuroscience.

[32]  T. Hromádka,et al.  Sparse Representation of Sounds in the Unanesthetized Auditory Cortex , 2008, PLoS biology.

[33]  R. Desimone,et al.  Modulation of Oscillatory Neuronal Synchronization by Selective Visual Attention , 2001, Science.

[34]  T. Sejnowski,et al.  Correlated neuronal activity and the flow of neural information , 2001, Nature Reviews Neuroscience.

[35]  Andrew T. Sornborger,et al.  Graded, Dynamically Routable Information Processing with Synfire-Gated Synfire Chains , 2015, PLoS Comput. Biol..

[36]  A. Reyes Synchrony-dependent propagation of firing rate in iteratively constructed networks in vitro , 2003, Nature Neuroscience.

[37]  Bijan Pesaran,et al.  Temporal structure in neuronal activity during working memory in macaque parietal cortex , 2000, Nature Neuroscience.

[38]  M. Abeles Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[39]  R. Quiroga,et al.  Extracting information from neuronal populations : information theory and decoding approaches , 2022 .

[40]  W. Newsome,et al.  Context-dependent computation by recurrent dynamics in prefrontal cortex , 2013, Nature.

[41]  Maxim Bazhenov,et al.  Feedback stabilizes propagation of synchronous spiking in cortical neural networks , 2015, Proceedings of the National Academy of Sciences.

[42]  Stefano Panzeri,et al.  Extracting information in spike time patterns with wavelets and information theory. , 2015, Journal of neurophysiology.

[43]  Woodrow L. Shew,et al.  Information Capacity and Transmission Are Maximized in Balanced Cortical Networks with Neuronal Avalanches , 2010, The Journal of Neuroscience.

[44]  William Bialek,et al.  Entropy and information in neural spike trains: progress on the sampling problem. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  A. Koulakov,et al.  Model for a robust neural integrator , 2002, Nature Neuroscience.

[46]  O. Sporns,et al.  Complex brain networks: graph theoretical analysis of structural and functional systems , 2009, Nature Reviews Neuroscience.

[47]  Anthony M. Zador,et al.  Binary Coding in Auditory Cortex , 2002, NIPS.

[48]  Woodrow L. Shew,et al.  The Functional Benefits of Criticality in the Cortex , 2013, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[49]  Carlos D. Brody,et al.  Rat Prefrontal Cortex Inactivations during Decision Making Are Explained by Bistable Attractor Dynamics , 2017, Neural Computation.

[50]  Chun-I Yeh,et al.  Temporal precision in the neural code and the timescales of natural vision , 2007, Nature.

[51]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[52]  Ayelet-Hashahar Shapira,et al.  Binless Estimation of Mutual Information in Metric Spaces , 2013 .

[53]  G. Buzsáki,et al.  Gamma (40-100 Hz) oscillation in the hippocampus of the behaving rat , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  Idan Segev,et al.  On the Transmission of Rate Code in Long Feedforward Networks with Excitatory–Inhibitory Balance , 2003, The Journal of Neuroscience.

[55]  Terrence J. Sejnowski,et al.  The “independent components” of natural scenes are edge filters , 1997, Vision Research.

[56]  K. Deisseroth,et al.  Parvalbumin neurons and gamma rhythms enhance cortical circuit performance , 2009, Nature.

[57]  Jiwei Zhang,et al.  Cusps enable line attractors for neural computation. , 2017, Physical review. E.

[58]  W. Singer,et al.  Modulation of Neuronal Interactions Through Neuronal Synchronization , 2007, Science.

[59]  H. Scheich,et al.  Stimulus-related gamma oscillations in primate auditory cortex. , 2002, Journal of neurophysiology.

[60]  P. Fries A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[61]  D. Tank,et al.  Persistent neural activity: prevalence and mechanisms , 2004, Current Opinion in Neurobiology.

[62]  Andrew T. Sornborger,et al.  A mechanism for graded, dynamically routable current propagation in pulse-gated synfire chains and implications for information coding , 2015, Journal of Computational Neuroscience.

[63]  Liam Paninski,et al.  Estimation of Entropy and Mutual Information , 2003, Neural Computation.

[64]  A. Aertsen,et al.  Conditions for Propagating Synchronous Spiking and Asynchronous Firing Rates in a Cortical Network Model , 2008, The Journal of Neuroscience.

[65]  D. Paré,et al.  Coherent gamma oscillations couple the amygdala and striatum during learning , 2009, Nature Neuroscience.