Efficient codes and balanced networks

Recent years have seen a growing interest in inhibitory interneurons and their circuits. A striking property of cortical inhibition is how tightly it balances excitation. Inhibitory currents not only match excitatory currents on average, but track them on a millisecond time scale, whether they are caused by external stimuli or spontaneous fluctuations. We review, together with experimental evidence, recent theoretical approaches that investigate the advantages of such tight balance for coding and computation. These studies suggest a possible revision of the dominant view that neurons represent information with firing rates corrupted by Poisson noise. Instead, tight excitatory/inhibitory balance may be a signature of a highly cooperative code, orders of magnitude more precise than a Poisson rate code. Moreover, tight balance may provide a template that allows cortical neurons to construct high-dimensional population codes and learn complex functions of their inputs.

[1]  D. McCormick,et al.  Neocortical Network Activity In Vivo Is Generated through a Dynamic Balance of Excitation and Inhibition , 2006, The Journal of Neuroscience.

[2]  Nicholas J. Priebe,et al.  Orientation Selectivity of Synaptic Input to Neurons in Mouse and Cat Primary Visual Cortex , 2011, The Journal of Neuroscience.

[3]  Henry Markram,et al.  Real-Time Computing Without Stable States: A New Framework for Neural Computation Based on Perturbations , 2002, Neural Computation.

[4]  R. Froemke,et al.  Oxytocin Enables Maternal Behavior by Balancing Cortical Inhibition , 2015, Nature.

[5]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[6]  Hilbert J. Kappen,et al.  Learning Universal Computations with Spikes , 2015, PLoS Comput. Biol..

[7]  Christian K. Machens,et al.  Learning optimal spike-based representations , 2012, NIPS.

[8]  E. Adrian,et al.  The impulses produced by sensory nerve-endings: Part II. The response of a Single End-Organ. , 2006, The Journal of physiology.

[9]  Nathan R. Wilson,et al.  Response Features of Parvalbumin-Expressing Interneurons Suggest Precise Roles for Subtypes of Inhibition in Visual Cortex , 2010, Neuron.

[10]  Guangying K. Wu,et al.  Lateral Sharpening of Cortical Frequency Tuning by Approximately Balanced Inhibition , 2008, Neuron.

[11]  David Ferster,et al.  Membrane Potential Synchrony in Primary Visual Cortex during Sensory Stimulation , 2010, Neuron.

[12]  Christian K. Machens,et al.  Predictive Coding of Dynamical Variables in Balanced Spiking Networks , 2013, PLoS Comput. Biol..

[13]  Joseph J. Paton,et al.  A Scalable Population Code for Time in the Striatum , 2015, Current Biology.

[14]  W. Gerstner,et al.  Optimal Control of Transient Dynamics in Balanced Networks Supports Generation of Complex Movements , 2014, Neuron.

[15]  M. Goldman,et al.  Balanced Cortical Microcircuitry for Spatial Working Memory Based on Corrective Feedback Control , 2014, The Journal of Neuroscience.

[16]  P. Berkes,et al.  Statistically Optimal Perception and Learning: from Behavior to Neural Representations , 2022 .

[17]  Christian K. Machens,et al.  Optimal compensation for neuron death , 2015, bioRxiv.

[18]  R. Yuste,et al.  Axo-dendritic overlap and laminar projection can explain interneuron connectivity to pyramidal cells. , 2013, Cerebral cortex.

[19]  J. Barry Richmond,et al.  Neural Coding , 2014, Encyclopedia of Computational Neuroscience.

[20]  E. Adrian,et al.  The impulses produced by sensory nerve‐endings , 1926 .

[21]  A. Zador,et al.  Balanced inhibition underlies tuning and sharpens spike timing in auditory cortex , 2003, Nature.

[22]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[23]  Sukbin Lim,et al.  Balanced cortical microcircuitry for maintaining information in working memory , 2013, Nature Neuroscience.

[24]  Y. Frégnac,et al.  In vitro and in vivo measures of evoked excitatory and inhibitory conductance dynamics in sensory cortices , 2008, Journal of Neuroscience Methods.

[25]  J. Isaacson,et al.  Odor Representations in Olfactory Cortex: “Sparse” Coding, Global Inhibition, and Oscillations , 2009, Neuron.

[26]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[27]  William R. Softky,et al.  The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[28]  Sooyoung Chung,et al.  Functional imaging with cellular resolution reveals precise micro-architecture in visual cortex , 2005, Nature.

[29]  M. Abeles Role of the cortical neuron: integrator or coincidence detector? , 1982, Israel journal of medical sciences.

[30]  Jan Drugowitsch,et al.  Causal Inference and Explaining Away in a Spiking Network , 2015, Scientific Reports.

[31]  M. Stryker,et al.  Modulation of Visual Responses by Behavioral State in Mouse Visual Cortex , 2010, Neuron.

[32]  K. Miller,et al.  Balanced Amplification: A New Mechanism of Selective Amplification of Neural Activity Patterns , 2016, Neuron.

[33]  Li I. Zhang,et al.  Scaling down of balanced excitation and inhibition by active behavioral states in auditory cortex , 2014, Nature Neuroscience.

[34]  Bartlett W. Mel,et al.  Pyramidal Neuron as Two-Layer Neural Network , 2003, Neuron.

[35]  C. Schreiner,et al.  A synaptic memory trace for cortical receptive field plasticity , 2007, Nature.

[36]  M. Cohen,et al.  Measuring and interpreting neuronal correlations , 2011, Nature Neuroscience.

[37]  Michael Okun,et al.  Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities , 2008, Nature Neuroscience.

[38]  L. F. Abbott,et al.  Building functional networks of spiking model neurons , 2016, Nature Neuroscience.

[39]  J. J. Hopfield,et al.  Pattern recognition computation using action potential timing for stimulus representation , 1995, Nature.

[40]  R. Yuste,et al.  Dense Inhibitory Connectivity in Neocortex , 2011, Neuron.

[41]  M. London,et al.  Sensitivity to perturbations in vivo implies high noise and suggests rate coding in cortex , 2010, Nature.

[42]  Matthew T. Kaufman,et al.  Neural population dynamics during reaching , 2012, Nature.

[43]  C. Petersen,et al.  Membrane Potential Dynamics of GABAergic Neurons in the Barrel Cortex of Behaving Mice , 2010, Neuron.

[44]  Christopher D. Harvey,et al.  Choice-specific sequences in parietal cortex during a virtual-navigation decision task , 2012, Nature.

[45]  Henning Sprekeler,et al.  Inhibitory Plasticity Balances Excitation and Inhibition in Sensory Pathways and Memory Networks , 2011, Science.

[46]  David Hansel,et al.  Short-Term Plasticity Explains Irregular Persistent Activity in Working Memory Tasks , 2013, The Journal of Neuroscience.

[47]  R. Reid,et al.  Broadly Tuned Response Properties of Diverse Inhibitory Neuron Subtypes in Mouse Visual Cortex , 2010, Neuron.

[48]  Haim Sompolinsky,et al.  Chaotic Balanced State in a Model of Cortical Circuits , 1998, Neural Computation.

[49]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[50]  Christoph E. Schreiner,et al.  Developmental sensory experience balances cortical excitation and inhibition , 2010, Nature.

[51]  Lyle J. Graham,et al.  Orientation and Direction Selectivity of Synaptic Inputs in Visual Cortical Neurons A Diversity of Combinations Produces Spike Tuning , 2003, Neuron.

[52]  Nicholas J. Priebe,et al.  A spontaneous state of weakly correlated synaptic excitation and inhibition in visual cortex , 2013, Neuroscience.

[53]  M. Carandini,et al.  Orientation tuning of input conductance, excitation, and inhibition in cat primary visual cortex. , 2000, Journal of neurophysiology.

[54]  F. Wolf,et al.  Dynamical entropy production in spiking neuron networks in the balanced state. , 2010, Physical review letters.

[55]  Jessica A. Cardin,et al.  Stimulus Feature Selectivity in Excitatory and Inhibitory Neurons in Primary Visual Cortex , 2007, The Journal of Neuroscience.

[56]  M. Scanziani,et al.  How Inhibition Shapes Cortical Activity , 2011, Neuron.

[57]  D. Contreras,et al.  Dynamics of excitation and inhibition underlying stimulus selectivity in rat somatosensory cortex , 2005, Nature Neuroscience.

[58]  M. Scanziani,et al.  Instantaneous Modulation of Gamma Oscillation Frequency by Balancing Excitation with Inhibition , 2009, Neuron.

[59]  Robert C. Froemke,et al.  Inhibitory and Excitatory Spike-Timing-Dependent Plasticity in the Auditory Cortex , 2015, Neuron.

[60]  Li I. Zhang,et al.  Broad Inhibition Sharpens Orientation Selectivity by Expanding Input Dynamic Range in Mouse Simple Cells , 2011, Neuron.

[61]  Herbert Jaeger,et al.  The''echo state''approach to analysing and training recurrent neural networks , 2001 .

[62]  M. Carandini,et al.  Inhibition dominates sensory responses in awake cortex , 2012, Nature.

[63]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[64]  Adrienne L Fairhall,et al.  Constructing Precisely Computing Networks with Biophysical Spiking Neurons , 2014, The Journal of Neuroscience.

[65]  Sophie Denève,et al.  Enforcing balance allows local supervised learning in spiking recurrent networks , 2015, NIPS.

[66]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[67]  C. Schreiner,et al.  Long-term modification of cortical synapses improves sensory perception , 2012, Nature Neuroscience.

[68]  M. Wehr,et al.  Balanced Tone-evoked Synaptic Excitation and Inhibition in Mouse Auditory Cortex Experimental Procedures Physiological Procedures Article in Press , 2022 .

[69]  A. Destexhe,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[70]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[71]  D. McCormick,et al.  Turning on and off recurrent balanced cortical activity , 2003, Nature.

[72]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[73]  Li I. Zhang,et al.  Visual Receptive Field Structure of Cortical Inhibitory Neurons Revealed by Two-Photon Imaging Guided Recording , 2009, The Journal of Neuroscience.

[74]  Arthur W. Wetzel,et al.  Network anatomy and in vivo physiology of visual cortical neurons , 2011, Nature.

[75]  M. Chalk,et al.  Neural oscillations as a signature of efficient coding in the presence of synaptic delays , 2015, bioRxiv.

[76]  R Clay Reid,et al.  Laminar processing of stimulus orientation in cat visual cortex , 2002, The Journal of physiology.

[77]  Li I. Zhang,et al.  Tone-evoked excitatory and inhibitory synaptic conductances of primary auditory cortex neurons. , 2004, Journal of neurophysiology.

[78]  Yumiko Yoshimura,et al.  Specialized Inhibitory Synaptic Actions Between Nearby Neocortical Pyramidal Neurons , 2007, Science.

[79]  M. Scanziani,et al.  Equalizing Excitation-Inhibition Ratios across Visual Cortical Neurons , 2014, Nature.

[80]  Michael Graupner,et al.  Synaptic Input Correlations Leading to Membrane Potential Decorrelation of Spontaneous Activity in Cortex , 2013, The Journal of Neuroscience.

[81]  Christian K. Machens,et al.  Firing rate predictions in optimal balanced networks , 2013, NIPS.

[82]  Sophie Denève,et al.  Spike-Based Population Coding and Working Memory , 2011, PLoS Comput. Biol..

[83]  D. McCormick,et al.  Synaptic Mechanisms of Tight Spike Synchrony at Gamma Frequency in Cerebral Cortex , 2015, The Journal of Neuroscience.