Efficient Coding and Energy Efficiency Are Promoted by Balanced Excitatory and Inhibitory Synaptic Currents in Neuronal Network

Selective pressure may drive neural systems to process as much information as possible with the lowest energy cost. Recent experiment evidence revealed that the ratio between synaptic excitation and inhibition (E/I) in local cortex is generally maintained at a certain value which may influence the efficiency of energy consumption and information transmission of neural networks. To understand this issue deeply, we constructed a typical recurrent Hodgkin-Huxley network model and studied the general principles that governs the relationship among the E/I synaptic current ratio, the energy cost and total amount of information transmission. We observed in such a network that there exists an optimal E/I synaptic current ratio in the network by which the information transmission achieves the maximum with relatively low energy cost. The coding energy efficiency which is defined as the mutual information divided by the energy cost, achieved the maximum with the balanced synaptic current. Although background noise degrades information transmission and imposes an additional energy cost, we find an optimal noise intensity that yields the largest information transmission and energy efficiency at this optimal E/I synaptic transmission ratio. The maximization of energy efficiency also requires a certain part of energy cost associated with spontaneous spiking and synaptic activities. We further proved this finding with analytical solution based on the response function of bistable neurons, and demonstrated that optimal net synaptic currents are capable of maximizing both the mutual information and energy efficiency. These results revealed that the development of E/I synaptic current balance could lead a cortical network to operate at a highly efficient information transmission rate at a relatively low energy cost. The generality of neuronal models and the recurrent network configuration used here suggest that the existence of an optimal E/I cell ratio for highly efficient energy costs and information maximization is a potential principle for cortical circuit networks. Summary We conducted numerical simulations and mathematical analysis to examine the energy efficiency of neural information transmission in a recurrent network as a function of the ratio of excitatory and inhibitory synaptic connections. We obtained a general solution showing that there exists an optimal E/I synaptic ratio in a recurrent network at which the information transmission as well as the energy efficiency of this network achieves a global maximum. These results reflect general mechanisms for sensory coding processes, which may give insight into the energy efficiency of neural communication and coding.

[1]  Woodrow L. Shew,et al.  Neuronal Avalanches Imply Maximum Dynamic Range in Cortical Networks at Criticality , 2009, The Journal of Neuroscience.

[2]  Lianchun Yu,et al.  Detection of subthreshold pulses in neurons with channel noise. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  J. Macke,et al.  Neural population coding: combining insights from microscopic and mass signals , 2015, Trends in Cognitive Sciences.

[4]  P. Somogyi,et al.  Salient features of synaptic organisation in the cerebral cortex 1 Published on the World Wide Web on 3 March 1998. 1 , 1998, Brain Research Reviews.

[5]  H. Sompolinsky,et al.  The Impact of Structural Heterogeneity on Excitation-Inhibition Balance in Cortical Networks , 2016, Neuron.

[6]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[7]  T. Sejnowski,et al.  Metabolic cost as a unifying principle governing neuronal biophysics , 2010, Proceedings of the National Academy of Sciences.

[8]  Christian K. Machens,et al.  Efficient codes and balanced networks , 2016, Nature Neuroscience.

[9]  A. Destexhe,et al.  The high-conductance state of neocortical neurons in vivo , 2003, Nature Reviews Neuroscience.

[10]  S. Thorpe,et al.  How parallel is visual processing in the ventral pathway? , 2004, Trends in Cognitive Sciences.

[11]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[12]  András Lörincz,et al.  Efficient Sparse Coding in Early Sensory Processing: Lessons from Signal Recovery , 2012, PLoS Comput. Biol..

[13]  Michael N. Shadlen,et al.  Noise, neural codes and cortical organization , 1994, Current Opinion in Neurobiology.

[14]  Simon B. Laughlin,et al.  Balanced Excitatory and Inhibitory Synaptic Currents Promote Efficient Coding and Metabolic Efficiency , 2013, PLoS Comput. Biol..

[15]  M. Corbetta,et al.  How Local Excitation–Inhibition Ratio Impacts the Whole Brain Dynamics , 2014, The Journal of Neuroscience.

[16]  William B Levy,et al.  Energy-Efficient Neuronal Computation via Quantal Synaptic Failures , 2002, The Journal of Neuroscience.

[17]  S. Laughlin,et al.  Energy limitation as a selective pressure on the evolution of sensory systems , 2008, Journal of Experimental Biology.

[18]  Simon B. Laughlin,et al.  Energy-Efficient Coding with Discrete Stochastic Events , 2002, Neural Computation.

[19]  John M. Beggs,et al.  Being Critical of Criticality in the Brain , 2012, Front. Physio..

[20]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[21]  Christoph Schmidt-Hieber,et al.  Fast Sodium Channel Gating Supports Localized and Efficient Axonal Action Potential Initiation , 2010, The Journal of Neuroscience.

[22]  Lianchun Yu,et al.  Optimal size of stochastic Hodgkin-Huxley neuronal systems for maximal energy efficiency in coding pulse signals. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[23]  D. Chklovskii,et al.  Maps in the brain: what can we learn from them? , 2004, Annual review of neuroscience.

[24]  P. Dayan,et al.  Supporting Online Material Materials and Methods Som Text Figs. S1 to S9 References the Asynchronous State in Cortical Circuits , 2022 .

[25]  Lianchun Yu,et al.  Optimal Size for Maximal Energy Efficiency in Information Processing of Biological Systems Due to Bistability , 2015, 1507.07668.

[26]  A. Destexhe,et al.  Impact of spontaneous synaptic activity on the resting properties of cat neocortical pyramidal neurons In vivo. , 1998, Journal of neurophysiology.

[27]  Dominique M. Durand,et al.  Reverse stochastic resonance in a hippocampal CA1 neuron model , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  Gregoire Nicolis,et al.  Stochastic resonance , 2007, Scholarpedia.

[29]  Gordon M Shepherd,et al.  Sparse Coding and Lateral Inhibition Arising from Balanced and Unbalanced Dendrodendritic Excitation and Inhibition , 2014, The Journal of Neuroscience.

[30]  Chi Zhang,et al.  Energy-efficient population coding constrains network size of a neuronal array system , 2015, Scientific Reports.

[31]  S. Kety,et al.  The circulation and energy metabolism of the brain. , 1963, Clinical neurosurgery.

[32]  D. Attwell,et al.  Synaptic Energy Use and Supply , 2012, Neuron.

[33]  N. Volkow,et al.  Energetic cost of brain functional connectivity , 2013, Proceedings of the National Academy of Sciences.

[34]  John M Beggs,et al.  Critical branching captures activity in living neural networks and maximizes the number of metastable States. , 2005, Physical review letters.

[35]  Peter Herman,et al.  Evaluating the gray and white matter energy budgets of human brain function , 2017, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[36]  Bruno A Olshausen,et al.  Sparse coding of sensory inputs , 2004, Current Opinion in Neurobiology.

[37]  A. Zador,et al.  Balanced inhibition underlies tuning and sharpens spike timing in auditory cortex , 2003, Nature.

[38]  Chi-Sang Poon,et al.  Pacemakers handshake synchronization mechanism of mammalian respiratory rhythmogenesis , 2008, Proceedings of the National Academy of Sciences.

[39]  K. Linkenkaer-Hansen,et al.  Critical-State Dynamics of Avalanches and Oscillations Jointly Emerge from Balanced Excitation/Inhibition in Neuronal Networks , 2012, The Journal of Neuroscience.

[40]  Woodrow L. Shew,et al.  Information Capacity and Transmission Are Maximized in Balanced Cortical Networks with Neuronal Avalanches , 2010, The Journal of Neuroscience.

[41]  A. Destexhe,et al.  Synaptic background activity controls spike transfer from thalamus to cortex , 2005, Nature Neuroscience.

[42]  A d'Anjou,et al.  Energy and information in Hodgkin-Huxley neurons. , 2011, Physical review. E, Statistical, nonlinear, and soft matter physics.

[43]  C. Koch,et al.  Synaptic Background Activity Influences Spatiotemporal Integration in Single Pyramidal Cells. , 1991, The Biological bulletin.

[44]  H. Sompolinsky,et al.  Chaos in Neuronal Networks with Balanced Excitatory and Inhibitory Activity , 1996, Science.

[45]  G. Mitchison Neuronal branching patterns and the economy of cortical wiring , 1991, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[46]  D. Contreras,et al.  Dynamics of excitation and inhibition underlying stimulus selectivity in rat somatosensory cortex , 2005, Nature Neuroscience.

[47]  H. Markram,et al.  Interneurons of the neocortical inhibitory system , 2004, Nature Reviews Neuroscience.

[48]  D. Attwell,et al.  Updated Energy Budgets for Neural Computation in the Neocortex and Cerebellum , 2012, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[49]  Michael L. Hines,et al.  Cable energy function of cortical axons , 2016, Scientific Reports.

[50]  Adam P. Hill,et al.  Warm Body Temperature Facilitates Energy Efficient Cortical Action Potentials , 2012, PLoS Comput. Biol..

[51]  J. DeFelipe,et al.  Microstructure of the neocortex: Comparative aspects , 2002, Journal of neurocytology.

[52]  William B. Levy,et al.  Energy Efficient Neural Codes , 1996, Neural Computation.

[53]  P. Lennie The Cost of Cortical Computation , 2003, Current Biology.

[54]  Changsong Zhou,et al.  Co-emergence of multi-scale cortical activities of irregular firing, oscillations and avalanches achieves cost-efficient information capacity , 2017, PLoS Comput. Biol..

[55]  Michael Häusser,et al.  Feed‐forward inhibition shapes the spike output of cerebellar Purkinje cells , 2005, The Journal of physiology.

[56]  Thilo Gross,et al.  Self-organized criticality as a fundamental property of neural systems , 2014, Front. Syst. Neurosci..

[57]  Alain Destexhe,et al.  Inhibition Determines Membrane Potential Dynamics and Controls Action Potential Generation in Awake and Sleeping Cat Cortex , 2007, The Journal of Neuroscience.

[58]  Nicolas Brunel,et al.  Dynamics of Sparsely Connected Networks of Excitatory and Inhibitory Spiking Neurons , 2000, Journal of Computational Neuroscience.

[59]  Jörg R. P. Geiger,et al.  Energy-Efficient Action Potentials in Hippocampal Mossy Fibers , 2009, Science.

[60]  Danielle Smith Bassett,et al.  Small-World Brain Networks , 2006, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[61]  S. Laughlin Energy as a constraint on the coding and processing of sensory information , 2001, Current Opinion in Neurobiology.

[62]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .