Competition Through Selective Inhibitory Synchrony

Models of cortical neuronal circuits commonly depend on inhibitory feedback to control gain, provide signal normalization, and selectively amplify signals using winner-take-all (WTA) dynamics. Such models generally assume that excitatory and inhibitory neurons are able to interact easily because their axons and dendrites are colocalized in the same small volume. However, quantitative neuroanatomical studies of the dimensions of axonal and dendritic trees of neurons in the neocortex show that this colocalization assumption is not valid. In this letter, we describe a simple modification to the WTA circuit design that permits the effects of distributed inhibitory neurons to be coupled through synchronization, and so allows a single WTA to be distributed widely in cortical space, well beyond the arborization of any single inhibitory neuron and even across different cortical areas. We prove by nonlinear contraction analysis and demonstrate by simulation that distributed WTA subsystems combined by such inhibitory synchrony are inherently stable. We show analytically that synchronization is substantially faster than winner selection. This circuit mechanism allows networks of independent WTAs to fully or partially compete with other.

[1]  Christof Koch,et al.  Biophysics of Computation: Information Processing in Single Neurons (Computational Neuroscience Series) , 1998 .

[2]  R. Traub,et al.  Synchronized oscillations in interneuron networks driven by metabotropic glutamate receptor activation , 1995, Nature.

[3]  Richard Granger,et al.  A cortical model of winner-take-all competition via lateral inhibition , 1992, Neural Networks.

[4]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[5]  G. Shepherd,et al.  Geometric and functional organization of cortical circuits , 2005, Nature Neuroscience.

[6]  B. Zemelman,et al.  The columnar and laminar organization of inhibitory connections to neocortical excitatory cells , 2010, Nature Neuroscience.

[7]  C. Koch,et al.  A brief history of time (constants). , 1996, Cerebral cortex.

[8]  Arthur W. Wetzel,et al.  Network anatomy and in vivo physiology of visual cortical neurons , 2011, Nature.

[9]  Jean-Jacques E. Slotine,et al.  Stable concurrent synchronization in dynamic system networks , 2005, Neural Networks.

[10]  Wolfgang Maass,et al.  On the Computational Power of Winner-Take-All , 2000, Neural Computation.

[11]  Mingqi Deng,et al.  Winner-take-all networks , 1992 .

[12]  C. Malsburg,et al.  How patterned neural connections can be set up by self-organization , 1976, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[13]  K. Deisseroth,et al.  Parvalbumin neurons and gamma rhythms enhance cortical circuit performance , 2009, Nature.

[14]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[15]  Richard Hans Robert Hahnloser,et al.  Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit , 2000, Nature.

[16]  M. I. Rabinovich,et al.  Dynamical coding of sensory information with competitive networks , 2000, Journal of Physiology-Paris.

[17]  Jean-Jacques E. Slotine,et al.  Nonlinear process control using contraction theory , 2000 .

[18]  R. Douglas,et al.  A Quantitative Map of the Circuit of Cat Primary Visual Cortex , 2004, The Journal of Neuroscience.

[19]  T. H. Brown,et al.  Passive electrical constants in three classes of hippocampal neurons. , 1981, Journal of neurophysiology.

[20]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[21]  Jack W. Tsao,et al.  Handbook of brain microcircuits Gordon M. Shepherd , 2012, Journal of the Neurological Sciences.

[22]  R. Yuste,et al.  Dense Inhibitory Connectivity in Neocortex , 2011, Neuron.

[23]  Jean-Jacques E. Slotine,et al.  Collective Stability of Networks of Winner-Take-All Circuits , 2011, Neural Computation.

[24]  E. Callaway,et al.  Cytochrome-oxidase blobs and intrinsic horizontal connections of layer 2/3 pyramidal neurons in primate V1 , 1998, Visual Neuroscience.

[25]  Jean-Jacques E. Slotine,et al.  Modularity, evolution, and the binding problem: a view from stability theory , 2001, Neural Networks.

[26]  Jessica A. Cardin,et al.  Driving fast-spiking cells induces gamma rhythm and controls sensory responses , 2009, Nature.

[27]  H. Adesnik,et al.  Lateral competition for cortical space by layer-specific horizontal circuits , 2010, Nature.

[28]  A. Holden.  Competition and cooperation in neural nets , 1983 .

[29]  W. Singer,et al.  The gamma cycle , 2007, Trends in Neurosciences.

[30]  Jean-Jacques E. Slotine,et al.  Modular stability tools for distributed computation and control , 2003 .

[31]  Hongkui Zeng,et al.  Differential tuning and population dynamics of excitatory and inhibitory neurons reflect differences in local intracortical connectivity , 2011, Nature Neuroscience.

[32]  Ueli Rutishauser,et al.  State-Dependent Computation Using Coupled Recurrent Networks , 2008, Neural Computation.

[33]  Jean-Jacques E. Slotine,et al.  On partial contraction analysis for coupled nonlinear oscillators , 2004, Biological Cybernetics.

[34]  DeLiang Wang,et al.  Locally excitatory globally inhibitory oscillator networks , 1995, IEEE Transactions on Neural Networks.

[35]  Sandra J. Kuhlman,et al.  Fast-spiking interneurons have an initial orientation bias that is lost with vision , 2011, Nature Neuroscience.

[36]  T. Sejnowski,et al.  Regulation of spike timing in visual cortical circuits , 2008, Nature Reviews Neuroscience.

[37]  Winfried Stefan Lohmiller,et al.  Contraction analysis of nonlinear systems , 1999 .

[38]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[39]  C. Koch,et al.  Recurrent excitation in neocortical circuits , 1995, Science.

[40]  G. Laurent,et al.  Normalization for Sparse Encoding of Odors by a Wide-Field Interneuron , 2011, Science.

[41]  D. McCormick,et al.  Comparative electrophysiology of pyramidal and sparsely spiny stellate neurons of the neocortex. , 1985, Journal of neurophysiology.

[42]  R. Reid,et al.  Broadly Tuned Response Properties of Diverse Inhibitory Neuron Subtypes in Mouse Visual Cortex , 2010, Neuron.

[43]  A. Selverston,et al.  Robust Microcircuit Synchronization by Inhibitory Connections , 2009, Neuron.

[44]  R. Traub,et al.  A mechanism for generation of long-range synchronous fast oscillations in the cortex , 1996, Nature.

[45]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[46]  Thomas K. Berger,et al.  A synaptic organizing principle for cortical neuronal groups , 2011, Proceedings of the National Academy of Sciences.

[47]  Christof Koch,et al.  Visual Saliency Computations: Mechanisms, Constraints, and the Effect of Feedback , 2010, The Journal of Neuroscience.

[48]  Jean-Jacques E. Slotine,et al.  On Contraction Analysis for Non-linear Systems , 1998, Autom..