Rhythmic Inhibition Allows Neural Networks to Search for Maximally Consistent States

Gamma-band rhythmic inhibition is a ubiquitous phenomenon in neural circuits, yet its computational role remains elusive. We show that a model of gamma-band rhythmic inhibition allows networks of coupled cortical circuit motifs to search for network configurations that best reconcile external inputs with an internal consistency model encoded in the network connectivity. We show that Hebbian plasticity allows the networks to learn the consistency model by example. The search dynamics driven by rhythmic inhibition enable the described networks to solve difficult constraint satisfaction problems without making assumptions about the form of stochastic fluctuations in the network. We show that the search dynamics are well approximated by a stochastic sampling process. We use the described networks to reproduce perceptual multistability phenomena with switching times that are a good match to experimental data and show that they provide a general neural framework that can be used to model other perceptual inference phenomena.

[1]  Michael J Shelley,et al.  Searching for Autocoherence in the Cortical Network with a Time-Frequency Analysis of the Local Field Potential , 2010, The Journal of Neuroscience.

[2]  S. Strogatz From Kuramoto to Crawford: exploring the onset of synchronization in populations of coupled oscillators , 2000 .

[3]  Marco Idiart,et al.  A Second Function of Gamma Frequency Oscillations: An E%-Max Winner-Take-All Mechanism Selects Which Cells Fire , 2009, The Journal of Neuroscience.

[4]  T. Womelsdorf,et al.  Attentional Stimulus Selection through Selective Synchronization between Monkey Visual Areas , 2012, Neuron.

[5]  K. Deisseroth,et al.  Parvalbumin neurons and gamma rhythms enhance cortical circuit performance , 2009, Nature.

[6]  J. Maunsell,et al.  Differences in Gamma Frequencies across Visual Cortex Restrict Their Possible Use in Computation , 2010, Neuron.

[7]  Giacomo Indiveri,et al.  Recurrent networks of coupled Winner-Take-All oscillators for solving constraint satisfaction problems , 2013, NIPS.

[8]  Fiona E. N. LeBeau,et al.  Multiple origins of the cortical gamma rhythm , 2011, Developmental neurobiology.

[9]  Christoph Braun,et al.  Coherence of gamma-band EEG activity as a basis for associative learning , 1999, Nature.

[10]  Pascal Mamassian,et al.  Temporal dynamics in bistable perception. , 2005, Journal of vision.

[11]  Jessica A. Cardin,et al.  Driving fast-spiking cells induces gamma rhythm and controls sensory responses , 2009, Nature.

[12]  W. Singer,et al.  The gamma cycle , 2007, Trends in Neurosciences.

[13]  P. Fries Neuronal gamma-band synchronization as a fundamental process in cortical computation. , 2009, Annual review of neuroscience.

[14]  H. Markram,et al.  Interneurons of the neocortical inhibitory system , 2004, Nature Reviews Neuroscience.

[15]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[16]  J. Fell,et al.  Memory formation by neuronal synchronization , 2006, Brain Research Reviews.

[17]  Karl J. Friston Learning and inference in the brain , 2003, Neural Networks.

[18]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[19]  G. Tononi,et al.  Breakdown of Cortical Effective Connectivity During Sleep , 2005, Science.

[20]  R. Sundareswara,et al.  Perceptual multistability predicted by search model for Bayesian decisions. , 2008, Journal of vision.

[21]  P Rappelsberger,et al.  Long-range EEG synchronization during word encoding correlates with successful memory performance. , 2000, Brain research. Cognitive brain research.

[22]  P. J. Sjöström,et al.  Rate, Timing, and Cooperativity Jointly Determine Cortical Synaptic Plasticity , 2001, Neuron.

[23]  P. Fries,et al.  Robust Gamma Coherence between Macaque V1 and V2 by Dynamic Frequency Matching , 2013, Neuron.

[24]  H. Markram,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997, Science.

[25]  Nicolas Brunel,et al.  Dynamics of the Firing Probability of Noisy Integrate-and-Fire Neurons , 2002, Neural Computation.

[26]  James L. McClelland,et al.  Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations , 1986 .

[27]  Shane Lee,et al.  Cortical Gamma Rhythms Modulate NMDAR-Mediated Spike Timing Dependent Plasticity in a Biophysical Model , 2009, PLoS Comput. Biol..

[28]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  G. Buzsáki,et al.  Mechanisms of gamma oscillations. , 2012, Annual review of neuroscience.

[30]  J. Fell,et al.  The role of phase synchronization in memory processes , 2011, Nature Reviews Neuroscience.

[31]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[32]  A. von Stein,et al.  Different frequencies for different scales of cortical integration: from local gamma to long range alpha/theta synchronization. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[33]  Wolfgang Maass,et al.  Probabilistic Inference in General Graphical Models through Sampling in Stochastic Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[34]  E. Rolls,et al.  Attention and working memory: a dynamical model of neuronal activity in the prefrontal cortex , 2003, The European journal of neuroscience.

[35]  G. Buzsáki,et al.  Neuronal Oscillations in Cortical Networks , 2004, Science.

[36]  O. Bertrand,et al.  Oscillatory gamma-band (30-70 Hz) activity induced by a visual search task in humans. , 1997, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[37]  Maurizio Mattia,et al.  Collective Behavior of Networks with Linear (VLSI) Integrate-and-Fire Neurons , 1999, Neural Computation.

[38]  W. Singer,et al.  Modulation of Neuronal Interactions Through Neuronal Synchronization , 2007, Science.

[39]  T. Sejnowski,et al.  Cortical Enlightenment: Are Attentional Gamma Oscillations Driven by ING or PING? , 2009, Neuron.

[40]  P. Fries A mechanism for cognitive dynamics: neuronal communication through neuronal coherence , 2005, Trends in Cognitive Sciences.

[41]  J. Pernier,et al.  Oscillatory γ-Band (30–70 Hz) Activity Induced by a Visual Search Task in Humans , 1997, The Journal of Neuroscience.

[42]  Joshua B. Tenenbaum,et al.  Multistability and Perceptual Inference , 2012, Neural Computation.

[43]  D. Amit,et al.  Model of global spontaneous activity and local structured activity during delay periods in the cerebral cortex. , 1997, Cerebral cortex.

[44]  M. Mattia,et al.  Population dynamics of interacting spiking neurons. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[45]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[46]  Haim Sompolinsky,et al.  The Theory of Neural Networks: The Hebb Rule and Beyond , 1987 .

[47]  Wolfgang Maass,et al.  Neural Dynamics as Sampling: A Model for Stochastic Computation in Recurrent Networks of Spiking Neurons , 2011, PLoS Comput. Biol..

[48]  Daniel J. Amit,et al.  Constraints on learning in dynamic synapses , 1992, Network: Computation in Neural Systems.

[49]  Bruce W. Knight,et al.  Dynamics of Encoding in Neuron Populations: Some General Mathematical Features , 2000, Neural Computation.

[50]  Roger D. Traub,et al.  Dual Gamma Rhythm Generators Control Interlaminar Synchrony in Auditory Cortex , 2011, The Journal of Neuroscience.

[51]  Jean-Jacques E. Slotine,et al.  Competition Through Selective Inhibitory Synchrony , 2012, Neural Computation.

[52]  John J. Hopfield,et al.  Searching for Memories, Sudoku, Implicit Check Bits, and the Iterative Use of Not-Always-Correct Rapid Neural Computation , 2006, Neural Computation.

[53]  KongFatt Wong-Lin,et al.  Neural Circuit Dynamics Underlying Accumulation of Time-Varying Evidence During Perceptual Decision Making , 2007, Frontiers Comput. Neurosci..

[54]  Daniel Kersten,et al.  Bayesian models of object perception , 2003, Current Opinion in Neurobiology.

[55]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[56]  Karl J. Friston Functional and effective connectivity in neuroimaging: A synthesis , 1994 .

[57]  G. Kane Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol 1: Foundations, vol 2: Psychological and Biological Models , 1994 .

[58]  D. Knill,et al.  Apparent surface curvature affects lightness perception , 1991, Nature.

[59]  Stefan Habenschuss,et al.  Stochastic Computations in Cortical Microcircuit Models , 2013, PLoS Comput. Biol..

[60]  J. J. Hopfield,et al.  “Neural” computation of decisions in optimization problems , 1985, Biological Cybernetics.

[61]  Xiao-Jing Wang,et al.  What determines the frequency of fast network oscillations with irregular neural discharges? I. Synaptic dynamics and excitation-inhibition balance. , 2003, Journal of neurophysiology.

[62]  Marvin Minsky,et al.  Perceptrons: An Introduction to Computational Geometry , 1969 .

[63]  Terrence J. Sejnowski,et al.  Regulating Cortical Oscillations in an Inhibition-Stabilized Network , 2014, Proceedings of the IEEE.