Computing by modulating spontaneous cortical activity patterns as a mechanism of active visual processing

Cortical populations produce complex spatiotemporal activity spontaneously without sensory inputs. However, the fundamental computational roles of such spontaneous activity remain unclear. Here, we propose a new neural computation mechanism for understanding how spontaneous activity is actively involved in cortical processing: Computing by Modulating Spontaneous Activity (CMSA). Using biophysically plausible circuit models, we demonstrate that spontaneous activity patterns with dynamical properties, as found in empirical observations, are modulated or redistributed by external stimuli to give rise to neural responses. We find that this CMSA mechanism of generating neural responses provides profound computational advantages, such as actively speeding up cortical processing. We further reveal that the CMSA mechanism provides a unifying explanation for many experimental findings at both the single-neuron and circuit levels, and that CMSA in response to natural stimuli such as face images is the underlying neurophysiological mechanism of perceptual “bubbles” as found in psychophysical studies. The brain’s cortex shows complex activity patterns in the absence of sensory inputs. Here, using computational modelling, the authors demonstrate that cortical spontaneous activity is modulated by sensory input and that this modulation process underlies active visual processing.

[1]  J. A. Henderson,et al.  Dynamical patterns underlying response properties of cortical circuits , 2018, Journal of The Royal Society Interface.

[2]  R. Douglas,et al.  A Quantitative Map of the Circuit of Cat Primary Visual Cortex , 2004, The Journal of Neuroscience.

[3]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[4]  József Fiser,et al.  Spontaneous Cortical Activity Reveals Hallmarks of an Optimal Internal Model of the Environment , 2011, Science.

[5]  R. Shapley,et al.  Contrast's effect on spatial summation by macaque V1 neurons , 1999, Nature Neuroscience.

[6]  O. Kinouchi,et al.  Optimal dynamical range of excitable networks at criticality , 2006, q-bio/0601037.

[7]  Andrew C. N. Chen,et al.  Mapping cortical mesoscopic networks of single spiking cortical or sub-cortical neurons , 2017, eLife.

[8]  A. Oliva,et al.  Dr. Angry and Mr. Smile: when categorization flexibly modifies the perception of faces in rapid visual presentations , 1999, Cognition.

[9]  Justin L. Vincent,et al.  Intrinsic Fluctuations within Cortical Systems Account for Intertrial Variability in Human Behavior , 2007, Neuron.

[10]  Woodrow L. Shew,et al.  Scale-Change Symmetry in the Rules Governing Neural Systems , 2019, iScience.

[11]  D. Gilden Cognitive emissions of 1/f noise. , 2001, Psychological review.

[12]  Maurizio Corbetta,et al.  The human brain is intrinsically organized into dynamic, anticorrelated functional networks. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Stephen Coombes,et al.  Waves, bumps, and patterns in neural field theories , 2005, Biological Cybernetics.

[14]  Pulin Gong,et al.  Detection and analysis of spatiotemporal patterns in brain activity , 2018, PLoS Comput. Biol..

[15]  Dario L Ringach,et al.  Spontaneous and driven cortical activity: implications for computation , 2009, Current Opinion in Neurobiology.

[16]  Matthias Kaschube,et al.  Distributed network interactions and their emergence in developing neocortex , 2018, Nature Neuroscience.

[17]  D. Chialvo Emergent complex neural dynamics , 2010, 1010.2530.

[18]  Tatsuo K Sato,et al.  Traveling Waves in Visual Cortex , 2012, Neuron.

[19]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[20]  D. Plenz,et al.  Neuronal avalanches organize as nested theta- and beta/gamma-oscillations during development of cortical layer 2/3 , 2008, Proceedings of the National Academy of Sciences.

[21]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[22]  Thomas Miconi,et al.  Spontaneous emergence of fast attractor dynamics in a model of developing primary visual cortex , 2016, Nature Communications.

[23]  Lubeck,et al.  Scaling of waves in the bak-tang-wiesenfeld sandpile model , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[24]  A. Grinvald,et al.  Dynamics of Ongoing Activity: Explanation of the Large Variability in Evoked Cortical Responses , 1996, Science.

[25]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2016, Texts in Computer Science.

[26]  K. Linkenkaer-Hansen,et al.  Critical-State Dynamics of Avalanches and Oscillations Jointly Emerge from Balanced Excitation/Inhibition in Neuronal Networks , 2012, The Journal of Neuroscience.

[27]  R. Yuste,et al.  Visual stimuli recruit intrinsically generated cortical ensembles , 2014, Proceedings of the National Academy of Sciences.

[28]  A. Reyes,et al.  Spatial Profile of Excitatory and Inhibitory Synaptic Connectivity in Mouse Primary Auditory Cortex , 2012, The Journal of Neuroscience.

[29]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[30]  Andrew M. Clark,et al.  Stimulus onset quenches neural variability: a widespread cortical phenomenon , 2010, Nature Neuroscience.

[31]  D. Burr,et al.  Two-dimensional spatial and spatial-frequency selectivity of motion-sensitive mechanisms in human vision. , 1991, Journal of the Optical Society of America. A, Optics and image science.

[32]  Pulin Gong,et al.  Propagating Waves Can Explain Irregular Neural Dynamics , 2015, The Journal of Neuroscience.

[33]  Ronald L. Rivest,et al.  On Estimating the Size and Confidence of a Statistical Audit , 2007, EVT.

[34]  M. Colonnier,et al.  A laminar analysis of the number of round‐asymmetrical and flat‐symmetrical synapses on spines, dendritic trunks, and cell bodies in area 17 of the cat , 1985, The Journal of comparative neurology.

[35]  D. Abrams,et al.  Chimera states: coexistence of coherence and incoherence in networks of coupled oscillators , 2014, 1403.6204.

[36]  D. V. van Essen,et al.  Spatial Embedding and Wiring Cost Constrain the Functional Layout of the Cortical Network of Rodents and Primates , 2016, PLoS biology.

[37]  J. Duyn,et al.  Time-varying functional network information extracted from brief instances of spontaneous brain activity , 2013, Proceedings of the National Academy of Sciences.

[38]  A. Grinvald,et al.  Linking spontaneous activity of single cortical neurons and the underlying functional architecture. , 1999, Science.

[39]  Gustavo Deco,et al.  Stimulus-dependent variability and noise correlations in cortical MT neurons , 2013, Proceedings of the National Academy of Sciences.

[40]  C. Koch,et al.  Recurrent excitation in neocortical circuits , 1995, Science.

[41]  Terrence J. Sejnowski,et al.  Cortical travelling waves: mechanisms and computational principles , 2018, Nature Reviews Neuroscience.

[42]  A. Litwin-Kumar,et al.  Slow dynamics and high variability in balanced cortical networks with clustered connections , 2012, Nature Neuroscience.

[43]  C. Gray,et al.  Cellular Mechanisms Contributing to Response Variability of Cortical Neurons In Vivo , 1999, The Journal of Neuroscience.

[44]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[45]  L Mazzucato,et al.  Expectation-induced modulation of metastable activity underlies faster coding of sensory stimuli , 2017, Nature Neuroscience.

[46]  Woodrow L. Shew,et al.  Voltage Imaging of Waking Mouse Cortex Reveals Emergence of Critical Neuronal Dynamics , 2014, The Journal of Neuroscience.

[47]  Leonardo L. Gollo,et al.  Metastable brain waves , 2018, Nature Communications.

[48]  M. A. Muñoz,et al.  Landau–Ginzburg theory of cortex dynamics: Scale-free avalanches emerge at the edge of synchronization , 2018, Proceedings of the National Academy of Sciences.

[49]  Woodrow L. Shew,et al.  Adaptation to sensory input tunes visual cortex to criticality , 2015, Nature Physics.

[50]  Wulfram Gerstner,et al.  Neuronal Dynamics: From Single Neurons To Networks And Models Of Cognition , 2014 .

[51]  H. Sompolinsky,et al.  13 Modeling Feature Selectivity in Local Cortical Circuits , 2022 .

[52]  Gustavo Deco,et al.  Resting brains never rest: computational insights into potential cognitive architectures , 2013, Trends in Neurosciences.

[53]  Mark E. J. Newman,et al.  Power-Law Distributions in Empirical Data , 2007, SIAM Rev..

[54]  A. Pouget,et al.  Variance as a Signature of Neural Computations during Decision Making , 2011, Neuron.

[55]  Nikola T. Markov,et al.  Weight Consistency Specifies Regularities of Macaque Cortical Networks , 2010, Cerebral cortex.

[56]  Michael Okun,et al.  Instantaneous correlation of excitation and inhibition during ongoing and sensory-evoked activities , 2008, Nature Neuroscience.

[57]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[58]  Jean-Baptiste Caussin,et al.  Emergence of macroscopic directed motion in populations of motile colloids , 2013, Nature.

[59]  A. Grinvald,et al.  Spontaneously emerging cortical representations of visual attributes , 2003, Nature.

[60]  H. B. Barlow,et al.  What does the eye see best? , 1983, Nature.

[61]  J. Reynolds,et al.  Attentional modulation of visual processing. , 2004, Annual review of neuroscience.

[62]  Frédéric Gosselin,et al.  Bubbles: a technique to reveal the use of information in recognition tasks , 2001, Vision Research.

[63]  Woodrow L. Shew,et al.  Maximal Variability of Phase Synchrony in Cortical Networks with Neuronal Avalanches , 2012, The Journal of Neuroscience.

[64]  David J. Field,et al.  How Close Are We to Understanding V1? , 2005, Neural Computation.

[65]  G. Parisi,et al.  Scale-free correlations in starling flocks , 2009, Proceedings of the National Academy of Sciences.

[66]  Woodrow L. Shew,et al.  Neuronal Avalanches Imply Maximum Dynamic Range in Cortical Networks at Criticality , 2009, The Journal of Neuroscience.

[67]  D. Plenz,et al.  Criticality in neural systems , 2014 .

[68]  Woodrow L. Shew,et al.  State-dependent intrinsic predictability of cortical network dynamics , 2015, PLoS Comput. Biol..

[69]  R. Yuste,et al.  Dense Inhibitory Connectivity in Neocortex , 2011, Neuron.

[70]  H. Swinney,et al.  Collective motion and density fluctuations in bacterial colonies , 2010, Proceedings of the National Academy of Sciences.

[71]  P. Bressloff Spatiotemporal dynamics of continuum neural fields , 2012 .

[72]  Pierre Vandergheynst,et al.  FREAK: Fast Retina Keypoint , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[73]  M. A. Muñoz,et al.  Griffiths phases and the stretching of criticality in brain networks , 2013, Nature Communications.

[74]  M. Weliky,et al.  Small modulation of ongoing cortical dynamics by sensory input during natural vision , 2004, Nature.

[75]  G. Germano,et al.  First-passage and first-exit times of a Bessel-like stochastic process. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.