A data-informed mean-field approach to mapping of cortical parameter landscapes

Constraining the many biological parameters that govern cortical dynamics is computationally and conceptually difficult because of the curse of dimensionality. This paper addresses these challenges by proposing (1) a novel data-informed mean-field (MF) approach to efficiently map the parameter space of network models; and (2) an organizing principle for studying parameter space that enables the extraction biologically meaningful relations from this high-dimensional data. We illustrate these ideas using a large-scale network model of the Macaque primary visual cortex. Of the 10-20 model parameters, we identify 7 that are especially poorly constrained, and use the MF algorithm in (1) to discover the firing rate contours in this 7D parameter cube. Defining a "biologically plausible" region to consist of parameters that exhibit spontaneous Excitatory and Inhibitory firing rates compatible with experimental values, we find that this region is a slightly thickened codimension-1 submanifold. An implication of this finding is that while plausible regimes depend sensitively on parameters, they are also robust and flexible provided one compensates appropriately when parameters are varied. Our organizing principle for conceptualizing parameter dependence is to focus on certain 2D parameter planes that govern lateral inhibition: Intersecting these planes with the biologically plausible region leads to very simple geometric structures which, when suitably scaled, have a universal character independent of where the intersections are taken. In addition to elucidating the geometry of the plausible region, this invariance suggests useful approximate scaling relations. Our study offers, for the first time, a complete characterization of the set of all biologically plausible parameters for a detailed cortical model, which has been out of reach due to the high dimensionality of parameter space.

[1]  Karl J. Friston,et al.  Cortical circuits for perceptual inference , 2009, Neural Networks.

[2]  Eleanor A. Maguire,et al.  Thoughts, behaviour, and brain dynamics during navigation in the real world , 2006, NeuroImage.

[3]  Jonas Obleser,et al.  The Brain Dynamics of Rapid Perceptual Adaptation to Adverse Listening Conditions , 2013, The Journal of Neuroscience.

[4]  Surya Ganguli,et al.  Statistical Mechanics of Deep Learning , 2020, Annual Review of Condensed Matter Physics.

[5]  Paul C. Bressloff,et al.  Neural field model of binocular rivalry waves , 2012, Journal of Computational Neuroscience.

[6]  P. Bressloff,et al.  Effects of synaptic depression and adaptation on spatiotemporal dynamics of an excitatory neuronal network , 2010 .

[7]  Stephen Grossberg,et al.  Absolute stability of global pattern formation and parallel memory storage by competitive neural networks , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[8]  M. Sigman,et al.  Signature of consciousness in the dynamics of resting-state brain activity , 2015, Proceedings of the National Academy of Sciences.

[9]  J. Lund,et al.  Anatomical organization of macaque monkey striate visual cortex. , 1988, Annual review of neuroscience.

[10]  Partha P. Mitra,et al.  Observed Brain Dynamics , 2007 .

[11]  Duane Q. Nykamp,et al.  A Population Density Approach That Facilitates Large-Scale Modeling of Neural Networks: Analysis and an Application to Orientation Tuning , 2004, Journal of Computational Neuroscience.

[12]  J. Touboul Propagation of chaos in neural fields , 2011, 1108.2414.

[13]  A. Burkhalter,et al.  Functional Role of the Fast Transient Outward K+ Current IA in Pyramidal Neurons in (Rat) Primary Visual Cortex , 2005, The Journal of Neuroscience.

[14]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[15]  Rainer Engelken,et al.  Dynamical models of cortical circuits , 2014, Current Opinion in Neurobiology.

[16]  D. Alistair Steyn-Ross,et al.  Gap junctions modulate seizures in a mean-field model of general anesthesia for the cortex , 2012, Cognitive Neurodynamics.

[17]  J. Cowan,et al.  A mathematical theory of visual hallucination patterns , 1979, Biological Cybernetics.

[18]  Klaus Obermayer,et al.  A mean-field model for orientation tuning, contrast saturation, and contextual effects in the primary visual cortex , 2000, Biological Cybernetics.

[19]  R. Shapley,et al.  Contrast response in a comprehensive network model of macaque V1 , 2020, Journal of vision.

[20]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[21]  Karl J. Friston,et al.  Modules or Mean-Fields? , 2020, Entropy.

[22]  J. Rinzel,et al.  Excitable dynamics of NREM sleep: a unifying model for neocortex and hippocampus , 2018, bioRxiv.

[23]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[24]  S Coombes,et al.  Dynamics of synaptically coupled integrate-and-fire-or-burst neurons. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[25]  Sacha Jennifer van Albada,et al.  Mean-field modeling of the basal ganglia-thalamocortical system. II Dynamics of parkinsonian oscillations. , 2009, Journal of theoretical biology.

[26]  Peter Dayan,et al.  Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems , 2001 .

[27]  Arjen van Ooyen,et al.  The need for integrating neuronal morphology databases and computational environments in exploring neuronal structure and function , 2001, Anatomy and Embryology.

[28]  K. Harris,et al.  A Simple Model of Cortical Dynamics Explains Variability and State Dependence of Sensory Responses in Urethane-Anesthetized Auditory Cortex , 2009, The Journal of Neuroscience.

[29]  H. Bungartz,et al.  Sparse grids , 2004, Acta Numerica.

[30]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[31]  D. Debanne,et al.  Axon physiology. , 2011, Physiological reviews.

[32]  Hongkui Zeng,et al.  Neuronal cell-type classification: challenges, opportunities and the path forward , 2017, Nature Reviews Neuroscience.

[33]  B. Connors,et al.  Two networks of electrically coupled inhibitory neurons in neocortex , 1999, Nature.

[34]  M. Shelley,et al.  An effective kinetic representation of fluctuation-driven neuronal networks with application to simple and complex cells in visual cortex. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[35]  Xiao-Jing Wang,et al.  Mean-Field Theory of Irregularly Spiking Neuronal Populations and Working Memory in Recurrent Cortical Networks , 2003 .

[36]  Kenneth D Harris,et al.  Stochastic transitions into silence cause noise correlations in cortical circuits , 2015, Proceedings of the National Academy of Sciences.

[37]  Eric Shea-Brown,et al.  Linking structure and activity in nonlinear spiking networks , 2016, bioRxiv.

[38]  Shawn R. Olsen,et al.  Translaminar Inhibitory Cells Recruited by Layer 6 Corticothalamic Neurons Suppress Visual Cortex , 2014, Neuron.

[39]  J. Rinzel,et al.  Noise-induced alternations in an attractor network model of perceptual bistability. , 2007, Journal of neurophysiology.

[40]  Ingo Bojak,et al.  Interface dynamics in planar neural field models , 2012, Journal of mathematical neuroscience.

[41]  Sacha Jennifer van Albada,et al.  Mean-field modeling of the basal ganglia-thalamocortical system. I Firing rates in healthy and parkinsonian states. , 2009, Journal of theoretical biology.

[42]  Eric Shea-Brown,et al.  From the statistics of connectivity to the statistics of spike times in neuronal networks , 2017, Current Opinion in Neurobiology.

[43]  Paul C. Bressloff,et al.  Stochastic Neural Field Theory and the System-Size Expansion , 2009, SIAM J. Appl. Math..

[44]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[45]  Xiao-Jing Wang,et al.  Probabilistic Decision Making by Slow Reverberation in Cortical Circuits , 2002, Neuron.

[46]  M. Scanziani,et al.  How Cortical Circuits Implement Cortical Computations: Mouse Visual Cortex as a Model. , 2021, Annual review of neuroscience.

[47]  Louis Tao,et al.  KINETIC THEORY FOR NEURONAL NETWORK DYNAMICS , 2006 .

[48]  D. Hubel,et al.  Receptive fields, binocular interaction and functional architecture in the cat's visual cortex , 1962, The Journal of physiology.

[49]  Christof Koch,et al.  Biophysics of Computation: Information Processing in Single Neurons (Computational Neuroscience Series) , 1998 .

[50]  D. Wake,et al.  Cell size predicts morphological complexity in the brains of frogs and salamanders. , 1994, Proceedings of the National Academy of Sciences of the United States of America.

[51]  Olivier D. Faugeras,et al.  A Constructive Mean-Field Analysis of Multi-Population Neural Networks with Random Synaptic Weights and Stochastic Inputs , 2008, Front. Comput. Neurosci..

[52]  Alessandro Treves,et al.  The emergence of grid cells: Intelligent design or just adaptation? , 2008, Hippocampus.

[53]  Lai-Sang Young,et al.  Orientation Selectivity from Very Sparse LGN Inputs in a Comprehensive Model of Macaque V1 Cortex , 2016, The Journal of Neuroscience.

[54]  S. Hestrin,et al.  A network of fast-spiking cells in the neocortex connected by electrical synapses , 1999, Nature.

[55]  Laurent Venance,et al.  Interplay of multiple pathways and activity-dependent rules in STDP , 2018, PLoS Comput. Biol..

[56]  Nicolas Brunel,et al.  Fast Global Oscillations in Networks of Integrate-and-Fire Neurons with Low Firing Rates , 1999, Neural Computation.

[57]  Wulfram Gerstner,et al.  Population Dynamics of Spiking Neurons: Fast Transients, Asynchronous States, and Locking , 2000, Neural Computation.

[58]  Paul C. Bressloff,et al.  Path-Integral Methods for Analyzing the Effects of Fluctuations in Stochastic Hybrid Neural Networks , 2015, The Journal of Mathematical Neuroscience (JMN).

[59]  Carson C. Chow,et al.  Stationary Bumps in Networks of Spiking Neurons , 2001, Neural Computation.

[60]  Nicolas Brunel,et al.  Can Attractor Network Models Account for the Statistics of Firing During Persistent Activity in Prefrontal Cortex? , 2008, Front. Neurosci..

[61]  Louis Tao,et al.  Dimensional reduction of emergent spatiotemporal cortical dynamics via a maximum entropy moment closure , 2020, PLoS computational biology.

[62]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[63]  J. Cowan,et al.  A mathematical theory of the functional dynamics of cortical and thalamic nervous tissue , 1973, Kybernetik.

[64]  Nicolas Brunel,et al.  Irregular Persistent Activity Induced by Synaptic Excitatory Feedback , 2007, Frontiers Comput. Neurosci..

[65]  Christian Igel,et al.  A Dynamic Neural Field Model of Mesoscopic Cortical Activity Captured with Voltage-Sensitive Dye Imaging , 2010, PLoS Comput. Biol..

[66]  R. Shapley,et al.  Orientation Selectivity in Macaque V1: Diversity and Laminar Dependence , 2002, The Journal of Neuroscience.

[67]  S. Dehaene,et al.  Brain Dynamics Underlying the Nonlinear Threshold for Access to Consciousness , 2007, PLoS biology.

[68]  K. Svoboda,et al.  Recurrent interactions in local cortical circuits , 2020, Nature.

[69]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[70]  J. B. Levitt,et al.  Circuits for Local and Global Signal Integration in Primary Visual Cortex , 2002, The Journal of Neuroscience.

[71]  J. Touboul,et al.  Mean-field description and propagation of chaos in networks of Hodgkin-Huxley and FitzHugh-Nagumo neurons , 2012, The Journal of Mathematical Neuroscience.

[72]  G. Turrigiano Homeostatic synaptic plasticity: local and global mechanisms for stabilizing neuronal function. , 2012, Cold Spring Harbor perspectives in biology.

[73]  Jeffrey S. Johnson,et al.  A Dynamic Neural Field Model of Visual Working Memory and Change Detection , 2009, Psychological science.

[74]  Alain Destexhe,et al.  Modeling mesoscopic cortical dynamics using a mean-field model of conductance-based networks of adaptive exponential integrate-and-fire neurons , 2017, bioRxiv.

[75]  Paul C. Bressloff,et al.  Phase Equation for Patterns of Orientation Selectivity in a Neural Field Model of Visual Cortex , 2016, SIAM J. Appl. Dyn. Syst..

[76]  Leonardo L. Gollo,et al.  Time-resolved resting-state brain networks , 2014, Proceedings of the National Academy of Sciences.

[77]  Louis Tao,et al.  A coarse-graining framework for spiking neuronal networks: from strongly-coupled conductance-based integrate-and-fire neurons to augmented systems of ODEs , 2019, Journal of Computational Neuroscience.

[78]  R. Douglas,et al.  Neuronal circuits of the neocortex. , 2004, Annual review of neuroscience.

[79]  B. Connors,et al.  Two dynamically distinct inhibitory networks in layer 4 of the neocortex. , 2003, Journal of neurophysiology.

[80]  A. Treves Mean-field analysis of neuronal spike dynamics , 1993 .

[81]  Michael A. Buice,et al.  Path Integral Methods for Stochastic Differential Equations , 2015, Journal of mathematical neuroscience.

[82]  David Terman,et al.  Mathematical foundations of neuroscience , 2010 .

[83]  Stephen Coombes,et al.  Waves, bumps, and patterns in neural field theories , 2005, Biological Cybernetics.

[84]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[85]  E. Callaway Local circuits in primary visual cortex of the macaque monkey. , 1998, Annual review of neuroscience.

[86]  P. Kenny,et al.  MicroRNAs in neuronal function and dysfunction , 2012, Trends in Neurosciences.

[87]  Jonathan D Victor,et al.  Large-scale brain dynamics in disorders of consciousness , 2014, Current Opinion in Neurobiology.

[88]  Bruce L. McNaughton,et al.  A Model of the Neural Basis of the Rat's Sense of Direction , 1994, NIPS.

[89]  Alain Destexhe,et al.  A Master Equation Formalism for Macroscopic Modeling of Asynchronous Irregular Activity States , 2009, Neural Computation.

[90]  A. Reyes,et al.  Spatial Profile of Excitatory and Inhibitory Synaptic Connectivity in Mouse Primary Auditory Cortex , 2012, The Journal of Neuroscience.

[91]  Lai-Sang Young,et al.  Emergent spike patterns in neuronal populations , 2014, Journal of Computational Neuroscience.

[92]  M. Mattia,et al.  Population dynamics of interacting spiking neurons. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[93]  M. Golubitsky,et al.  Geometric visual hallucinations, Euclidean symmetry and the functional architecture of striate cortex. , 2001, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[94]  K. Martin,et al.  Excitatory synaptic inputs to spiny stellate cells in cat visual cortex , 1996, Nature.

[95]  David J. Freedman,et al.  Inferring learning rules from distribution of firing rates in cortical neurons , 2015, Nature Neuroscience.