Energy-based stochastic control of neural mass models suggests time-varying effective connectivity in the resting state

Several studies posit energy as a constraint on the coding and processing of information in the brain due to the high cost of resting and evoked cortical activity. This suggestion has been addressed theoretically with models of a single neuron and two coupled neurons. Neural mass models (NMMs) address mean-field based modeling of the activity and interactions between populations of neurons rather than a few neurons. NMMs have been widely employed for studying the generation of EEG rhythms, and more recently as frameworks for integrated models of neurophysiology and functional MRI (fMRI) responses. To date, the consequences of energy constraints on the activity and interactions of ensembles of neurons have not been addressed. Here we aim to study the impact of constraining energy consumption during the resting-state on NMM parameters. To this end, we first linearized the model, then used stochastic control theory by introducing a quadratic cost function, which transforms the NMM into a stochastic linear quadratic regulator (LQR). Solving the LQR problem introduces a regime in which the NMM parameters, specifically the effective connectivities between neuronal populations, must vary with time. This is in contrast to current NMMs, which assume a constant parameter set for a given condition or task. We further simulated energy-constrained stochastic control of a specific NMM, the Wilson and Cowan model of two coupled neuronal populations, one of which is excitatory and the other inhibitory. These simulations demonstrate that with varying weights of the energy-cost function, the NMM parameters show different time-varying behavior. We conclude that constraining NMMs according to energy consumption may create more realistic models. We further propose to employ linear NMMs with time-varying parameters as an alternative to traditional nonlinear NMMs with constant parameters.

[1]  Jan Karbowski,et al.  How Does Connectivity Between Cortical Areas Depend on Brain Size? Implications for Efficient Computation , 2003, Journal of Computational Neuroscience.

[2]  Jose M. Sanchez-Bornot,et al.  Model driven EEG/fMRI fusion of brain oscillations , 2009, Human brain mapping.

[3]  Alicia D'Anjou,et al.  Energy consumption and information transmission in model neurons , 2009 .

[4]  Jörg R. P. Geiger,et al.  Energy-Efficient Action Potentials in Hippocampal Mossy Fibers , 2009, Science.

[5]  Hamid Soltanian-Zadeh,et al.  Integrated MEG/EEG and fMRI model based on neural masses , 2006, IEEE Transactions on Biomedical Engineering.

[6]  Amir Shmuel,et al.  Anatomically-constrained effective connectivity among layers in a cortical column modeled and estimated from local field potentials. , 2010, Journal of integrative neuroscience.

[7]  S. Laughlin Energy as a constraint on the coding and processing of sensory information , 2001, Current Opinion in Neurobiology.

[8]  Konrad Paul Kording,et al.  Review TRENDS in Cognitive Sciences Vol.10 No.7 July 2006 Special Issue: Probabilistic models of cognition Bayesian decision theory in sensorimotor control , 2022 .

[9]  Alicia D'Anjou,et al.  Energy efficiency of information transmission by electrically coupled neurons , 2009, Biosyst..

[10]  Karl J. Friston,et al.  Bayesian estimation of synaptic physiology from the spectral responses of neural masses , 2008, NeuroImage.

[11]  M. Turelli Random environments and stochastic calculus. , 1977, Theoretical population biology.

[12]  W. Wonham On a Matrix Riccati Equation of Stochastic Control , 1968 .

[13]  B. Katz,et al.  Membrane Noise produced by Acetylcholine , 1970, Nature.

[14]  J. Niven Brains, islands and evolution: breaking all the rules. , 2007, Trends in ecology & evolution.

[15]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005, J. Field Robotics.

[16]  A V Herz,et al.  Neural codes: firing rates and beyond. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[17]  Xun Yu Zhou,et al.  Constrained Stochastic LQ Control with Random Coefficients, and Application to Portfolio Selection , 2005, SIAM J. Control. Optim..

[18]  C. Johnson,et al.  Limits of propriety for linear-quadratic regulator problems , 1987 .

[19]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[20]  Anton A. Stoorvogel,et al.  Linear quadratic regulator problem with positive controls , 1998 .

[21]  Adelbert Ames,et al.  CNS energy metabolism as related to function , 2000, Brain Research Reviews.

[22]  Stephen P. Banks,et al.  Linear, Time-varying Approximations to Nonlinear Dynamical Systems: with Applications in Control and Optimization , 2010 .

[23]  Energy-Efficient Action Potentials in Hippocampal , 2009 .

[24]  Jianfeng Feng,et al.  Optimal control of neuronal activity. , 2003, Physical review letters.

[25]  Donald O. Walter,et al.  Mass action in the nervous system , 1975 .

[26]  S. Highstein,et al.  Depletion of vesicles and fatigue of transmission at a vertebrate central synapse , 1975, Brain Research.

[27]  Terrence J Sejnowski,et al.  Communication in Neuronal Networks , 2003, Science.

[28]  M. Bennett,et al.  Statistics of transmitter release at nerve terminals , 2000, Progress in Neurobiology.

[29]  Karl J. Friston,et al.  The Dynamic Brain: From Spiking Neurons to Neural Masses and Cortical Fields , 2008, PLoS Comput. Biol..

[30]  Anders M. Dale,et al.  Estimation of Thalamocortical and Intracortical Network Models from Joint Thalamic Single-Electrode and Cortical Laminar-Electrode Recordings in the Rat Barrel System , 2009, PLoS Comput. Biol..

[31]  S. Laughlin,et al.  Energy limitation as a selective pressure on the evolution of sensory systems , 2008, Journal of Experimental Biology.

[32]  D. Chklovskii,et al.  Maps in the brain: what can we learn from them? , 2004, Annual review of neuroscience.

[33]  William B. Levy,et al.  Energy Efficient Neural Codes , 1996, Neural Computation.

[34]  Xun Yu Zhou,et al.  Stochastic Linear Quadratic Regulators with Indefinite Control Weight Costs. II , 2000, SIAM J. Control. Optim..

[35]  Olivier D. Faugeras,et al.  Persistent Neural States: Stationary Localized Activity Patterns in Nonlinear Continuous n-Population, q-Dimensional Neural Networks , 2009, Neural Computation.

[36]  P. Lennie The Cost of Cortical Computation , 2003, Current Biology.

[37]  Nelson J. Trujillo-Barreto,et al.  Biophysical model for integrating neuronal activity, EEG, fMRI and metabolism , 2008, NeuroImage.

[38]  Jordi García-Ojalvo,et al.  Relating structural and functional anomalous connectivity in the aging brain via neural mass modeling , 2010, NeuroImage.

[39]  S. Shreve,et al.  Stochastic differential equations , 1955, Mathematical Proceedings of the Cambridge Philosophical Society.

[40]  Olivier D. Faugeras,et al.  Bifurcation Analysis of Jansen's Neural Mass Model , 2006, Neural Computation.

[41]  Roberto C. Sotero,et al.  Dynamical Mean Field Model of a Neural-Glial Mass , 2010, Neural Computation.

[42]  Michael J. Berry,et al.  Metabolically Efficient Information Processing , 2001, Neural Computation.

[43]  Konrad Paul Kording,et al.  Bayesian integration in sensorimotor learning , 2004, Nature.

[44]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[45]  L. Kristiansson,et al.  Performance of a model for a local neuron population , 1978, Biological Cybernetics.

[46]  J. Montgomery,et al.  Discrete synaptic states define a major mechanism of synapse plasticity , 2004, Trends in Neurosciences.

[47]  D. Attwell,et al.  The neural basis of functional brain imaging signals , 2002, Trends in Neurosciences.

[48]  R. Martin Scaling of the Mammalian Brain: the Maternal Energy Hypothesis , 1996 .

[49]  Tayfun Çimen,et al.  State-Dependent Riccati Equation (SDRE) Control: A Survey , 2008 .

[50]  L. Maloney,et al.  Decision-theoretic models of visual perception and action , 2010, Vision Research.

[51]  Nelson J. Trujillo-Barreto,et al.  Realistically Coupled Neural Mass Models Can Generate EEG Rhythms , 2007, Neural Computation.

[52]  René L. Schilling Stochastic differential equations: An introduction with applications (6th edn), by Bernt Oksendal. Pp. 360. £27. 2004. ISBN 3 540 04758 1 (Springer-Verlag). , 2005, The Mathematical Gazette.

[53]  Ben H. Jansen,et al.  Electroencephalogram and visual evoked potential generation in a mathematical model of coupled cortical columns , 1995, Biological Cybernetics.

[54]  Andreas Spiegler,et al.  Bifurcation Analysis of Neural Mass Models , 2010 .

[55]  R. E. Kalman,et al.  Contributions to the Theory of Optimal Control , 1960 .

[56]  M. Raichle Two views of brain function , 2010, Trends in Cognitive Sciences.

[57]  Karl J. Friston,et al.  A neural mass model for MEG/EEG: coupling and neuronal dynamics , 2003, NeuroImage.

[58]  W. Wonham On the Separation Theorem of Stochastic Control , 1968 .

[59]  Nelson J. Trujillo-Barreto,et al.  Modelling the role of excitatory and inhibitory neuronal activity in the generation of the BOLD signal , 2007, NeuroImage.

[60]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[61]  T. Sejnowski,et al.  Metabolic cost as a unifying principle governing neuronal biophysics , 2010, Proceedings of the National Academy of Sciences.

[62]  Oliver Brock,et al.  Decomposition-based motion planning: a framework for real-time motion planning in high-dimensional configuration spaces , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[63]  Xi Chen,et al.  Stochastic Linear-Quadratic Control with Conic Control Constraints on an Infinite Time Horizon , 2004, SIAM J. Control. Optim..

[64]  Louis Sokoloff,et al.  Circulation and Energy Metabolism of the Brain , 1999 .

[65]  J E Niven,et al.  Shaker K+-channels are predicted to reduce the metabolic cost of neural information in Drosophila photoreceptors , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[66]  C. Granger Non-Linear Models: Where Do We Go Next - Time Varying Parameter Models? , 2008 .

[67]  Emmanuel Guigon,et al.  Optimality, stochasticity, and variability in motor behavior , 2008, Journal of Computational Neuroscience.

[68]  Emanuel Todorov,et al.  From task parameters to motor synergies: A hierarchical framework for approximately optimal control of redundant manipulators , 2005 .

[69]  Emanuel Todorov,et al.  Stochastic Optimal Control and Estimation Methods Adapted to the Noise Characteristics of the Sensorimotor System , 2005, Neural Computation.

[70]  B. Øksendal Stochastic Differential Equations , 1985 .

[71]  Olivier Faugeras,et al.  Persistent neural states: stationary localized activity patterns in nonlinear continuous n-population, q-dimensional neural networks. , 2009, Neural computation.

[72]  L. Maloney,et al.  Bayesian decision theory as a model of human visual perception: Testing Bayesian transfer , 2009, Visual Neuroscience.

[73]  F. H. Lopes da Silva,et al.  Model of brain rhythmic activity , 1974, Kybernetik.

[74]  L. Aiello,et al.  The Expensive-Tissue Hypothesis: The Brain and the Digestive System in Human and Primate Evolution , 1995, Current Anthropology.