A brain basis of dynamical intelligence for AI and computational neuroscience

The deep neural nets of modern artificial intelligence (AI) have not achieved defining features of biological intelligence, including abstraction, causal learning, and energy-efficiency. While scaling to larger models has delivered performance improvements for current applications, more brain-like capacities may demand new theories, models, and methods for designing artificial learning systems. Here, we argue that this opportunity to reassess insights from the brain should stimulate cooperation between AI research and theory-driven computational neuroscience (CN). To motivate a brain basis of neural computation, we present a dynamical view of intelligence from which we elaborate concepts of sparsity in network structure, temporal dynamics, and interactive learning. In particular, we suggest that temporal dynamics, as expressed through neural synchrony, nested oscillations, and flexible sequences, provide a rich computational layer for reading and updating hierarchical models distributed in long-term memory networks. Moreover, embracing agent-centered paradigms in AI and CN will accelerate our understanding of the complex dynamics and behaviors that build useful world models. A convergence of AI/CN theories and objectives will reveal dynamical principles of intelligence for brains and engineered learning systems. This article was inspired by our symposium on dynamical neuroscience and machine learning at the 6th Annual US/NIH BRAIN Initiative Investigators Meeting.

[1]  Todd K. Leen,et al.  Approximating distributions in stochastic learning , 2012, Neural Networks.

[2]  James Carson,et al.  BRAIN Initiative: Cutting-Edge Tools and Resources for the Community , 2019, The Journal of Neuroscience.

[3]  William B. Levy,et al.  T-maze training of a recurrent CA3 model reveals the necessity of novelty-based modulation of LTP in hippocampal region CA3 , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[4]  Wolfgang Lehrach,et al.  A detailed mathematical theory of thalamic and cortical microcircuits based on inference in a generative vision model , 2020, bioRxiv.

[5]  L. Nadel,et al.  Memory consolidation, retrograde amnesia and the hippocampal complex , 1997, Current Opinion in Neurobiology.

[6]  M. Brecht,et al.  Behavioral and neural correlates of hide-and-seek in rats , 2019, Science.

[7]  Hongxun Yao,et al.  A modular latching chain , 2013, Cognitive Neurodynamics.

[8]  Hansjörg Scherberger,et al.  Uniting functional network topology and oscillations in the fronto-parietal single unit network of behaving primates , 2016, eLife.

[9]  Daniel L. K. Yamins,et al.  Deep Neural Networks Rival the Representation of Primate IT Cortex for Core Visual Object Recognition , 2014, PLoS Comput. Biol..

[10]  T. Gelder,et al.  The dynamical hypothesis in cognitive science , 1998, Behavioral and Brain Sciences.

[11]  Nicolas Brunel,et al.  Contributions of intrinsic membrane dynamics to fast network oscillations with irregular neuronal discharges. , 2005, Journal of neurophysiology.

[12]  Martin Rehn,et al.  Attractor dynamics in a modular network model of neocortex , 2006, Network.

[13]  Ichiro Tsuda,et al.  Chaotic itinerancy and its roles in cognitive neurodynamics , 2015, Current Opinion in Neurobiology.

[14]  Gustavo Deco,et al.  Sequential Memory: A Putative Neural and Synaptic Dynamical Mechanism , 2005, Journal of Cognitive Neuroscience.

[15]  Anthony Maida,et al.  BP-STDP: Approximating Backpropagation using Spike Timing Dependent Plasticity , 2017, Neurocomputing.

[16]  Karl J. Friston Life as we know it , 2013, Journal of The Royal Society Interface.

[17]  J. DiCarlo,et al.  Using goal-driven deep learning models to understand sensory cortex , 2016, Nature Neuroscience.

[18]  R. Yuste,et al.  Attractor dynamics of network UP states in the neocortex , 2003, Nature.

[19]  Eörs Szathmáry,et al.  The evolutionary dynamics of language , 2017, Biosyst..

[20]  Karl J. Friston,et al.  Canonical Microcircuits for Predictive Coding , 2012, Neuron.

[21]  Dileep George,et al.  Learning cognitive maps as structured graphs for vicarious evaluation , 2019, bioRxiv.

[22]  Bard Ermentrout,et al.  A model for complex sequence learning and reproduction in neural populations , 2011, Journal of Computational Neuroscience.

[23]  Kenneth D. Miller,et al.  What is the dynamical regime of cerebral cortex? , 2019, Neuron.

[24]  Walter J Freeman,et al.  Neurodynamic Models of Brain in Psychiatry , 2003, Neuropsychopharmacology.

[25]  J. Milnor On the concept of attractor , 1985 .

[26]  Bhaskara Marthi,et al.  A generative vision model that trains with high data efficiency and breaks text-based CAPTCHAs , 2017, Science.

[27]  Paul Miller,et al.  Itinerancy between attractor states in neural systems , 2016, Current Opinion in Neurobiology.

[28]  Alain Destexhe,et al.  Modeling mesoscopic cortical dynamics using a mean-field model of conductance-based networks of adaptive exponential integrate-and-fire neurons , 2017, bioRxiv.

[29]  Yoshua Bengio,et al.  Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling , 2014, ArXiv.

[30]  Adam Santoro,et al.  Backpropagation and the brain , 2020, Nature Reviews Neuroscience.

[31]  Friedemann Zenke,et al.  Brain-Inspired Learning on Neuromorphic Substrates , 2020, Proceedings of the IEEE.

[32]  Anil K. Seth,et al.  Learning action-oriented models through active inference , 2019, bioRxiv.

[33]  Matthew G Perich,et al.  Rethinking brain-wide interactions through multi-region ‘network of networks’ models , 2020, Current Opinion in Neurobiology.

[34]  Joseph J. Paton,et al.  Big behavioral data: psychology, ethology and the foundations of neuroscience , 2014, Nature Neuroscience.

[35]  Nikolaus Kriegeskorte,et al.  Deep Learning for Cognitive Neuroscience , 2019, ArXiv.

[36]  Pascal Fries,et al.  Communication through coherence with inter-areal delays , 2015, Current Opinion in Neurobiology.

[37]  Matteo Carandini,et al.  Cortical State Fluctuations during Sensory Decision Making , 2018, Current Biology.

[38]  Cees van Leeuwen,et al.  Robust emergence of small-world structure in networks of spiking neurons , 2007, Cognitive Neurodynamics.

[39]  A. Gomez-Marin Causal Circuit Explanations of Behavior: Are Necessity and Sufficiency Necessary and Sufficient? , 2017 .

[40]  A. Tate A measure of intelligence , 2012 .

[41]  Robert M. Mok,et al.  Abstract neural representations of category membership beyond information coding stimulus or response , 2020, bioRxiv.

[42]  T. Gelder,et al.  What Might Cognition Be, If Not Computation? , 1995 .

[43]  Konrad Paul Kording,et al.  Could a Neuroscientist Understand a Microprocessor? , 2016, bioRxiv.

[44]  L. Barsalou,et al.  Whither structured representation? , 1999, Behavioral and Brain Sciences.

[45]  M. Wibral,et al.  Untangling cross-frequency coupling in neuroscience , 2014, Current Opinion in Neurobiology.

[46]  Earl K. Miller,et al.  Preservation and changes in oscillatory dynamics across the cortical hierarchy , 2020, bioRxiv.

[47]  Hinrich Schutze,et al.  It’s Not Just Size That Matters: Small Language Models Are Also Few-Shot Learners , 2020, NAACL.

[48]  J. Jacobs,et al.  Traveling Theta Waves in the Human Hippocampus , 2015, The Journal of Neuroscience.

[49]  Joseph D. Monaco,et al.  Spatial synchronization codes from coupled rate-phase neurons , 2019, PLoS Comput. Biol..

[50]  S. Romani,et al.  Short‐term plasticity based network model of place cells dynamics , 2015, Hippocampus.

[51]  Beren Millidge,et al.  Activation Relaxation: A Local Dynamical Approximation to Backpropagation in the Brain , 2020, ArXiv.

[52]  Ivan Tyukin,et al.  Spatially constrained adaptive rewiring in cortical networks creates spatially modular small world architectures , 2014, Cognitive Neurodynamics.

[53]  G. Buzsáki,et al.  Natural logarithmic relationship between brain oscillators , 2003 .

[54]  Andrew J. Watrous,et al.  Theta and Alpha Oscillations Are Traveling Waves in the Human Neocortex , 2017, Neuron.

[55]  P M MILNER,et al.  The cell assembly: Mark II. , 1957, Psychological review.

[56]  Timothy P Lillicrap,et al.  Towards deep learning with segregated dendrites , 2016, eLife.

[57]  E. Vianello,et al.  Bio-Inspired Architectures Substantially Reduce the Memory Requirements of Neural Network Models , 2021, Frontiers in Neuroscience.

[58]  L. Colgin,et al.  Theta–gamma Coupling in the Entorhinal–hippocampal System This Review Comes from a Themed Issue on Brain Rhythms and Dynamic Coordination Sciencedirect , 2022 .

[59]  Matthias Bethge,et al.  Engineering a Less Artificial Intelligence , 2019, Neuron.

[60]  Sara Hooker,et al.  The hardware lottery , 2020, Commun. ACM.

[61]  Pablo Varona,et al.  Dynamical bridge between brain and mind , 2015, Trends in Cognitive Sciences.

[62]  A. Destexhe,et al.  Enhanced Responsiveness and Low-Level Awareness in Stochastic Network States , 2017, Neuron.

[63]  M. Breakspear,et al.  The connectomics of brain disorders , 2015, Nature Reviews Neuroscience.

[64]  Boaz Barak,et al.  Deep double descent: where bigger models and more data hurt , 2019, ICLR.

[65]  N. Logothetis,et al.  Scaling Brain Size, Keeping Timing: Evolutionary Preservation of Brain Rhythms , 2013, Neuron.

[66]  Pablo Varona,et al.  Discrete Sequential Information Coding: Heteroclinic Cognitive Dynamics , 2018, Front. Comput. Neurosci..

[67]  G. Mongillo,et al.  Intrinsic volatility of synaptic connections — a challenge to the synaptic trace theory of memory , 2017, Current Opinion in Neurobiology.

[68]  R. Knight,et al.  Oscillatory Dynamics of Prefrontal Cognitive Control , 2016, Trends in Cognitive Sciences.

[69]  Terrence J Sejnowski,et al.  The unreasonable effectiveness of deep learning in artificial intelligence , 2020, Proceedings of the National Academy of Sciences.

[70]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[71]  P. Cheng,et al.  Causal Invariance as an Essential Constraint for Creating a Causal Representation of the World , 2017 .

[72]  Marcin Miłkowski,et al.  Explaining the Computational Mind , 2013 .

[73]  L. Frank,et al.  Three brain states in the hippocampus and cortex , 2019, Hippocampus.

[74]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[75]  Christian F. Doeller,et al.  The Hippocampus Encodes Distances in Multidimensional Feature Space , 2019, Current Biology.

[76]  Ehren L. Newman,et al.  Medial entorhinal cortex activates in a traveling wave in the rat , 2020, eLife.

[77]  Natalie L. M. Cappaert,et al.  Graph analysis of the anatomical network organization of the hippocampal formation and parahippocampal region in the rat , 2015, Brain Structure and Function.

[78]  G. Buzsáki,et al.  The log-dynamic brain: how skewed distributions affect network operations , 2014, Nature Reviews Neuroscience.

[79]  W B Levy,et al.  A sequence predicting CA3 is a flexible associator that learns and uses context to solve hippocampal‐like tasks , 1996, Hippocampus.

[80]  Y. Niv On the Primacy of Behavioral Research for Understanding the Brain , 2020, Current Controversies in Philosophy of Cognitive Science.

[81]  Romain Brette,et al.  Is coding a relevant metaphor for the brain? , 2017, bioRxiv.

[82]  O. Sporns,et al.  Rich-Club Organization of the Human Connectome , 2011, The Journal of Neuroscience.

[83]  Yazan N. Billeh,et al.  Survey of spiking in the mouse visual system reveals functional hierarchy , 2021, Nature.

[84]  G. Buzsáki,et al.  Traveling Theta Waves along the Entire Septotemporal Axis of the Hippocampus , 2012, Neuron.

[85]  W. Freeman,et al.  How brains make chaos in order to make sense of the world , 1987, Behavioral and Brain Sciences.

[86]  Jean-Jacques E. Slotine,et al.  Achieving stable dynamics in neural circuits , 2020, bioRxiv.

[87]  J. Knierim,et al.  Attractor dynamics of spatially correlated neural activity in the limbic system. , 2012, Annual review of neuroscience.

[88]  John J. Hopfield,et al.  Dense Associative Memory Is Robust to Adversarial Inputs , 2017, Neural Computation.

[89]  H. Bell Behavioral Variability in the Service of Constancy , 2014 .

[90]  Daniel Levenstein,et al.  On the role of theory and modeling in neuroscience. , 2020 .

[91]  T. H. Bullock,et al.  Neutral coding - A report based on an NRP work session , 1968 .

[92]  David Sussillo,et al.  Harnessing behavioral diversity to understand neural computations for cognition , 2019, Current Opinion in Neurobiology.

[93]  Richard J. Gardner,et al.  Toroidal topology of population activity in grid cells , 2021, Nature.

[94]  Athena Akrami,et al.  Lateral thinking, from the Hopfield model to cortical dynamics , 2012, Brain Research.

[95]  Elias B. Issa,et al.  Neural dynamics at successive stages of the ventral visual stream are consistent with hierarchical error signals , 2018, eLife.

[96]  György Buzsáki,et al.  Neural Syntax: Cell Assemblies, Synapsembles, and Readers , 2010, Neuron.

[97]  Karl J. Friston,et al.  The Anatomy of Inference: Generative Models and Brain Structure , 2018, Front. Comput. Neurosci..

[98]  W T Powers,et al.  Feedback: Beyond Behaviorism , 1973, Science.

[99]  Mackenzie W. Mathis,et al.  Deep learning tools for the measurement of animal behavior in neuroscience , 2019, Current Opinion in Neurobiology.

[100]  W. Gerstner,et al.  Optimal Control of Transient Dynamics in Balanced Networks Supports Generation of Complex Movements , 2014, Neuron.

[101]  Francesca Mastrogiuseppe,et al.  Linking Connectivity, Dynamics, and Computations in Low-Rank Recurrent Neural Networks , 2017, Neuron.

[102]  Frank Haist,et al.  Consolidation of human memory over decades revealed by functional magnetic resonance imaging , 2001, Nature Neuroscience.

[103]  Amos J. Storkey,et al.  Exploration by Random Network Distillation , 2018, ICLR.

[104]  J. Krakauer,et al.  Two views on the cognitive brain , 2021, Nature Reviews Neuroscience.

[105]  Laurenz Wiskott,et al.  A computational model for preplay in the hippocampus , 2013, Front. Comput. Neurosci..

[106]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[107]  G. Pfurtscheller,et al.  Event-related synchronization (ERS) in the alpha band--an electrophysiological correlate of cortical idling: a review. , 1996, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[108]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[109]  Marcin Milkowski,et al.  From Computer Metaphor to Computational Modeling: The Evolution of Computationalism , 2018, Minds and Machines.

[110]  György Buzsáki,et al.  Preexisting hippocampal network dynamics constrain optogenetically induced place fields , 2019, Neuron.

[111]  Biyu J He,et al.  Neuromodulation of Brain State and Behavior. , 2020, Annual review of neuroscience.

[112]  Karl J. Friston,et al.  LFP and oscillations—what do they tell us? , 2015, Current Opinion in Neurobiology.

[113]  Alexandre Hyafil,et al.  Neural Cross-Frequency Coupling: Connecting Architectures, Mechanisms, and Functions , 2015, Trends in Neurosciences.

[114]  Edmund T. Rolls,et al.  What determines the capacity of autoassociative memories in the brain? Network , 1991 .

[115]  I. Tsuda,et al.  Chaotic itinerancy generated by coupling of Milnor attractors. , 2003, Chaos.

[116]  G. Buzsáki,et al.  Mechanisms of gamma oscillations. , 2012, Annual review of neuroscience.

[117]  Karl J. Friston,et al.  How and why consciousness arises: Some considerations from physics and physiology , 2018 .

[118]  Mark Chen,et al.  Language Models are Few-Shot Learners , 2020, NeurIPS.

[119]  Eric Halgren,et al.  Rotating waves during human sleep spindles organize global patterns of activity that repeat precisely through the night , 2016, eLife.

[120]  Alison R Preston,et al.  Concept formation as a computational cognitive process , 2021, Current Opinion in Behavioral Sciences.

[121]  Alessandro Treves,et al.  Partial coherence and frustration in self-organizing spherical grids , 2019, bioRxiv.

[122]  Nina S Hsu,et al.  The promise of the BRAIN initiative: NIH strategies for understanding neural circuit function , 2020, Current Opinion in Neurobiology.

[123]  Karl J. Friston Hierarchical Models in the Brain , 2008, PLoS Comput. Biol..

[124]  Saeed Reza Kheradpisheh,et al.  BS4NN: Binarized Spiking Neural Networks with Temporal Coding and Learning , 2020, Neural Processing Letters.

[125]  Michael Carbin,et al.  The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks , 2018, ICLR.

[126]  Victoria G. Calvert,et al.  Communication consumes 35 times more energy than computation in the human cortex, but both costs are needed to predict synapse number , 2021, Proceedings of the National Academy of Sciences.

[127]  H. P. de Vladar,et al.  Why Greatness Cannot Be Planned: The Myth of the Objective , 2016, Leonardo.

[128]  Daniel L. K. Yamins,et al.  Pruning neural networks without any data by iteratively conserving synaptic flow , 2020, NeurIPS.

[129]  Keeheon Lee,et al.  The Computational Limits of Deep Learning , 2020, ArXiv.

[130]  H. Eichenbaum Prefrontal–hippocampal interactions in episodic memory , 2017, Nature Reviews Neuroscience.

[131]  G. Buzsáki Hippocampal sharp wave‐ripple: A cognitive biomarker for episodic memory and planning , 2015, Hippocampus.

[132]  Eric Shea-Brown,et al.  A solution to temporal credit assignment using cell-type-specific modulatory signals , 2020, bioRxiv.

[133]  J. Kelso,et al.  The Metastable Brain , 2014, Neuron.

[134]  Joseph D. Monaco,et al.  Attentive Scanning Behavior Drives One-Trial Potentiation of Hippocampal Place Fields , 2014, Nature Neuroscience.

[135]  M. Berger,et al.  High Gamma Power Is Phase-Locked to Theta Oscillations in Human Neocortex , 2006, Science.

[136]  M. A. MacIver,et al.  Neuroscience Needs Behavior: Correcting a Reductionist Bias , 2017, Neuron.

[137]  Kenneth O. Stanley,et al.  Why Greatness Cannot Be Planned , 2015, Springer International Publishing.

[138]  Simon R. Schultz,et al.  Learning to select actions shapes recurrent dynamics in the corticostriatal system , 2019, bioRxiv.

[139]  Giorgio A Ascoli,et al.  Graph Theoretic and Motif Analyses of the Hippocampal Neuron Type Potential Connectome , 2016, eNeuro.

[140]  H. Bowman,et al.  The Sync/deSync Model: How a Synchronized Hippocampus and a Desynchronized Neocortex Code Memories , 2018, The Journal of Neuroscience.

[141]  Romain Brette,et al.  Computing with Neural Synchrony , 2012, PLoS Comput. Biol..

[142]  Brad E. Pfeiffer,et al.  Alternating sequences of future and past behavior encoded within hippocampal theta oscillations , 2020, Science.

[143]  Romain Brette,et al.  Philosophy of the Spike: Rate-Based vs. Spike-Based Theories of the Brain , 2015, Front. Syst. Neurosci..

[144]  B. Merker Consciousness without a cerebral cortex: A challenge for neuroscience and medicine , 2007, Behavioral and Brain Sciences.

[145]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[146]  Zachary P. Kilpatrick,et al.  Sparse Gamma Rhythms Arising through Clustering in Adapting Neuronal Networks , 2011, PLoS Comput. Biol..

[147]  Dan F. M. Goodman,et al.  Visualizing a joint future of neuroscience and neuromorphic engineering , 2021, Neuron.

[148]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[149]  The ascending arousal system shapes low-dimensional neural dynamics to mediate awareness of intrinsic cognitive states , 2021 .

[150]  Michael E. Hasselmo,et al.  The Role of Hierarchical Dynamical Functions in Coding for Episodic Memory and Cognition , 2019, Journal of Cognitive Neuroscience.

[151]  Krishna V. Shenoy,et al.  Computation Through Neural Population Dynamics. , 2020, Annual review of neuroscience.

[152]  James G. King,et al.  Reconstruction and Simulation of Neocortical Microcircuitry , 2015, Cell.

[153]  R. Traub,et al.  Inhibition-based rhythms: experimental and mathematical observations on network dynamics. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[154]  Tobi Delbrück,et al.  Training Deep Spiking Neural Networks Using Backpropagation , 2016, Front. Neurosci..

[155]  G. Buzsáki,et al.  Gamma Oscillation by Synaptic Inhibition in a Hippocampal Interneuronal Network Model , 1996, The Journal of Neuroscience.

[156]  J. Riddle,et al.  Causal role of cross-frequency coupling in distinct components of cognitive control , 2021, Progress in Neurobiology.

[157]  James B. Aimone,et al.  A Roadmap for Reaching the Potential of Brain‐Derived Computing , 2020 .

[158]  S. Laughlin,et al.  An Energy Budget for Signaling in the Grey Matter of the Brain , 2001, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[159]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[160]  Matthias Löwe,et al.  On a Model of Associative Memory with Huge Storage Capacity , 2017, 1702.01929.

[161]  Geoffrey E. Hinton,et al.  Assessing the Scalability of Biologically-Motivated Deep Learning Algorithms and Architectures , 2018, NeurIPS.

[162]  Yoshua Bengio,et al.  Equivalence of Equilibrium Propagation and Recurrent Backpropagation , 2017, Neural Computation.

[163]  D. Long Networks of the Brain , 2011 .

[164]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[165]  Robert Kozma,et al.  Cognitive Phase Transitions in the Cerebral Cortex - Enhancing the Neuron Doctrine by Modeling Neural Fields , 2015 .

[166]  Russell A. Epstein,et al.  Structuring Knowledge with Cognitive Maps and Cognitive Graphs , 2020, Trends in Cognitive Sciences.

[167]  Carver Mead,et al.  How we created neuromorphic engineering , 2020, Nature Electronics.

[168]  Jessica B. Hamrick,et al.  Exploring Exploration: Comparing Children with RL Agents in Unified Environments , 2020, ArXiv.

[169]  Misha Tsodyks,et al.  Persistent Activity in Neural Networks with Dynamic Synapses , 2007, PLoS Comput. Biol..

[170]  Kaushik Roy,et al.  Towards spike-based machine intelligence with neuromorphic computing , 2019, Nature.

[171]  G. Buzsáki The Brain from Inside Out , 2019 .

[172]  Subutai Ahmad,et al.  How Can We Be So Dense? The Benefits of Using Highly Sparse Representations , 2019, ArXiv.

[173]  Grace M. Hwang,et al.  Cognitive swarming in complex environments with attractor dynamics and oscillatory computing , 2019, Biological Cybernetics.