Supplementary Materials for A Large-Scale Model of the Functioning Brain

Modeling the Brain Neurons are pretty complicated cells. They display an endless variety of shapes that sprout highly variable numbers of axons and dendrites; they sport time- and voltage-dependent ion channels along with an impressive array of neurotransmitter receptors; and they connect intimately with near neighbors as well as former neighbors who have since moved away. Simulating a sizeable chunk of brain tissue has recently become achievable, thanks to advances in computer hardware and software. Eliasmith et al. (p. 1202; see the Perspective by Machens) present their million-neuron model of the brain and show that it can recognize numerals, remember lists of digits, and write down those lists—tasks that seem effortless for a human but that encompass the triad of perception, cognition, and behavior. Two-and-a-half million model neurons recognize images, learn via reinforcement, and display fluid intelligence. A central challenge for cognitive and systems neuroscience is to relate the incredibly complex behavior of animals to the equally complex activity of their brains. Recently described, large-scale neural models have not bridged this gap between neural activity and biological function. In this work, we present a 2.5-million-neuron model of the brain (called “Spaun”) that bridges this gap by exhibiting many different behaviors. The model is presented only with visual image sequences, and it draws all of its responses with a physically modeled arm. Although simplified, the model captures many aspects of neuroanatomy, neurophysiology, and psychological behavior, which we demonstrate via eight diverse tasks.

[1]  J. Penney,et al.  The functional anatomy of basal ganglia disorders , 1989, Trends in Neurosciences.

[2]  R. Engle,et al.  The role of prefrontal cortex in working-memory capacity, executive attention, and general fluid intelligence: An individual-differences perspective , 2002, Psychonomic bulletin & review.

[3]  L. E. Krueger Reconciling Fechner and Stevens: Toward a unified psychophysical law , 1989, Behavioral and Brain Sciences.

[4]  E. Hoshi Functional specialization within the dorsolateral prefrontal cortex: A review of anatomical and physiological studies of non-human primates , 2006, Neuroscience Research.

[5]  Robert F. Hadley The Problem of Rapid Variable Creation , 2009, Neural Computation.

[6]  Peter Redgrave,et al.  A computational model of action selection in the basal ganglia. I. A new functional anatomy , 2001, Biological Cybernetics.

[7]  David A Lewis,et al.  Dopamine D1 receptor activation regulates sodium channel‐dependent EPSP amplification in rat prefrontal cortex pyramidal neurons , 2007, The Journal of physiology.

[8]  A. Nambu,et al.  Functional significance of the cortico–subthalamo–pallidal ‘hyperdirect’ pathway , 2002, Neuroscience Research.

[9]  Mounir Boukadoum,et al.  Mechanisms Gating the Flow of Information in the Cortex: What They Might Look Like and What Their Uses may be , 2010, Front. Comput. Neurosci..

[10]  Rochel Gelman,et al.  Variability signatures distinguish verbal from nonverbal counting for both large and small numbers , 2001, Psychonomic bulletin & review.

[11]  K. Hasan,et al.  Working memory load modulation of parieto‐frontal connections: Evidence from dynamic causal modeling , 2012, Human brain mapping.

[12]  N. Spruston,et al.  Dendritic glutamate receptor channels in rat hippocampal CA3 and CA1 pyramidal neurons. , 1995, The Journal of physiology.

[13]  J. Tanji,et al.  The role of premotor cortex and the supplementary motor area in the temporal control of movement in man. , 1993, Brain : a journal of neurology.

[14]  H. Markram,et al.  Organizing principles for a diversity of GABAergic interneurons and synapses in the neocortex. , 2000, Science.

[15]  宁北芳,et al.  疟原虫var基因转换速率变化导致抗原变异[英]/Paul H, Robert P, Christodoulou Z, et al//Proc Natl Acad Sci U S A , 2005 .

[16]  J. Hollerman,et al.  Dopamine neurons report an error in the temporal prediction of reward during learning , 1998, Nature Neuroscience.

[17]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[18]  Shigeru Shinomoto,et al.  Differences in Spiking Patterns Among Cortical Neurons , 2003, Neural Computation.

[19]  J. Raven,et al.  Manual for Raven's progressive matrices and vocabulary scales , 1962 .

[20]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[21]  J. Taube The head direction signal: origins and sensory-motor integration. , 2007, Annual review of neuroscience.

[22]  Wulfram Gerstner,et al.  Spike-Based Reinforcement Learning in Continuous State and Action Space: When Policy Gradient Methods Fail , 2009, PLoS Comput. Biol..

[23]  Barbara Anne Dosher Item Interference and Time Delays in Working Memory: Immediate Serial Recall , 1999 .

[24]  S. Wise,et al.  A neurophysiological study of the premotor cortex in the rhesus monkey. , 1984, Brain : a journal of neurology.

[25]  B B Murdock,et al.  TODAM2: a model for the storage and retrieval of item, associative, and serial-order information. , 1993, Psychological review.

[26]  Chris Eliasmith,et al.  A Controlled Attractor Network Model of Path Integration in the Rat , 2005, Journal of Computational Neuroscience.

[27]  Trevor Bekolay,et al.  Neural representations of compositional structures: representing and manipulating vector spaces with spiking neurons , 2011, Connect. Sci..

[28]  J C Jahnke Delayed recall and the serial-position effect of short-term memory. , 1968, Journal of experimental psychology.

[29]  Chris Eliasmith,et al.  Integrating behavioral and neural data in a model of zebrafish network interaction , 2005, Biological Cybernetics.

[30]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[31]  M. Konishi,et al.  Emergence of multiplicative auditory responses in the midbrain of the barn owl. , 2007, Journal of neurophysiology.

[32]  Christian K. Machens,et al.  Behavioral / Systems / Cognitive Functional , But Not Anatomical , Separation of “ What ” and “ When ” in Prefrontal Cortex , 2009 .

[33]  Chris Eliasmith,et al.  Fine-Tuning and the Stability of Recurrent Neural Networks , 2011, PloS one.

[34]  Adrian M Owen,et al.  Working Memory: Imaging the Magic Number Four , 2004, Current Biology.

[35]  G. Edelman,et al.  Large-scale model of mammalian thalamocortical systems , 2008, Proceedings of the National Academy of Sciences.

[36]  C. Eliasmith,et al.  Higher-Dimensional Neurons Explain the Tuning and Dynamics of Working Memory Cells , 2006, The Journal of Neuroscience.

[37]  Chris Eliasmith,et al.  How to Build a Brain: A Neural Architecture for Biological Cognition , 2013 .

[38]  Carol A. Seger,et al.  Dynamics of frontal, striatal, and hippocampal systems during rule learning. , 2005, Cerebral cortex.

[39]  Christos Constantinidis,et al.  Comparison of Neural Activity Related to Working Memory in Primate Dorsolateral Prefrontal and Posterior Parietal Cortex , 2010, Front. Syst. Neurosci..

[40]  P. Goldman-Rakic,et al.  Preface: Cerebral Cortex Has Come of Age , 1991 .

[41]  Chris Eliasmith,et al.  Neural populations can induce reliable postsynaptic currents without observable spike rate changes or precise spike timing. , 2007, Cerebral cortex.

[42]  T DeWolf,et al.  The neural optimal control hierarchy for motor control , 2011, Journal of neural engineering.

[43]  Becky Verastegui,et al.  Proceedings of the 2007 ACM/IEEE conference on Supercomputing , 2007, HiPC 2007.

[44]  T K LANDAUER,et al.  Rate of Implicit Speech , 1962, Perceptual and motor skills.

[45]  Eero P. Simoncelli,et al.  How MT cells analyze the motion of visual patterns , 2006, Nature Neuroscience.

[46]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[47]  Chris Eliasmith,et al.  A Neural Model of Rule Generation in Inductive Reasoning , 2011, Top. Cogn. Sci..

[48]  J. Murray,et al.  HANDBOOK OF PSYCHOLOGY , 1951 .

[49]  H. Markram The Blue Brain Project , 2006, Nature Reviews Neuroscience.

[50]  Yan Liu,et al.  Neural selectivity in anterior inferotemporal cortex for morphed photographic images during behavioral classification or fixation. , 2008, Journal of Neurophysiology.

[51]  W. Schultz Multiple reward signals in the brain , 2000, Nature Reviews Neuroscience.

[52]  Chris Eliasmith,et al.  Neural Engineering: Computation, Representation, and Dynamics in Neurobiological Systems , 2004, IEEE Transactions on Neural Networks.

[53]  Shaul Hochstein,et al.  Serial memory strategies in macaque monkeys: behavioral and theoretical aspects. , 2002, Cerebral cortex.

[54]  Paul Thagard,et al.  Neural affective decision theory: Choices, brains, and emotions , 2008, Cognitive Systems Research.

[55]  R. Nicoll,et al.  Mechanisms generating the time course of dual component excitatory synaptic currents recorded in hippocampal slices , 1990, Neuron.

[56]  Bijan Pesaran,et al.  Temporal structure in neuronal activity during working memory in macaque parietal cortex , 2000, Nature Neuroscience.

[57]  A. Forbes AN ITEM ANALYSIS OF THE ADVANCED MATRICES , 1964 .

[58]  Michael R. Scheessele,et al.  Human Performance on the USPS Database , 2007 .

[59]  B. Postle,et al.  Maintenance versus Manipulation of Information Held in Working Memory: An Event-Related fMRI Study , 1999, Brain and Cognition.

[60]  C. Pollard,et al.  Center for the Study of Language and Information , 2022 .

[61]  J. T. Massey,et al.  Mental rotation of the neuronal population vector. , 1989, Science.

[62]  M. Kringelbach The human orbitofrontal cortex: linking reward to hedonic experience , 2005, Nature Reviews Neuroscience.

[63]  Adam Johnson,et al.  Triple Dissociation of Information Processing in Dorsal Striatum, Ventral Striatum, and Hippocampus on a Learned Spatial Decision Task , 2010, Neuron.

[64]  Ben Goertzel,et al.  A world survey of artificial brain projects, Part I: Large-scale brain simulations , 2010, Neurocomputing.

[65]  John F. Sowa,et al.  Conceptual Structures: Information Processing in Mind and Machine , 1983 .

[66]  J. Dostrovsky,et al.  Neuronal firing rates and patterns in the globus pallidus internus of patients with cervical dystonia differ from those with Parkinson's disease. , 2007, Journal of neurophysiology.

[67]  Marc'Aurelio Ranzato,et al.  Sparse Feature Learning for Deep Belief Networks , 2007, NIPS.

[68]  L. Cosmides From : The Cognitive Neurosciences , 1995 .

[69]  C. Eliasmith,et al.  Learning to Select Actions with Spiking Neurons in the Basal Ganglia , 2012, Front. Neurosci..

[70]  D. Ringach Spatial structure and symmetry of simple-cell receptive fields in macaque primary visual cortex. , 2002, Journal of neurophysiology.