A world survey of artificial brain projects, Part I: Large-scale brain simulations

Driven by rapid ongoing advances in computer hardware, neuroscience and computer science, Artificial Brain research and development are blossoming. This article constitutes the first half of a two-part world survey of artificial brain projects: this part dealing with large-scale brain simulations, and the second part with biologically inspired cognitive architectures (BICAs). The large-scale brain simulations we consider in depth here include those by Markram, Modha, Boahen, Horwitz, Edelman, Izhikevich, and Just. As well as reviewing the particulars of these simulation projects, we position them in a broader perspective, comparing at the different underlying definitions of the concept of ''simulation,'' noting that in many ways the projects are modeling neurosystems at different levels as well as using different methodologies.

[1]  Susan R. Goldman,et al.  CAPping the construction-integration model of discourse comprehension: Essays in honor of Walter Kintsch , 1995 .

[2]  H. Markram.  The Blue Brain Project , 2006, Nature Reviews Neuroscience.

[3]  James G. King,et al.  A Component-Based Extension Framework for Large-Scale Parallel Simulations in NEURON , 2009, Front. Neuroinform..

[4]  Shane Legg,et al.  Universal Intelligence: A Definition of Machine Intelligence , 2007, Minds and Machines.

[5]  Karl J. Friston.  Functional and effective connectivity in neuroimaging: A synthesis , 1994 .

[6]  Karl J. Friston,et al.  Neural modeling and functional brain imaging: an overview , 2000, Neural Networks.

[7]  Sharlene D. Newman,et al.  The Synchronization of the Human Cortical Working Memory Network , 2002, NeuroImage.

[8]  R. Coppola,et al.  Physiological characteristics of capacity constraints in working memory as revealed by functional MRI. , 1999, Cerebral cortex.

[9]  Wulfram Gerstner,et al.  A neuronal learning rule for sub-millisecond temporal coding , 1996, Nature.

[10]  J. B. Demb,et al.  Different Circuits for ON and OFF Retinal Ganglion Cells Cause Different Contrast Sensitivities , 2003, The Journal of Neuroscience.

[11]  D. V. van Essen,et al.  Computerized Mappings of the Cerebral Cortex: A Multiresolution Flattening Method and a Surface-Based Coordinate System , 1996, Journal of Cognitive Neuroscience.

[12]  M. Just,et al.  Cognitive coordinate systems: accounts of mental rotation and individual differences in spatial ability. , 1985, Psychological review.

[13]  Cynthia A. Brewer,et al.  ColorBrewer.org: An Online Tool for Selecting Colour Schemes for Maps , 2003 .

[14]  Karl J. Friston,et al.  Large-scale neural models and dynamic causal modelling , 2006, NeuroImage.

[15]  B. Horwitz,et al.  Integrating electrophysiological and anatomical experimental data to create a large-scale model that simulates a delayed match-to-sample human brain imaging study. , 1998, Cerebral cortex.

[16]  Kwabena Boahen,et al.  Optic nerve signals in a neuromorphic chip II: testing and results , 2004, IEEE Transactions on Biomedical Engineering.

[17]  B. Horwitz,et al.  Functional connectivity of the angular gyrus in normal reading and dyslexia. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Kwabena Boahen,et al.  Optic nerve signals in a neuromorphic chip I: Outer and inner retina models , 2004, IEEE Transactions on Biomedical Engineering.

[19]  M. Just,et al.  Brain Activation Modulated by Sentence Comprehension , 1996, Science.

[20]  R. Douglas,et al.  A Quantitative Map of the Circuit of Cat Primary Visual Cortex , 2004, The Journal of Neuroscience.

[21]  G. Edelman,et al.  Spike-timing dynamics of neuronal groups. , 2004, Cerebral cortex.

[22]  Denis Dooley,et al.  Atlas of the Human Brain. , 1971 .

[24]  Kathie L. Olsen,et al.  Neurotech for Neuroscience: Unifying Concepts, Organizing Principles, and Emerging Tools , 2007, The Journal of Neuroscience.

[25]  Bertram E. Shi,et al.  An ON-OFF orientation selective address event representation image transceiver chip , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[26]  Kwabena Boahen,et al.  A Retinomorphic Chip with Parallel Pathways: Encoding INCREASING, ON, DECREASING, and OFF Visual Signals , 2002 .

[27]  G. Paxinos,et al.  The Rat Brain in Stereotaxic Coordinates , 1983 .

[28]  Andreas G. Andreou,et al.  Synthetic Neural Circuits Using Current-Domain Signal Representations , 1989, Neural Computation.

[29]  M. Just,et al.  Collaborative Activity between Parietal and Dorso-Lateral Prefrontal Cortex in Dynamic Spatial Working Memory Revealed by fMRI , 2000, NeuroImage.

[30]  D. Johnston,et al.  Regulation of Synaptic Efficacy by Coincidence of Postsynaptic APs and EPSPs , 1997 .

[31]  A. Meyer-Lindenberg,et al.  Interindividual differences in functional interactions among prefrontal, parietal and parahippocampal regions during working memory. , 2003, Cerebral cortex.

[32]  David A. Rottenberg,et al.  Quantitative evaluation of three cortical surface flattening methods , 2005, NeuroImage.

[33]  R. Cabeza,et al.  Imaging Cognition II: An Empirical Review of 275 PET and fMRI Studies , 2000, Journal of Cognitive Neuroscience.

[34]  Rajagopal Ananthanarayanan,et al.  Scaling, stability and synchronization in mouse-sized (and larger) cortical simulations , 2007, BMC Neuroscience.

[35]  Vivien A. Casagrande,et al.  Biophysics of Computation: Information Processing in Single Neurons , 1999 .

[36]  N. Logothetis.  The Underpinnings of the BOLD Functional Magnetic Resonance Imaging Signal , 2003, The Journal of Neuroscience.

[37]  Noriaki Yahata,et al.  Selective enhancement of functional connectivity in the left prefrontal cortex during sentence processing , 2003, NeuroImage.

[38]  A. Toga,et al.  The Rhesus Monkey Brain in Stereotaxic Coordinates , 1999 .

[39]  A. Braun,et al.  Simulating Transcranial Magnetic Stimulation during PET with a Large-Scale Neural Network Model of the Prefrontal Cortex and the Visual System , 2002, NeuroImage.

[40]  Kwabena Boahen,et al.  Competitively coupled orientation selective cellular neural networks , 2002 .

[41]  Marcel Adam Just,et al.  A Model of the Time Course and Content of Reading , 1982, Cogn. Sci..

[42]  Angelo Arleo,et al.  Modeling rodent head-direction cells and place cells for spatial learning in bio-mimetic robotics , 2000 .

[43]  Cheryl L. Grady,et al.  Mapping the functional neuroanatomy of the intact human brain with brain work imaging , 1991, Neuropsychologia.

[44]  M. Just,et al.  The psychology of reading and language comprehension , 1986 .

[45]  A. Newell.  Unified Theories of Cognition , 1990 .

[46]  J. Artieda,et al.  Electric Fields of the Brain. The Neurophysics of EEG, second ed. Paul L. Nunez, Ramesh Srinivasan. Oxford University Press, Oxford (2005). 611 pages, ISBN: 0-19-505038-7 , 2006, Clinical Neurophysiology.

[47]  Bruce L. Miller.  Principles of Frontal Lobe Function , 2003 .

[48]  G. Edelman,et al.  Structural differences among antibodies of different specificities. , 1961, Proceedings of the National Academy of Sciences of the United States of America.

[49]  G. Edelman,et al.  Retrospective and prospective responses arising in a modeled hippocampus during maze navigation by a brain-based device , 2007, Proceedings of the National Academy of Sciences.

[50]  B. Wandell,et al.  Visualization and Measurement of the Cortical Surface , 2000, Journal of Cognitive Neuroscience.

[51]  Kwabena Boahen,et al.  Functional circuitry for peripheral suppression in Mammalian Y-type retinal ganglion cells. , 2007, Journal of neurophysiology.

[52]  Sally Adee.  Cat-brain fever , 2010 .

[53]  G. Paxinos,et al.  Atlas of the Human Brain , 2000 .

[54]  Kwabena Boahen.  A burst-mode word-serial address-event link-III: analysis and test results , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[55]  A. McIntosh,et al.  Neural modeling, functional brain imaging, and cognition , 1999, Trends in Cognitive Sciences.

[56]  Eugenio Culurciello,et al.  High dynamic range, arbitrated address event representation digital imager , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[57]  Antonio Ulloa,et al.  Investigating the Neural Basis of the Auditory Continuity Illusion , 2005, Journal of Cognitive Neuroscience.

[58]  G. Edelman,et al.  Neural dynamics in a model of the thalamocortical system. I. Layers, loops and the emergence of fast synchronous rhythms. , 1997, Cerebral cortex.

[59]  J. Maunsell,et al.  Two‐dimensional maps of the cerebral cortex , 1980, The Journal of comparative neurology.

[60]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[61]  Kwabena Boahen,et al.  Thermodynamically Equivalent Silicon Models of Voltage-Dependent Ion Channels , 2007, Neural Computation.

[62]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[63]  Jeffrey L. Krichmar,et al.  Spatial navigation and causal analysis in a brain-based device modeling cortical-hippocampal interactions , 2007, Neuroinformatics.

[64]  Ibm Blue,et al.  Overview of the IBM Blue Gene/P Project , 2008, IBM J. Res. Dev..

[65]  Lightner Witmer.  Intelligence—A Definition , 1922, The Psychological clinic.

[66]  Auke Jan Ijspeert,et al.  Simulation and Robotics Studies of Salamander Locomotion Applying Neurobiological Principles to the Control of Locomotion in Robots , 2005 .

[67]  J. B. Demb,et al.  Contrast Adaptation in Subthreshold and Spiking Responses of Mammalian Y-Type Retinal Ganglion Cells , 2005, The Journal of Neuroscience.

[68]  Stewart W. Wilson,et al.  From Animals to Animats 5. Proceedings of the Fifth International Conference on Simulation of Adaptive Behavior , 1997 .

[69]  R. Cabeza,et al.  Imaging Cognition: An Empirical Review of PET Studies with Normal Subjects , 1997, Journal of Cognitive Neuroscience.

[70]  M M Mesulam,et al.  Large‐scale neurocognitive networks and distributed processing for attention, language, and memory , 1990, Annals of neurology.

[71]  E. Culurciello,et al.  A biomorphic digital image sensor , 2003, IEEE J. Solid State Circuits.

[72]  Kwabena Boahen,et al.  Translinear circuits in subthreshold MOS , 1996 .

[73]  Kwabena Boahen.  A burst-mode word-serial address-event link-II: receiver design , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[74]  Kwabena Boahen,et al.  Nonlinear Influence of T-Channels in an in silico Relay Neuron , 2009, IEEE Transactions on Biomedical Engineering.

[75]  Earl K. Miller,et al.  Cognitive focus through adaptive neural coding in the primate prefrontal cortex , 2002 .

[76]  Gerald M Edelman,et al.  Characterizing functional hippocampal pathways in a brain-based device as it solves a spatial memory task. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[77]  Kwabena Boahen,et al.  A retinomorphic vision system , 1996, IEEE Micro.

[78]  Shawn Mikula,et al.  Internet-enabled high-resolution brain mapping and virtual microscopy , 2007, NeuroImage.

[79]  S. Vijayakumar,et al.  Competitive-Cooperative-Concurrent Reinforcement Learning with Importance Sampling , 2004 .

[80]  Kwabena Boahen,et al.  Synchrony in Silicon: The Gamma Rhythm , 2007, IEEE Transactions on Neural Networks.

[81]  M. Just,et al.  Interdependence of Nonoverlapping Cortical Systems in Dual Cognitive Tasks , 2001, NeuroImage.

[82]  Tom Michael Mitchell,et al.  Mind Matters : A Tribute To Allen Newell , 1996 .

[83]  T. Sejnowski,et al.  Origin of slow cortical oscillations in deafferented cortical slabs. , 2000, Cerebral cortex.

[84]  Hartwig Kuhlenbeck,et al.  The central nervous system of vertebrates , 1967 .

[85]  M. Torrens.  Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[86]  D. V. van Essen,et al.  Surface-based approaches to spatial localization and registration in primate cerebral cortex. , 2004, NeuroImage.

[87]  Ben Shneiderman.  Promoting universal usability with multi-layer interface design , 2002 .

[88]  George L.-T. Chiu,et al.  Overview of the Blue Gene/L system architecture , 2005, IBM J. Res. Dev..

[89]  Andreas G. Andreou,et al.  Analog VLSI neuromorphic image acquisition and pre-processing systems , 1995, Neural Networks.

[90]  Eugenio Culurciello,et al.  Arbitrated address-event representation digital image sensor , 2001 .

[91]  H. Whitaker,et al.  Handbook of the neuroscience of language , 2008 .

[92]  David B. Arciniegas.  Principles of Behavioral and Cognitive Neurology, Second Edition , 2001 .

[93]  Kwabena Boahen,et al.  A burst-mode word-serial address-event link-I: transmitter design , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[94]  M. Mesulam.  Principles of Behavioral and Cognitive Neurology , 2000 .

[95]  Paul M. Thompson,et al.  A framework for computational anatomy , 2002 .

[96]  Kwabena Boahen,et al.  A silicon retina that reproduces signals in the optic nerve , 2006, Journal of neural engineering.

[97]  K. Doya,et al.  Competitive-Cooperative-Concurrent Reinforcement Learning with Importance Sampling , 2004 .

[98]  Kwabena Boahen,et al.  Space-rate coding in an adaptive silicon neuron , 2001, Neural Networks.

[99]  Andreas G. Andreou,et al.  Current-mode subthreshold MOS circuits for analog VLSI neural systems , 1991, IEEE Trans. Neural Networks.

[100]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[101]  Raymond C. Kurzweil,et al.  The Singularity Is Near , 2018, The Infinite Desire for Growth.

[102]  G. Edelman,et al.  Neural dynamics in a model of the thalamocortical system. II. The role of neural synchrony tested through perturbations of spike timing. , 1997, Cerebral cortex.

[103]  George Paxinos,et al.  The Mouse Brain in Stereotaxic Coordinates , 2001 .

[104]  Francesco Mondada,et al.  Evolutionary neurocontrollers for autonomous mobile robots , 1998, Neural Networks.

[105]  L. Abbott,et al.  Competitive Hebbian learning through spike-timing-dependent synaptic plasticity , 2000, Nature Neuroscience.

[106]  Henry Markram,et al.  A Novel Multiple Objective Optimization Framework for Constraining Conductance-Based Neuron Models by Experimental Data , 2007, Front. Neurosci..

[107]  Henry Markram,et al.  Identifying, tabulating, and analyzing contacts between branched neuron morphologies , 2008, IBM J. Res. Dev..

[108]  Maxim Bazhenov,et al.  Thalamocortical oscillations , 2006, Scholarpedia.

[109]  Thomas K. Berger,et al.  Evaluating automated parameter constraining procedures of neuron models by experimental and surrogate data , 2008, Biological Cybernetics.

[110]  Vinod Goel,et al.  A computational model of frontal lobe dysfunction: working memory and the Tower of Hanoi task , 2001, Cogn. Sci..

[111]  M. Just,et al.  Cortical activation and synchronization during sentence comprehension in high-functioning autism: evidence of underconnectivity. , 2004, Brain : a journal of neurology.

[112]  Dharmendra S. Modha,et al.  Anatomy of a cortical simulator , 2007, Proceedings of the 2007 ACM/IEEE Conference on Supercomputing (SC '07).

[113]  G. Paxinos,et al.  Comprar The Mouse Brain in Stereotaxic Coordinates, The coronal plates and diagrams Compact, 3rd Edition | Keith Franklin | 9780123742445 | Academic Press , 2008 .

[114]  Kwabena Boahen,et al.  The Retinomorphic Approach: Pixel-Parallel Adaptive Amplification, Filtering, and Quantization , 1997 .

[115]  Kwabena Boahen,et al.  A heteroassociative memory using current-mode MOS analog VLSI circuits , 1989 .

[116]  Dharmendra S. Modha,et al.  A Conceptual Cortical Surface Atlas , 2009, PloS one.

[117]  Ricardo Chavarriaga,et al.  A Computational Model of Parallel Navigation Systems in Rodents , 2005 .

[118]  L. Harmon,et al.  Neural modeling. , 1968, Advances in biomedical engineering and medical physics.

[119]  Frances K. Skinner.  Conductance-based models , 2006, Scholarpedia.

[120]  Marcel Adam Just,et al.  A hybrid architecture for working memory: Reply to MacDonald and Christiansen (2002). , 2002 .

[121]  J. Lindsten,et al.  The Nobel Prize in Physiology or Medicine , 2001 .

[122]  W. M. Keck,et al.  Machine Psychology : Autonomous Behavior , Perceptual Categorization and Conditioning in a Brain-based Device , 2002 .

[123]  Bertram E. Shi,et al.  Neuromorphic implementation of orientation hypercolumns , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[124]  Robert E. Kass,et al.  Working-memory failure in phone-based interaction , 1997, TCHI.

[125]  M. Byrne,et al.  A Working Memory Model of a Common Procedural Error , 1997 .

[126]  M. Just,et al.  Plasticity of language-related brain function during recovery from stroke. , 1999, Stroke.

[127]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[128]  Kwabena Boahen,et al.  A retinomorphic chip with parallel pathways : encoding ON, OFF,INCREASING, and DECREASING visual signals , 2002 .

[129]  Rolf Pfeifer,et al.  Sensory - motor coordination: The metaphor and beyond , 1997, Robotics Auton. Syst..

[130]  Barry Horwitz,et al.  Simulation Frameworks for Large-Scale Brain Systems , 2007 .

[131]  Michael L. Hines,et al.  Neuron splitting in compute-bound parallel network simulations enables runtime scaling with twice as many processors , 2008, Journal of Computational Neuroscience.

[132]  G. Edelman,et al.  Large-scale model of mammalian thalamocortical systems , 2008, Proceedings of the National Academy of Sciences.

[133]  Barry Horwitz,et al.  CHAPTER 7 – PET Research of Language , 2008 .

[134]  M A Just,et al.  From the SelectedWorks of Marcel Adam Just 1990 What one intelligence test measures : A theoretical account of the processing in the Raven Progressive Matrices Test , 2016 .

[135]  D. V. van Essen,et al.  Functional and structural mapping of human cerebral cortex: solutions are in the surfaces. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[136]  M. Just,et al.  From the Selectedworks of Marcel Adam Just the Organization of Thinking: What Functional Brain Imaging Reveals about the Neuroarchitecture of Complex Cognition , 2022 .

[137]  Luis Puelles,et al.  The Chick Brain in Stereotaxic Coordinates: An Atlas featuring Neuromeric Subdivisions and Mammalian Homologies , 2007 .

[138]  Bo Wen,et al.  A Silicon Cochlea With Active Coupling , 2009, IEEE Transactions on Biomedical Circuits and Systems.

[139]  E. Izhikevich.  Solving the distal reward problem through linkage of STDP and dopamine signaling , 2007, BMC Neuroscience.

[140]  W. Kintsch,et al.  Discourse comprehension : essays in honor of Walter Kintsch , 1996 .

[141]  B. Connors,et al.  Two dynamically distinct inhibitory networks in layer 4 of the neocortex. , 2003, Journal of neurophysiology.

[142]  Bertram E. Shi,et al.  Expandable Networks for Neuromorphic Chips , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[143]  Michael L. Hines,et al.  Fully implicit parallel simulation of single neurons , 2008, Journal of Computational Neuroscience.

[144]  Eugene M. Izhikevich,et al.  Polychronization: Computation with Spikes , 2006, Neural Computation.

[145]  Barry Horwitz,et al.  Investigating the neural basis for functional and effective connectivity. Application to fMRI , 2005, Philosophical Transactions of the Royal Society B: Biological Sciences.

[146]  G. Bi,et al.  Synaptic Modifications in Cultured Hippocampal Neurons: Dependence on Spike Timing, Synaptic Strength, and Postsynaptic Cell Type , 1998, The Journal of Neuroscience.

[147]  M. Ross Quillian,et al.  Retrieval time from semantic memory , 1969 .

[148]  Dharmendra S. Modha,et al.  IBM Research Report Towards Real-Time, Mouse-Scale Cortical Simulations , 2007 .

[149]  Bruno A. Olshausen,et al.  Book Review , 2003, Journal of Cognitive Neuroscience.

[150]  W. Levy,et al.  Temporal contiguity requirements for long-term associative potentiation/depression in the hippocampus , 1983, Neuroscience.

[151]  Ben Goertzel,et al.  Human-level artificial general intelligence and the possibility of a technological singularity: A reaction to Ray Kurzweil's The Singularity Is Near, and McDermott's critique of Kurzweil , 2007, Artif. Intell..

[152]  Olaf Sporns,et al.  Neuromodulation and plasticity in an autonomous robot , 2002, Neural Networks.

[153]  K. Boahen.  Neuromorphic Microchips. , 2005, Scientific American.

[154]  Drew McDermott,et al.  Kurzweil's argument for the success of AI , 2006, Artif. Intell..

[155]  Kwabena Boahen,et al.  An ON-OFF log domain circuit that recreates adaptive filtering in the retina , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[156]  F. T. Husain,et al.  Relating neuronal dynamics for auditory object processing to neuroimaging activity: a computational modeling and an fMRI study , 2004, NeuroImage.

[157]  E. Harth,et al.  Electric Fields of the Brain: The Neurophysics of Eeg , 2005 .

[158]  Cristina Savin,et al.  Erratum: Resonance or integration? Self-sustained dynamics and excitability of neural microcircuits (Journal of Neurophysiology (2007) 97, (1911-1930) DOI: 10.1152/jn.01043.2006) , 2010 .

[159]  M. Just,et al.  Aphasic Sentence Comprehension as a Resource Deficit: A Computational Approach , 1997, Brain and Language.

[160]  J. Fodor,et al.  Connectionism and cognitive architecture: A critical analysis , 1988, Cognition.

[161]  K. Boahen.  Neuromorphic Microchips. (Cover story) , 2005 .

[162]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[163]  Christof Koch,et al.  Biophysics of Computation: Information Processing in Single Neurons (Computational Neuroscience Series) , 1998 .

[164]  Philippe Gaussier,et al.  From view cells and place cells to cognitive map learning: processing stages of the hippocampal system , 2002, Biological Cybernetics.

[165]  B. Horwitz,et al.  Functional Interactions of the Inferior Frontal Cortex during the Processing of Words and Word-like Stimuli , 2001, Neuron.

[166]  Cristina Savin,et al.  Resonance or integration? Self-sustained dynamics and excitability of neural microcircuits. , 2007, Journal of neurophysiology.