Neuromorphic systems: past, present and future.

Neuromorphic systems are implementations in silicon of elements of neural systems. The idea of electronic implementation is not new, but modern microelectronics has provided opportunities for producing systems for both sensing and neural modelling that can be mass produced straightforwardly. We review the the history of neuromorphic systems, and discuss the range of neuromorphic systems that have been developed. We discuss recent ideas for overcoming some of the problems, particularly providing effective adaptive synapses in large numbers.

[1]  I. Aleksander,et al.  WISARD·a radical step forward in image recognition , 1984 .

[2]  Jim Austin,et al.  PRESENCE, a hardware implementation of binary neural networks , 1998 .

[3]  James A. Anderson,et al.  Neurocomputing: Foundations of Research , 1988 .

[4]  T. Pearce,et al.  Computational parallels between the biological olfactory pathway and its analogue 'the electronic nose': Part II. Sensor-based machine olfaction. , 1997, Bio Systems.

[5]  Paul A. Merolla,et al.  A silicon model of the primary visual cortex: Representing features through stochastic variations , 2006 .

[6]  R. Douglas,et al.  A silicon neuron , 1991, Nature.

[7]  Paul E. Hasler,et al.  A Silicon Axon , 1994, NIPS.

[8]  Andreas G. Andreou,et al.  Winner-Takes-All Associative Memory: A Hamming Distance Vector Quantizer , 1997 .

[9]  W. Pitts,et al.  A Logical Calculus of the Ideas Immanent in Nervous Activity (1943) , 2021, Ideas That Created the Future.

[10]  Leslie S. Smith,et al.  Analogue VLSI Leaky Integrate-and-Fire Neurons and Their Use in a Sound Analysis System , 2002 .

[11]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[12]  J. Austin,et al.  An analogue sum and threshold neuron based on the quantum tunnelling amplification of electrical pulses , 2008 .

[13]  John Lazzaro,et al.  Winner-Take-All Networks of O(N) Complexity , 1988, NIPS.

[14]  John G. Elias,et al.  Artificial Dendritic Trees , 1993, Neural Computation.

[15]  Rodney J. Douglas,et al.  CHARACTERIZATION OF A SILICON PYRAMIDAL NEURON , 1998 .

[16]  Chiara Bartolozzi,et al.  Synaptic Dynamics in Analog VLSI , 2007, Neural Computation.

[17]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[18]  Anthony G. Pipe,et al.  A Hardware Based Implementation of a Tactile Sensory System For Neuromorphic Signal Processing Applications , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[19]  Piotr Dudek,et al.  Compact silicon neuron circuit with spiking and bursting behaviour , 2008, Neural Networks.

[20]  E. Vittoz,et al.  An analogue electronic model of Ventral Cochlear Nucleus neurons , 1996, Proceedings of Fifth International Conference on Microelectronics for Neural Networks.

[21]  T. Pearce.  Computational parallels between the biological olfactory pathway and its analogue 'the electronic nose': Part I. Biological olfaction. , 1997, Bio Systems.

[22]  Andreas G. Andreou,et al.  Analog VLSI neuromorphic image acquisition and pre-processing systems , 1995, Neural Networks.

[23]  G Roy,et al.  A simple electronic analog of the squid axon membrane: the NEUROFET. , 1972, IEEE transactions on bio-medical engineering.

[24]  Shih-Chii Liu,et al.  Analog VLSI: Circuits and Principles , 2002 .

[25]  B. Webb,et al.  Fabrication and characterization of a wind sensor for integration with a neuron circuit , 2007 .

[26]  S S Viglione,et al.  Electronic synthesis of the avian retina. , 1968, IEEE transactions on bio-medical engineering.

[27]  Thomas G. Dietterich,et al.  Editors. Advances in Neural Information Processing Systems , 2002 .

[28]  Rodney J. Douglas,et al.  An Improved Silicon Neuron , 2000 .

[29]  David P. M. Northmore,et al.  Spike Train Processing by a Silicon Neuromorph: The Role of Sublinear Summation in Dendrites , 1996, Neural Computation.

[30]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[31]  William H. Brockman,et al.  A Simple Electronic Neuron Model Incorporating Both Active and Passive Responses , 1979, IEEE Transactions on Biomedical Engineering.

[32]  Craig T. Jin,et al.  An Active 2-D Silicon Cochlea , 2008, IEEE Transactions on Biomedical Circuits and Systems.

[33]  Stuart R. Hameroff,et al.  The Brain Is Both Neurocomputer and Quantum Computer , 2007, Cogn. Sci..

[34]  Liam McDaid,et al.  EMBRACE: emulating biologically-inspired architectures on hardware , 2008 .

[35]  Z. Vizvary,et al.  Characterization of an Integrable Single-Crystalline 3-D Tactile Sensor , 2006, IEEE Sensors Journal.

[36]  D. Cumming,et al.  Design of a Single-Chip pH Sensor Using a Conventional 0 . 6-m CMOS Process , 2004 .

[37]  J Lazzaro,et al.  Silicon modeling of pitch perception. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[38]  Andreas G. Andreou,et al.  A design framework for low power analog filter banks , 1995 .

[39]  Robert W. Newcomb,et al.  Evaluation of the VLSI adaptation of the CHEMFET, a biosensor for fluid analysis , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[40]  John Lazzaro,et al.  A Silicon Model Of Auditory Localization , 1989, Neural Computation.

[41]  T. J. Stonham,et al.  Guide to pattern recognition using random-access memories , 1979 .

[42]  Rodney J. Douglas,et al.  Forward- and backpropagation in a silicon dendrite , 2001, IEEE Trans. Neural Networks.

[43]  R FitzHugh.  An electronic model of the nerve membrane for demonstration purposes. , 1966, Journal of applied physiology.

[44]  H. V. Shurmer,et al.  Odour discrimination with an electronic nose , 1992 .

[45]  Misha Mahowald,et al.  A silicon model of early visual processing , 1993, Neural Networks.

[46]  G R Hanna,et al.  Membrane model: a single transistor analog of excitable membrane. , 1969, Journal of theoretical biology.

[47]  Weimin Liu,et al.  Voiced-speech representation by an analog silicon model of the auditory periphery , 1992, IEEE Trans. Neural Networks.

[48]  Lynn Conway,et al.  Introduction to VLSI systems , 1978 .

[49]  Miguel Figueroa,et al.  Competitive learning with floating-gate circuits , 2002, IEEE Trans. Neural Networks.

[50]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[51]  Alister Hamilton,et al.  Analog VLSI Circuit Implementation of an Adaptive Neuromorphic Olfaction Chip , 2007, IEEE Transactions on Circuits and Systems I: Regular Papers.

[52]  C. M. Markan,et al.  Neuromorphic building blocks for adaptable cortical feature maps , 2007, 2007 IFIP International Conference on Very Large Scale Integration.

[53]  A. Hodgkin,et al.  Currents carried by sodium and potassium ions through the membrane of the giant axon of Loligo , 1952, The Journal of physiology.

[54]  Vittorio Dante,et al.  A VLSI recurrent network of integrate-and-fire neurons connected by plastic synapses with long-term memory , 2003, IEEE Trans. Neural Networks.

[55]  W S McCulloch,et al.  A logical calculus of the ideas immanent in nervous activity , 1990, The Philosophy of Artificial Intelligence.

[56]  Debanik Roy,et al.  Design and Developmental Metrics of a ‘Skin-Like’ Multi-Input Quasi-Compliant Robotic Gripper Sensor Using Tactile Matrix , 2006, J. Intell. Robotic Syst..

[57]  Carver A. Mead,et al.  A single-transistor silicon synapse , 1996 .

[58]  André van Schaik,et al.  Design of an Analogue VLSI Model of an Active Cochlea , 1997 .

[59]  Örjan Ekeberg,et al.  Brain-scale simulation of the neocortex on the IBM Blue Gene/L supercomputer , 2008, IBM J. Res. Dev..

[60]  Dedy H. B. Wicaksono,et al.  Fly's Proprioception-inspired micromachined strain-sensing structure: idea, design, modeling and simulation, and comparison with experimental results , 2006 .

[61]  Evangelia Micheli-Tzanakou,et al.  A neuromime in VLSI , 1996, IEEE Trans. Neural Networks.

[62]  John Lazzaro,et al.  Circuit Models of Sensory Transduction in the Cochlea , 1989, Analog VLSI Implementation of Neural Systems.

[63]  Florentin Wörgötter,et al.  A neuromorphic depth-from-motion vision model with STDP adaptation , 2006, IEEE Transactions on Neural Networks.

[64]  Walter W. Soroka,et al.  Analog methods in computation and simulation , 1954 .

[65]  Jim Austin,et al.  Artificial ion channels and spike computation in modulation-doped semiconductors , 2004 .

[66]  D. Cumming,et al.  Design of a single-chip pH sensor using a conventional 0.6-/spl mu/m CMOS process , 2004, IEEE Sensors Journal.

[67]  Christof Koch,et al.  An Analog VLSI Model of the Fly Elementary Motion Detector , 1997, NIPS.

[68]  John Wawrzynek,et al.  Speech Recognition Experiments with Silicon Auditory Models , 1997 .

[69]  André van Schaik,et al.  A Silicon Model of Amplitude Modulation Detection in the Auditory Brainstem , 1996, NIPS.

[70]  E. R. Lewis,et al.  An electronic model of neuroelectric point processes , 1968, Kybernetik.

[71]  Richard F. Lyon,et al.  An analog electronic cochlea , 1988, IEEE Trans. Acoust. Speech Signal Process..

[72]  Weimin Liu,et al.  Analog Cochlear Model for Multiresolution Speech Analysis , 1992, NIPS.