Real time unsupervised learning of visual stimuli in neuromorphic VLSI systems

Neuromorphic chips embody computational principles operating in the nervous system, into microelectronic devices. In this domain it is important to identify computational primitives that theory and experiments suggest as generic and reusable cognitive elements. One such element is provided by attractor dynamics in recurrent networks. Point attractors are equilibrium states of the dynamics (up to fluctuations), determined by the synaptic structure of the network; a ‘basin’ of attraction comprises all initial states leading to a given attractor upon relaxation, hence making attractor dynamics suitable to implement robust associative memory. The initial network state is dictated by the stimulus, and relaxation to the attractor state implements the retrieval of the corresponding memorized prototypical pattern. In a previous work we demonstrated that a neuromorphic recurrent network of spiking neurons and suitably chosen, fixed synapses supports attractor dynamics. Here we focus on learning: activating on-chip synaptic plasticity and using a theory-driven strategy for choosing network parameters, we show that autonomous learning, following repeated presentation of simple visual stimuli, shapes a synaptic connectivity supporting stimulus-selective attractors. Associative memory develops on chip as the result of the coupled stimulus-driven neural activity and ensuing synaptic dynamics, with no artificial separation between learning and retrieval phases.

[1]  Chiara Bartolozzi,et al.  Neuromorphic Electronic Circuits for Building Autonomous Cognitive Systems , 2014, Proceedings of the IEEE.

[2]  Paolo Del Giudice,et al.  Long and short-term synaptic plasticity and the formation of working memory: A case study , 2001, Neurocomputing.

[3]  Giacomo Indiveri,et al.  A device mismatch compensation method for VLSI neural networks , 2010, 2010 Biomedical Circuits and Systems Conference (BioCAS).

[4]  Mario Pannunzi,et al.  Classification of Correlated Patterns with a Configurable Analog VLSI Neural Network of Spiking Neurons and Self-Regulating Plastic Synapses , 2009, Neural Computation.

[5]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[6]  Giacomo Indiveri,et al.  Real-Time Classification of Complex Patterns Using Spike-Based Learning in Neuromorphic VLSI , 2009, IEEE Transactions on Biomedical Circuits and Systems.

[7]  Daniel J. Amit,et al.  Mean Field and Capacity in Realistic Networks of Spiking Neurons Storing Sparsely Coded Random Memories , 2004, Neural Computation.

[8]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Bernard Widrow,et al.  Adaptive switching circuits , 1988 .

[10]  Andre van Schaik,et al.  Asynchronous Binaural Spatial Audition Sensor With 2$\,\times\,$64$\,\times\,$4 Channel Output , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[11]  Roberto Cordeschi,et al.  The Discovery of the Artificial. Behavior, Mind and Machines Before and Beyond Cybernetics , 2010, Studies in Cognitive Systems.

[12]  Xiao-Jing Wang Attractor Network Models , 2009 .

[13]  Daniel J. Amit,et al.  Modeling brain function: the world of attractor neural networks, 1st Edition , 1989 .

[14]  D. Amit,et al.  Effective neural response function for collective population states. , 1999, Network.

[15]  M. Bear,et al.  A biophysically-based neuromorphic model of spike rate- and timing-dependent plasticity , 2011, Proceedings of the National Academy of Sciences.

[16]  O. Cueto,et al.  Physical aspects of low power synapses based on phase change memory devices , 2012 .

[17]  Philipp Häfliger,et al.  A multi-level static memory cell , 2003, ISCAS.

[18]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[19]  Shimeng Yu,et al.  Synaptic electronics: materials, devices and applications , 2013, Nanotechnology.

[20]  Paul E. Hasler,et al.  Biological learning modeled in an adaptive floating-gate system , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[21]  R. Douglas,et al.  Event-Based Neuromorphic Systems , 2015 .

[22]  Giacomo Indiveri,et al.  Spike-based learning with a generalized integrate and fire silicon neuron , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[23]  Shih-Chii Liu,et al.  Temporally learning floating-gate VLSI synapses , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[24]  Tobi Delbrück,et al.  CAVIAR: A 45k Neuron, 5M Synapse, 12G Connects/s AER Hardware Sensory–Processing– Learning–Actuating System for High-Speed Visual Object Recognition and Tracking , 2009, IEEE Transactions on Neural Networks.

[25]  Mohammed Ismail,et al.  Analog VLSI Implementation of Neural Systems , 2011, The Kluwer International Series in Engineering and Computer Science.

[26]  Shih-Chii Liu,et al.  Neuromorphic sensory systems , 2010, Current Opinion in Neurobiology.

[27]  Nicolas Brunel,et al.  Learning internal representations in an attractor neural network with analogue neurons , 1995 .

[28]  Tamás Roska,et al.  A Biomimetic Model of the Outer Plexiform Layer by Incorporating Memristive Devices , 2012, Physical review. E, Statistical, nonlinear, and soft matter physics.

[29]  Alan F. Murray,et al.  Spike-Timing-Dependent Plasticity With Weight Dependence Evoked From Physical Constraints , 2012, IEEE Transactions on Biomedical Circuits and Systems.

[30]  T. Serrano-Gotarredona,et al.  STDP and STDP variations with memristors for spiking neuromorphic learning systems , 2013, Front. Neurosci..

[31]  Vittorio Dante,et al.  PCI-AER hardware and software for interfacing to address-event based neuromorphic systems , 2005 .

[32]  Giacomo Indiveri,et al.  Synthesizing cognition in neuromorphic electronic systems , 2013, Proceedings of the National Academy of Sciences.

[33]  Davide Badoni,et al.  Spike-Driven Synaptic Plasticity: Theory, Simulation, VLSI Implementation , 2000, Neural Computation.

[34]  Jochen Braun,et al.  Attractors and noise: Twin drivers of decisions and multistability , 2010, NeuroImage.

[35]  L. Abbott,et al.  Limits on the memory storage capacity of bounded synapses , 2007, Nature Neuroscience.

[36]  Patrick Camilleri,et al.  Robust Working Memory in an Asynchronously Spiking Neural Network Realized with Neuromorphic VLSI , 2011, Frontiers in Neuroscience.

[37]  Arindam Basu,et al.  A Learning-Enabled Neuron Array IC Based Upon Transistor Channel Models of Biological Phenomena , 2013, IEEE Transactions on Biomedical Circuits and Systems.

[38]  Walter Senn,et al.  Learning Real-World Stimuli in a Neural Network with Spike-Driven Synaptic Dynamics , 2007, Neural Computation.

[39]  Alan F. Murray,et al.  Synchrony detection and amplification by silicon neurons with STDP synapses , 2004, IEEE Transactions on Neural Networks.

[40]  Nan Du,et al.  Waveform Driven Plasticity in BiFeO3 Memristive Devices: Model and Implementation , 2012, NIPS.

[41]  Stefano Fusi,et al.  Hebbian spike-driven synaptic plasticity for learning patterns of mean firing rates , 2002, Biological Cybernetics.

[42]  Yong Liu,et al.  A 45nm CMOS neuromorphic chip with a scalable architecture for learning in networks of spiking neurons , 2011, 2011 IEEE Custom Integrated Circuits Conference (CICC).

[43]  Misha A. Mahowald,et al.  An Analog VLSI System for Stereoscopic Vision , 1994 .

[44]  Patrick Camilleri,et al.  A VLSI network of spiking neurons with plastic fully configurable “stop-learning” synapses , 2008, 2008 15th IEEE International Conference on Electronics, Circuits and Systems.

[45]  P. D. Giudice,et al.  Modelling the formation of working memory with networks of integrate-and-fire neurons connected by plastic synapses , 2003, Journal of Physiology-Paris.

[46]  Robert B. Allen,et al.  Performance of a Stochastic Learning Microchip , 1990, NIPS.

[47]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[48]  Philipp Häfliger Adaptive WTA With an Analog VLSI Neuromorphic Learning Chip , 2007, IEEE Transactions on Neural Networks.

[49]  Paul E. Hasler,et al.  Floating gate synapses with spike time dependent plasticity , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[50]  Gert Cauwenberghs,et al.  Neuromorphic learning VLSI systems: a survey , 1998 .

[51]  Kwabena Boahen,et al.  Learning in Silicon: Timing is Everything , 2005, NIPS.

[52]  Sandro Romani,et al.  Learning in realistic networks of spiking neurons and spike‐driven plastic synapses , 2005, The European journal of neuroscience.

[53]  Maurizio Mattia,et al.  Finite-size dynamics of inhibitory and excitatory interacting spiking neurons. , 2004, Physical review. E, Statistical, nonlinear, and soft matter physics.

[54]  Johannes Schemmel,et al.  Implementing Synaptic Plasticity in a VLSI Spiking Neural Network Model , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[55]  Alan A. Stocker Analog VLSI Implementation , 2006 .