STICK: Spike Time Interval Computational Kernel, a Framework for General Purpose Computation Using Neurons, Precise Timing, Delays, and Synchrony

There has been significant research over the past two decades in developing new platforms for spiking neural computation. Current neural computers are primarily developed to mimic biology. They use neural networks, which can be trained to perform specific tasks to mainly solve pattern recognition problems. These machines can do more than simulate biology; they allow us to rethink our current paradigm of computation. The ultimate goal is to develop brain-inspired general purpose computation architectures that can breach the current bottleneck introduced by the von Neumann architecture. This work proposes a new framework for such a machine. We show that the use of neuron-like units with precise timing representation, synaptic diversity, and temporal delays allows us to set a complete, scalable compact computation framework. The framework provides both linear and nonlinear operations, allowing us to represent and solve any function. We show usability in solving real use cases from simple differential equations to sets of nonlinear differential equations leading to chaotic attractors.

[1]  H. Swadlow Efferent neurons and suspected interneurons in binocular visual cortex of the awake rabbit: receptive fields and binocular properties. , 1988, Journal of neurophysiology.

[2]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[3]  Steve B. Furber,et al.  The SpiNNaker Project , 2014, Proceedings of the IEEE.

[4]  Giacomo Indiveri,et al.  A Current-Mode Hysteretic Winner-take-all Network, with Excitatory and Inhibitory Coupling , 2001 .

[5]  John W. Backus,et al.  Can programming be liberated from the von Neumann style?: a functional style and its algebra of programs , 1978, CACM.

[6]  H. Swadlow Efferent neurons and suspected interneurons in motor cortex of the awake rabbit: axonal properties, sensory receptive fields, and subthreshold synaptic inputs. , 1994, Journal of neurophysiology.

[7]  Herb Sutter,et al.  The Free Lunch Is Over A Fundamental Turn Toward Concurrency in Software , 2013 .

[8]  P. H. Schiller,et al.  Spatial frequency and orientation tuning dynamics in area V1 , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Daniel Matolin,et al.  A QVGA 143 dB Dynamic Range Frame-Free PWM Image Sensor With Lossless Pixel-Level Video Compression and Time-Domain CDS , 2011, IEEE Journal of Solid-State Circuits.

[10]  I. Tetko,et al.  Spatiotemporal activity patterns of rat cortical neurons predict responses in a conditioned task. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Giacomo Indiveri,et al.  Systematic configuration and automatic tuning of neuromorphic systems , 2011, 2011 IEEE International Symposium of Circuits and Systems (ISCAS).

[12]  Zhenghao Chen,et al.  On Random Weights and Unsupervised Feature Learning , 2011, ICML.

[13]  P. Somogyi,et al.  Target-cell-specific facilitation and depression in neocortical circuits , 1998, Nature Neuroscience.

[14]  André van Schaik,et al.  Learning the pseudoinverse solution to network weights , 2012, Neural Networks.

[15]  K. Morris,et al.  Repeated sequences of interspike intervals in baroresponsive respiratory related neuronal assemblies of the cat brain stem. , 2000, Journal of neurophysiology.

[16]  E. Lorenz Deterministic nonperiodic flow , 1963 .

[17]  G. Gerstein,et al.  Repeated patterns of distributed synchrony in neuronal assemblies. , 1997, Journal of neurophysiology.

[18]  Eugenio Culurciello,et al.  Activity-driven, event-based vision sensors , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[19]  Idan Segev,et al.  On the Transmission of Rate Code in Long Feedforward Networks with Excitatory–Inhibitory Balance , 2003, The Journal of Neuroscience.

[20]  Rodrigo Alvarez-Icaza,et al.  Neurogrid: A Mixed-Analog-Digital Multichip System for Large-Scale Neural Simulations , 2014, Proceedings of the IEEE.

[21]  M. Shadlen,et al.  Limits to the temporal fidelity of cortical spike rate signals , 2002, Nature Neuroscience.

[22]  R. Reid,et al.  Temporal Coding of Visual Information in the Thalamus , 2000, The Journal of Neuroscience.

[23]  J. Deuchars,et al.  Single axon excitatory postsynaptic potentials in neocortical interneurons exhibit pronounced paired pulse facilitation , 1993, Neuroscience.

[24]  H. Swadlow Monitoring the excitability of neocortical efferent neurons to direct activation by extracellular current pulses. , 1992, Journal of neurophysiology.

[25]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[26]  Terrence J. Sejnowski,et al.  Time for a new neural code? , 1995, Nature.

[27]  Daniel Matolin,et al.  An asynchronous time-based image sensor , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[28]  H. Markram,et al.  Differential signaling via the same axon of neocortical pyramidal neurons. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[29]  C. Darlington,et al.  Damage to the vestibular inner ear causes long-term changes in neuronal nitric oxide synthase expression in the rat hippocampus , 2001, Neuroscience.

[30]  Igor V. Tetko,et al.  A pattern grouping algorithm for analysis of spatiotemporal patterns in neuronal spike trains. 2. Application to simultaneous single unit recordings , 2001, Journal of Neuroscience Methods.

[31]  Johannes Schemmel,et al.  Wafer-scale integration of analog neural networks , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[32]  Trevor Bekolay,et al.  A Large-Scale Model of the Functioning Brain , 2012, Science.

[33]  E. Vaadia,et al.  Spatiotemporal structure of cortical activity: properties and behavioral relevance. , 1998, Journal of neurophysiology.

[34]  T. Albright,et al.  Efficient Discrimination of Temporal Patterns by Motion-Sensitive Neurons in Primate Visual Cortex , 1998, Neuron.

[35]  Lei Chen,et al.  Enhanced random search based incremental extreme learning machine , 2008, Neurocomputing.

[36]  Giacomo Indiveri,et al.  Exploiting device mismatch in neuromorphic VLSI systems to implement axonal delays , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[37]  AI Koan,et al.  Weighted Sums of Random Kitchen Sinks: Replacing minimization with randomization in learning , 2008, NIPS.

[38]  T. Sejnowski,et al.  Reliability of spike timing in neocortical neurons. , 1995, Science.

[39]  Michael J. Berry,et al.  The structure and precision of retinal spike trains. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[40]  Chiara Bartolozzi,et al.  Event-Based Visual Flow , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[41]  H. Swadlow Physiological properties of individual cerebral axons studied in vivo for as long as one year. , 1985, Journal of neurophysiology.

[42]  Gregory Cohen,et al.  Synthesis of neural networks for spatio-temporal spike pattern recognition and processing , 2013, Front. Neurosci..

[43]  Bernabé Linares-Barranco,et al.  Multicasting Mesh AER: A Scalable Assembly Approach for Reconfigurable Neuromorphic Structured AER Systems. Application to ConvNets , 2013, IEEE Transactions on Biomedical Circuits and Systems.

[44]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.