Neural Learning Circuits Utilizing Nano-Crystalline Silicon Transistors and Memristors

Properties of neural circuits are demonstrated via SPICE simulations and their applications are discussed. The neuron and synapse subcircuits include ambipolar nano-crystalline silicon transistor and memristor device models based on measured data. Neuron circuit characteristics and the Hebbian synaptic learning rule are shown to be similar to biology. Changes in the average firing rate learning rule depending on various circuit parameters are also presented. The subcircuits are then connected into larger neural networks that demonstrate fundamental properties including associative learning and pulse coincidence detection. Learned extraction of a fundamental frequency component from noisy inputs is demonstrated. It is then shown that if the fundamental sinusoid of one neuron input is out of phase with the rest, its synaptic connection changes differently than the others. Such behavior indicates that the system can learn to detect which signals are important in the general population, and that there is a spike-timing-dependent component of the learning mechanism. Finally, future circuit design and considerations are discussed, including requirements for the memristive device.

[1]  Vittorio Dante,et al.  A VLSI recurrent network of integrate-and-fire neurons connected by plastic synapses with long-term memory , 2003, IEEE Trans. Neural Networks.

[2]  Kwabena Boahen,et al.  Point-to-point connectivity between neuromorphic chips using address events , 2000 .

[3]  J. Hawkins,et al.  On Intelligence , 2004 .

[4]  J. Knott The organization of behavior: A neuropsychological theory , 1951 .

[5]  T. Serrano-Gotarredona,et al.  Exploiting memristance in adaptive asynchronous spiking neuromorphic nanotechnology systems , 2009, 2009 9th IEEE Conference on Nanotechnology (IEEE-NANO).

[6]  H. Gundersen,et al.  Total regional and global number of synapses in the human brain neocortex , 2001, Synapse.

[7]  G. Stuart,et al.  Direct measurement of specific membrane capacitance in neurons. , 2000, Biophysical journal.

[8]  Massimiliano Di Ventra,et al.  Experimental demonstration of associative memory with memristive neural networks , 2009, Neural Networks.

[9]  A. van Schaik Building blocks for electronic spiking neural networks. , 2001, Neural networks : the official journal of the International Neural Network Society.

[10]  Bernabé Linares-Barranco,et al.  On Spike-Timing-Dependent-Plasticity, Memristive Devices, and Building a Self-Learning Visual Cortex , 2011, Front. Neurosci..

[11]  Yuriy V. Pershin,et al.  Memory effects in complex materials and nanoscale systems , 2010, 1011.3053.

[12]  J. Yang,et al.  Memristive switching mechanism for metal/oxide/metal nanodevices. , 2008, Nature nanotechnology.

[13]  K. D. Cantley,et al.  Hebbian Learning in Spiking Neural Networks With Nanocrystalline Silicon TFTs and Memristive Synapses , 2011, IEEE Transactions on Nanotechnology.

[14]  P. Schwindt,et al.  Repetitive firing in layer V neurons from cat neocortex in vitro. , 1984, Journal of neurophysiology.

[15]  André van Schaik Building blocks for electronic spiking neural networks , 2001, Neural Networks.

[16]  W. Singer,et al.  Integrator or coincidence detector? The role of the cortical neuron revisited , 1996, Trends in Neurosciences.

[17]  Philip H Smith,et al.  Coincidence Detection in the Auditory System 50 Years after Jeffress , 1998, Neuron.

[18]  Wei Yang Lu,et al.  Nanoscale memristor device as synapse in neuromorphic systems. , 2010, Nano letters.

[19]  Kurt Wiesenfeld,et al.  Stochastic resonance and the benefits of noise: from ice ages to crayfish and SQUIDs , 1995, Nature.

[20]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[21]  Richard A. Chapman,et al.  Submicron ambipolar nanocrystalline-silicon TFTs with high-K gate dielectrics , 2011, 2011 International Semiconductor Device Research Symposium (ISDRS).

[22]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[23]  D. Stewart,et al.  The missing memristor found , 2008, Nature.

[24]  Gregory S. Snider,et al.  Spike-timing-dependent learning in memristive nanodevices , 2008, 2008 IEEE International Symposium on Nanoscale Architectures.

[25]  E. Lehtonen,et al.  CNN using memristors for neighborhood connections , 2010, 2010 12th International Workshop on Cellular Nanoscale Networks and their Applications (CNNA 2010).

[26]  勇一 作村,et al.  Biophysics of Computation , 2001 .

[27]  J. Palva,et al.  Phase Synchrony among Neuronal Oscillations in the Human Cortex , 2005, The Journal of Neuroscience.

[28]  Christopher J. Bishop,et al.  Pulsed Neural Networks , 1998 .

[29]  J. Lisman,et al.  Oscillations in the alpha band (9-12 Hz) increase with memory load during retention in a short-term memory task. , 2002, Cerebral cortex.

[30]  Massimiliano Di Ventra,et al.  Neuromorphic, Digital, and Quantum Computation With Memory Circuit Elements , 2010, Proceedings of the IEEE.

[31]  Richard A. Chapman,et al.  SPICE simulation of nanoscale non-crystalline silicon TFTs in spiking neuron circuits , 2010, 2010 53rd IEEE International Midwest Symposium on Circuits and Systems.

[32]  Giacomo Indiveri,et al.  A VLSI array of low-power spiking neurons and bistable synapses with spike-timing dependent plasticity , 2006, IEEE Transactions on Neural Networks.

[33]  G. Bi,et al.  Synaptic modification by correlated activity: Hebb's postulate revisited. , 2001, Annual review of neuroscience.

[34]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[35]  B. Pakkenberg,et al.  Neocortical neuron number in humans: Effect of sex and age , 1997, The Journal of comparative neurology.

[36]  Richard A. Chapman,et al.  Ambipolar nano-crystalline-silicon TFTs with submicron dimensions and reduced threshold voltage shift , 2011, 69th Device Research Conference.

[37]  E. M. Vogel,et al.  Submicron Ambipolar Nanocrystalline Silicon Thin-Film Transistors and Inverters , 2012, IEEE Transactions on Electron Devices.