Oscillator Circuit for Spike Neural Network with Sigmoid Like Activation Function and Firing Rate Coding

The study presents an oscillator circuit for a spike neural network with the possibility of firing rate coding and sigmoid-like activation function. The circuit contains a switching element with an S-shaped current-voltage characteristic and two capacitors; one of the capacitors is shunted by a control resistor. The circuit is characterised by a strong dependence of the frequency of relaxation oscillations on the magnitude of the control resistor. The dependence has a sigmoid-like form and we present an analytical method for dependence calculation. Finally, we describe the concept of the spike neural network architecture with firing rate coding based on the presented circuit for creating neuromorphic devices and artificial intelligence.

[1]  Arnaud Delorme,et al.  Spike-based strategies for rapid processing , 2001, Neural Networks.

[2]  Alexander Pergament,et al.  Modeling of thermal coupling in VO2-based oscillatory neural networks , 2018 .

[3]  Petr Boriskov,et al.  Switch Elements with S-Shaped Current-Voltage Characteristic in Models of Neural Oscillators , 2019, ArXiv.

[4]  N. Bogoslovskiy,et al.  Physics of switching and memory effects in chalcogenide glassy semiconductors , 2012 .

[5]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[6]  Maksim Belyaev,et al.  Model of an oscillatory neural network with multilevel neurons for pattern recognition , 2018, Electronics.

[7]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[8]  Lucia Rita Quitadamo,et al.  Resistive flex sensors: a survey , 2015 .

[9]  Carver A. Mead.  Analog VLSI and neural systems (invited presentation) , 1989 .

[10]  Wei Yi,et al.  Biological plausibility and stochasticity in scalable VO2 active memristor neurons , 2018, Nature Communications.

[11]  Junqiao Wu,et al.  Thermal diodes, regulators, and switches: Physical mechanisms and potential applications , 2017 .

[12]  Romain Brette,et al.  Philosophy of the Spike: Rate-Based vs. Spike-Based Theories of the Brain , 2015, Front. Syst. Neurosci..

[13]  Alexander Pergament,et al.  Thermal coupling and effect of subharmonic synchronization in a system of two VO2 based oscillators , 2020, ArXiv.

[14]  Giacomo Indiveri,et al.  Synaptic Plasticity and Spike-based Computation in VLSI Networks of Integrate-and-Fire Neurons , 2007 .

[15]  S. D. Khanin,et al.  The non-capacitor model of leaky integrate-and-fire VO2 neuron with the thermal mechanism of the membrane potential , 2019, ArXiv.

[16]  T. Nakajima,et al.  Improvement of temperature coefficient of resistance of a VO2 film on an SiN/polyimide/Si substrate by excimer laser irradiation for IR sensors , 2014 .

[17]  S. D. Khanin,et al.  Switching Channel Development Dynamics in Planar Structures on the Basis of Vanadium Dioxide , 2018 .

[18]  N. Nguyen,et al.  Thermoresistive Effect for Advanced Thermal Sensors: Fundamentals, Design Considerations, and Applications , 2017, Journal of Microelectromechanical Systems.

[19]  Mirko Hansen,et al.  A memristive spiking neuron with firing rate coding , 2015, Front. Neurosci..

[20]  A. Pergament,et al.  Electroforming and Switching in Oxides of Transition Metals: The Role of Metal-Insulator Transition in the Switching Mechanism , 1996 .

[21]  Timothée Masquelier,et al.  Deep Learning in Spiking Neural Networks , 2018, Neural Networks.

[22]  Eugene M. Izhikevich,et al.  Simple model of spiking neurons , 2003, IEEE Trans. Neural Networks.

[23]  Zhengkun Yi,et al.  Biomimetic tactile sensors and signal processing with spike trains: A review , 2018 .

[24]  Wofgang Maas,et al.  Networks of spiking neurons: the third generation of neural network models , 1997 .

[25]  F. Dodge,et al.  Deciphering a neural code for vision. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[26]  E. Adrian,et al.  The impulses produced by sensory nerve endings , 1926, The Journal of physiology.

[27]  Shigeo Kobayashi.  Temperature receptors in cutaneous nerve endings are thermostat molecules that induce thermoregulatory behaviors against thermal load , 2015, Temperature.

[28]  Alexander Pergament,et al.  Electrical Switching in Thin Film Structures Based on Transition Metal Oxides , 2015 .