Ultra low power analog design and technology for artificial neurons

In a context of the end of Moore's law, energy dissipation constitutes a real challenge. Among the new energy efficient paradigms for data processing, bio-inspired computing is very promising, moreover introducing cognitive characteristics. As applications at very high scale are addressed, the size and energy dissipation of both the neuron and synapse cells needs to be minimized. In this context, this paper presents the design of an original artificial neuron, using standard 65nm CMOS technology with optimized energy efficiency and its application in basic neural networks. By recalling brain and neuron features, it is shown why neuron energy efficiency is roughly limited to 1 pJ/spike in biological neuron. Biological and artificial neurons features are carefully compared, highlighting the importance of downscaling. The artificial neuron circuit presented was designed to exhibit wide band spiking frequencies, targeting large scale bio-inspired information processing applications. The most important feature of the fabricated circuits is the neuron energy efficiency in the few fJ/spike range, which improves prior state-of-the-art by two to three orders of magnitude. This performance is achieved by minimizing two key parameters: the supply voltage and the related membrane capacitance. Meanwhile, the obtained standby power at a resting output does not exceed tens of picowatts. The circuit is sized to 35μm2, reaching a spiking output frequency of 26kHz. It is then shown how this artificial technology has already been used for two applications: (i) emulation of bursting mode, important in brain stimulation context or for robotics (locomotion rhythm), (ii) stochastic resonance application, useful to detect an electrical signal buried in noise, phenomena exploited in nature by species. These results already allow envisioning the development of highly integrated neuro-processors (vision application). A variant circuit (biomimetic) could be used for robotics, neuroscience or medical applications.

[1]  Christophe Loyez,et al.  Experimental investigation of stochastic resonance in a 65nm CMOS artificial neuron , 2017, 2017 International Conference on Noise and Fluctuations (ICNF).

[2]  Frank Moss,et al.  Use of behavioural stochastic resonance by paddle fish for feeding , 1999, Nature.

[3]  C. Morris,et al.  Voltage oscillations in the barnacle giant muscle fiber. , 1981, Biophysical journal.

[4]  Piotr Dudek,et al.  Compact silicon neuron circuit with spiking and bursting behaviour , 2008, Neural Networks.

[5]  Narayan Srinivasa,et al.  Energy-Efficient Neuron, Synapse and STDP Integrated Circuits , 2012, IEEE Transactions on Biomedical Circuits and Systems.

[6]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1990 .

[7]  Chi-Sang Poon,et al.  Neuromorphic Silicon Neurons and Large-Scale Neural Networks: Challenges and Opportunities , 2011, Front. Neurosci..

[8]  Christophe Loyez,et al.  A 4-fJ/Spike Artificial Neuron in 65 nm CMOS Technology , 2017, Front. Neurosci..

[9]  A. Hodgkin,et al.  A quantitative description of membrane current and its application to conduction and excitation in nerve , 1952, The Journal of physiology.

[10]  Carver A. Mead,et al.  Neuromorphic electronic systems , 1990, Proc. IEEE.

[11]  David Attwell,et al.  The Energetics of CNS White Matter , 2012, The Journal of Neuroscience.

[12]  Gert Cauwenberghs,et al.  Reverse engineering the cognitive brain , 2013, Proceedings of the National Academy of Sciences.

[13]  Indranil Saha,et al.  journal homepage: www.elsevier.com/locate/neucom , 2022 .

[14]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[15]  Eugene M. Izhikevich,et al.  Dynamical Systems in Neuroscience: The Geometry of Excitability and Bursting , 2006 .

[16]  Gert Cauwenberghs,et al.  Neuromorphic Silicon Neuron Circuits , 2011, Front. Neurosci.

[17]  M. Mitchell Waldrop,et al.  The chips are down for Moore’s law , 2016, Nature.

[18]  Christian Hauptmann,et al.  Modified Pulse Shapes for Effective Neural Stimulation , 2011, Front. Neuroeng..

[19]  Biswa Sengupta,et al.  The effect of cell size and channel density on neuronal information encoding and energy efficiency , 2013, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[20]  E. Marder,et al.  Central pattern generators and the control of rhythmic movements , 2001, Current Biology.

[21]  Peter Hänggi,et al.  Stochastic resonance in biology. How noise can enhance detection of weak signals and help improve biological information processing. , 2002, Chemphyschem : a European journal of chemical physics and physical chemistry.

[22]  Sylvie Renaud,et al.  A $Q$ -Modification Neuroadaptive Control Architecture for Discrete-Time Systems , 2010 .

[23]  Giacomo Indiveri,et al.  A current-mode conductance-based silicon neuron for address-event neuromorphic systems , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[24]  Olivier Temam,et al.  Hardware spiking neurons design: Analog or digital? , 2012, The 2012 International Joint Conference on Neural Networks (IJCNN).

[25]  Jennifer Hasler,et al.  Finding a roadmap to achieve large neuromorphic hardware systems , 2013, Front. Neurosci..

[26]  Horacio G. Rotstein,et al.  Bursting in Neurons and Small Networks , 2014, Encyclopedia of Computational Neuroscience.