A Power Efficient Artificial Neuron Using Superconducting Nanowires

With the rising societal demand for more information-processing capacity with lower power consumption, alternative architectures inspired by the parallelism and robustness of the human brain have recently emerged as possible solutions. In particular, spiking neural networks (SNNs) offer a bio-realistic approach, relying on pulses, analogous to action potentials, as units of information. While software encoded networks provide flexibility and precision, they are often computationally expensive. As a result, hardware SNNs based on the spiking dynamics of a device or circuit represent an increasingly appealing direction. Here, we propose to use superconducting nanowires as a platform for the development of an artificial neuron. Building on an architecture first proposed for Josephson junctions, we rely on the intrinsic non-linearity of two coupled nanowires to generate spiking behavior, and use electrothermal circuit simulations to demonstrate that the nanowire neuron reproduces multiple characteristics of biological neurons. Furthermore, by harnessing the non-linearity of the superconducting nanowire’s inductance, we develop a design for a variable inductive synapse capable of both excitatory and inhibitory control. We demonstrate that this synapse design supports direct fan-out, a feature that has been difficult to achieve in other superconducting architectures, and that the nanowire neuron’s nominal energy performance is competitive with that of current technologies.

[1]  A. Thomas,et al.  Memristor-based neural networks , 2013 .

[2]  K. Berggren,et al.  Bridging the Gap Between Nanowires and Josephson Junctions: A Superconducting Device Based on Controlled Fluxon Transfer. , 2018, Physical review applied.

[3]  K. Berggren,et al.  Single-photon imager based on a superconducting nanowire delay line , 2017, Nature Photonics.

[4]  B. O. Alving Spontaneous Activity in Isolated Somata of Aplysia Pacemaker Neurons , 1968, The Journal of general physiology.

[5]  Eric A. Dauler,et al.  Electrothermal feedback in superconducting nanowire single-photon detectors , 2008, 0812.0290.

[6]  S. K. Dana,et al.  Spiking and Bursting in Josephson Junction , 2006, IEEE Transactions on Circuits and Systems II: Express Briefs.

[7]  Karl K. Berggren,et al.  Frequency Pulling and Mixing of Relaxation Oscillations in Superconducting Nanowires , 2017, Physical Review Applied.

[8]  Christophe Loyez,et al.  A 4-fJ/Spike Artificial Neuron in 65 nm CMOS Technology , 2017, Front. Neurosci..

[9]  Yanzhi Wang,et al.  Adiabatic Quantum-Flux-Parametron: Towards Building Extremely Energy-Efficient Circuits and Systems , 2019, Scientific Reports.

[10]  Jeffrey M. Shainline,et al.  Fluxonic Processing of Photonic Synapse Events , 2019, IEEE Journal of Selected Topics in Quantum Electronics.

[11]  Karl K Berggren,et al.  A superconducting-nanowire three-terminal electrothermal device. , 2014, Nano letters.

[12]  R. Bertram,et al.  Topological and phenomenological classification of bursting oscillations. , 1995, Bulletin of mathematical biology.

[13]  O A Mukhanov,et al.  Energy-Efficient Single Flux Quantum Technology , 2011, IEEE Transactions on Applied Superconductivity.

[14]  Massoud Pedram,et al.  Superconducting Magnetic Field Programmable Gate Array , 2018, IEEE Transactions on Applied Superconductivity.

[15]  Andrew S. Cassidy,et al.  A million spiking-neuron integrated circuit with a scalable communication network and interface , 2014, Science.

[16]  Naoki Takeuchi,et al.  An adiabatic quantum flux parametron as an ultra-low-power logic device , 2013 .

[17]  Sae Woo Nam,et al.  Circuit designs for superconducting optoelectronic loop neurons , 2018, Journal of Applied Physics.

[18]  Steve B. Furber,et al.  Neural Systems Engineering , 2008, Computational Intelligence: A Compendium.

[19]  Karl K. Berggren,et al.  A compact superconducting nanowire memory element operated by nanowire cryotrons , 2017, 1711.08290.

[20]  Manish Kumar Large-scale neuromorphic computing systems , 2016 .

[21]  B. Bean The action potential in mammalian central neurons , 2007, Nature Reviews Neuroscience.

[22]  Karl K. Berggren,et al.  A superconducting nanowire can be modeled by using SPICE , 2018 .

[23]  Damien Querlioz,et al.  Simulation of a memristor-based spiking neural network immune to device variations , 2011, The 2011 International Joint Conference on Neural Networks.

[24]  John Rinzel,et al.  Bursting oscillations in an excitable membrane model , 1985 .

[25]  Faraz Najafi,et al.  Single-photon detectors based on ultranarrow superconducting nanowires. , 2010, Nano letters.

[26]  Luigi Frunzio,et al.  Tunable superconducting nanoinductors , 2010, Nanotechnology.

[27]  Yan Zhou,et al.  Magnetic skyrmion-based artificial neuron device , 2017, Nanotechnology.

[28]  Massoud Pedram,et al.  Logic Optimization, Complex Cell Design, and Retiming of Single Flux Quantum Circuits , 2018, IEEE Transactions on Applied Superconductivity.

[29]  Di Zhu,et al.  A distributed electrical model for superconducting nanowire single photon detectors , 2018, Applied Physics Letters.

[30]  O. Okunev,et al.  Picosecond superconducting single-photon optical detector , 2001 .

[31]  Michael L. Schneider,et al.  Ultralow power artificial synapses using nanotextured magnetic Josephson junctions , 2018, Science Advances.

[32]  Sae Woo Nam,et al.  A kinetic-inductance-based superconducting memory element with shunting and sub-nanosecond write times , 2018, Superconductor science & technology.

[33]  Eugene M. Izhikevich,et al.  Which model to use for cortical spiking neurons? , 2004, IEEE Transactions on Neural Networks.

[34]  Luping Shi,et al.  Memristor devices for neural networks , 2018, Journal of Physics D: Applied Physics.

[35]  Patrick Crotty,et al.  Josephson junction simulation of neurons. , 2010, Physical review. E, Statistical, nonlinear, and soft matter physics.

[36]  R. Wurtz,et al.  Comparison of cortico-cortical and cortico-collicular signals for the generation of saccadic eye movements. , 2002, Journal of neurophysiology.

[37]  N. Kopell,et al.  Parabolic bursting revisited , 1996, Journal of mathematical biology.

[38]  V. Semenov,et al.  RSFQ logic/memory family: a new Josephson-junction technology for sub-terahertz-clock-frequency digital systems , 1991, IEEE Transactions on Applied Superconductivity.

[39]  O. Mukhanov,et al.  Ultimate performance of the RSFQ logic circuits , 1987 .

[40]  Karl K. Berggren,et al.  A nanocryotron comparator can connect single-flux-quantum circuits to conventional electronics , 2016, 1610.09349.

[41]  Julie Grollier,et al.  Chaos and Relaxation Oscillations in Spin-Torque Windmill Spiking Oscillators , 2018, Physical Review Applied.

[42]  Huxley Equations Hodgkin-huxley Equations , .

[43]  Eric A. Dauler,et al.  Kinetic-inductance-limited reset time of superconducting nanowire photon counters , 2005, physics/0510238.