Energy-Efficient Single-Flux-Quantum Based Neuromorphic Computing

Recent experimental work has demonstrated nano- textured magnetic Josephson junctions (MJJs) that exhibit tunable spiking behavior with ultra-low training energies in the attojoule range. MJJ devices integrated with standard single-flux-quantum neural systems form a new class of neuromorphic technologies that have spiking energies between attojoules and zeptojoules, operation frequencies up to 100 GHz, and nanoscale plasticity. Here, we present the design of neural cells utilizing MJJs that form the basic elements in multilayer perception and convolutional networks. We present SPICE models, using experimentally derived Verilog A models for MJJs, to assess the performance of these cells in simple neural network structures. Modeling results indicate that the tunable Josephson critical current IC can function as a weight in a neural network. Using SPICE we model a fully connected two layer network with 9 inputs and 3 outputs.

[1]  T. Duzer,et al.  Principles of superconductive devices and circuits, (second ed.) , 1998 .

[2]  Michael Tinkham,et al.  Introduction to Superconductivity , 1975 .

[3]  Michael L. Schneider,et al.  Ultralow power artificial synapses using nanotextured magnetic Josephson junctions , 2018, Science Advances.

[4]  Patrick Crotty,et al.  Phase-flip bifurcation in a coupled Josephson junction neuron system , 2014 .

[5]  Tetsuya Asai,et al.  Pulsed Neural Networks Consisting of Single-Flux-Quantum Spiking Neurons , 2007 .

[6]  Michael L. Schneider,et al.  Stochastic single flux quantum neuromorphic computing using magnetically tunable Josephson junctions , 2016, 2016 IEEE International Conference on Rebooting Computing (ICRC).

[7]  Farnood Merrikh-Bayat,et al.  Training and operation of an integrated neuromorphic network based on metal-oxide memristors , 2014, Nature.

[8]  D. S. Holmes,et al.  Energy-Efficient Superconducting Computing—Power Budgets and Requirements , 2013, IEEE Transactions on Applied Superconductivity.

[9]  Koji Nakajima,et al.  High-speed single flux-quantum up/down counter for neural computation using stochastic logic , 2008 .

[10]  S. Sarwana,et al.  Zero Static Power Dissipation Biasing of RSFQ Circuits , 2011, IEEE Transactions on Applied Superconductivity.

[11]  Y. Yamanashi,et al.  Pseudo Sigmoid Function Generator for a Superconductive Neural Network , 2013, IEEE Transactions on Applied Superconductivity.

[12]  B. Josephson Possible new effects in superconductive tunnelling , 1962 .

[13]  Charu C. Aggarwal,et al.  Neural Networks and Deep Learning , 2018, Springer International Publishing.

[14]  K. Likharev,et al.  Rapid single flux quantum T-flip flop operating up to 770 GHz , 1999, IEEE Transactions on Applied Superconductivity.