FPGA Based Hardware Implementation of Simple Dynamic Binary Neural Networks

This paper studies hardware implementation of a simple dynamic binary neural network that can generate various periodic orbits. The network is characterized by local binary connection and signum activation function. First, using a simple feature quantity, stability of a target periodic orbit is considered. Second, using a FPGA board, a test circuit is implemented. The signum activation function is realized by a majority decision circuit and the binary connection is realized by switches and inverters. The circuit operation is confirmed experimentally.

[1]  Leon O. Chua.  A Nonlinear Dynamics Perspective Of Wolfram'S New Kind Of Science , 2013 .

[2]  Toshimichi Saito,et al.  Stability of Periodic Orbits and Fault Tolerance in Dynamic Binary Neural Networks , 2017, ICONIP.

[3]  Toshimichi Saito,et al.  Stabilization of desired periodic orbits in dynamic binary neural networks , 2017, Neurocomputing.

[4]  Shigetoshi Nara,et al.  Completely reproducible description of digital sound data with cellular automata , 2002 .

[5]  Vincent Gripon,et al.  Storing Sequences in Binary Tournament-Based Neural Networks , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Toshimichi Saito,et al.  Simple Feature Quantities for Analysis of Periodic Orbits in Dynamic Binary Neural Networks , 2018, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[7]  Anthony N. Michel,et al.  A training algorithm for binary feedforward neural networks , 1992, IEEE Trans. Neural Networks.

[8]  M. Lavanya,et al.  Design and Analysis of Linear Feedback Shift Register Based on Various Tap Connections , 2012 .

[9]  Bimal K. Bose,et al.  Neural Network Applications in Power Electronics and Motor Drives—An Introduction and Perspective , 2007, IEEE Transactions on Industrial Electronics.

[10]  Guanrong Chen,et al.  Universal Perceptron and DNA-Like Learning Algorithm for Binary Neural Networks: Non-LSBF Implementation , 2009, IEEE Transactions on Neural Networks.

[11]  Toshimichi Saito,et al.  An associative memory including time-variant self-feedback , 1994, Neural Networks.

[12]  Toshimichi Saito,et al.  Analysis and Implementation of Simple Dynamic Binary Neural Networks , 2018, 2018 International Joint Conference on Neural Networks (IJCNN).