Simple Feature Quantities for Learning of Dynamic Binary Neural Networks

This paper presents simple feature quantities for learning of dynamic binary neural networks. The teacher signal is a binary periodic orbit corresponding to control signal of switching circuits. The feature quantities characterize generation of spurious memories and stability of the teacher signal. We present a simple greedy search based algorithm where the two feature quantities are used as cost functions. Performing basic numerical experiments, the algorithm efficiency is confirmed.

[1]  Shigetoshi Nara,et al.  Completely reproducible description of digital sound data with cellular automata , 2002 .

[2]  Bimal K. Bose,et al.  Neural Network Applications in Power Electronics and Motor Drives—An Introduction and Perspective , 2007, IEEE Transactions on Industrial Electronics.

[3]  Toshimichi Saito,et al.  An associative memory including time-variant self-feedback , 1994, Neural Networks.

[4]  Johann W. Kolar,et al.  A Review of Control and Modulation Methods for Matrix Converters , 2012, IEEE Transactions on Industrial Electronics.

[5]  Toshimichi Saito,et al.  Learning of Simple Dynamic Binary Neural Networks , 2013, IEICE Transactions on Fundamentals of Electronics Communications and Computer Sciences.

[6]  Guanrong Chen,et al.  Universal Perceptron and DNA-Like Learning Algorithm for Binary Neural Networks: Non-LSBF Implementation , 2009, IEEE Transactions on Neural Networks.

[7]  Hiroyuki Torikai,et al.  Theoretical and Heuristic Synthesis of Digital Spiking Neurons for Spike-Pattern-Division Multiplexing , 2010, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[8]  Toshimichi Saito,et al.  A Deep Dynamic Binary Neural Network and Its Application to Matrix Converters , 2014, ICANN.

[9]  Toshimichi Saito,et al.  Sparsification and Stability of Simple Dynamic Binary Neural Networks , 2014, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[10]  Anthony N. Michel,et al.  A training algorithm for binary feedforward neural networks , 1992, IEEE Trans. Neural Networks.

[11]  Toshimichi Saito,et al.  A Cascade System of Simple Dynamic Binary Neural Networks and Its Sparsification , 2014, ICONIP.

[12]  Paul L. Rosin.  Training Cellular Automata for Image Processing , 2006, IEEE Trans. Image Process..

[13]  Toshimichi Saito,et al.  Application of the Dynamic Binary Neural Network to Switching Circuits , 2013, ICONIP.