A new digital pulse-mode neuron with adjustable activation function

This paper describes a new pulse-mode digital neuron which is based on voting neuron. The signal level of the neuron is represented by frequency of pulse signals. The proposed neuron provides adjustable nonlinear function, which resembles the sigmoid function. The proposed neuron and experimental multilayer neural network (MNN) are implemented on field programmable gate array (FPGA) and various experiments are conducted to test the performance of the proposed system. The experimental results show that the proposed neuron has rigid adjustable nonlinear function.

[1]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[2]  L. M. Reyneri.  A performance analysis of pulse stream neural and fuzzy computing systems , 1995 .

[3]  Martin Schäfer,et al.  An accelerator for neural networks with pulse-coded model neurons , 1999, IEEE Trans. Neural Networks.

[4]  Hiroomi Hikawa.  Frequency-based multilayer neural network with on-chip learning and enhanced neuron characteristics , 1999, IEEE Trans. Neural Networks.

[5]  Dziem D. Nguyen,et al.  STOCHASTIC PROCESSING IN A NEURAL NETWORK APPLICATION. , 1987 .

[6]  Hiroomi Hikawa.  Learning performance of frequency-modulation digital neural network with on-chip learning , 1998, 1998 IEEE International Joint Conference on Neural Networks Proceedings. IEEE World Congress on Computational Intelligence (Cat. No.98CH36227).

[7]  Frank C. Hoppensteadt,et al.  Pattern recognition via synchronization in phase-locked loop neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[8]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[9]  T. Ikenaga,et al.  A DTCNN universal machine based on highly parallel 2-D cellular automata CAM/sup 2/ , 1998 .

[10]  Michael A. Shanblatt,et al.  Architecture and statistical model of a pulse-mode digital multilayer neural network , 1995, IEEE Trans. Neural Networks.

[11]  Sun-Yuan Kung,et al.  Digital neural networks , 1993, Prentice Hall Information and System Sciences Series.

[12]  Yutaka Maeda,et al.  FPGA implementation of a pulse density neural network using simultaneous perturbation , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[13]  Michael A. Shanblatt,et al.  Random noise effects in pulse-mode digital multilayer neural networks , 1995, IEEE Trans. Neural Networks.

[14]  Yuzo Hirai,et al.  Hardware implementation of a PCA learning network by an asynchronous PDM digital circuit , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.