论文信息 - Utilization of hierarchical structure stochastic automata for the back propagation method with momentum

Utilization of hierarchical structure stochastic automata for the back propagation method with momentum

Backpropagation (BP) is one of the most popular learning algorithms for multilayer networks, but it has limitations. Various modified BP methods have therefore been proposed. The BP method with momentum may be one of the most popular such modified algorithms. It has been reported that the BP method with momentum has been applied quite successfully to many practical problems. However, despite its effectiveness, this method involves the following serious problem: "Its learning performance depends heavily upon the selection of the value of momentum factor." Unfortunately, it seems that there has not so far been proposed an intelligent algorithm for determining an appropriate value of the momentum factor. In this paper, we suggest that hierarchical structure stochastic automata are quite helpful for finding an appropriate value of the momentum factor of the BP method with momentum. Several computer simulation results confirm our idea.

H. Handa | N. Baba

[1] N. Baba,et al. A user friendly decision support system for dealing stocks using neural network , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[2] Robert A. Jacobs,et al. Increased rates of convergence through learning rate adaptation , 1987, Neural Networks.

[3] M. Thathachar,et al. A Hierarchical System of Learning Automata , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[4] K. R. Ramakrishnan,et al. Hierarchical Systems and Cooperative Games of Learning Automata , 1982 .

[5] Yoshio Mogami,et al. A hybrid algorithm for finding the global minimum of error function of neural networks and its applications , 1994, Neural Networks.

[6] Norio Baba,et al. A new approach for finding the global minimum of error function of neural networks , 1989, Neural Networks.

[7] N. Baba. New Topics in Learning Automata Theory and Applications , 1985 .