Gradient Type Learning Rules for Neural Networks Based on Watcher-Environment Model

Moderatism, which is a learning rule for ANNs, is based on the principle that individual neurons and neural nets as a whole try to sustain a “moderate” level in their input and output signals. In this way, neural network receives feedback signal from the outside environment, and the principle of connectionism is preserved. In this paper, a potential Moderatism-based local, gradient learning rule based on a watcher-environment model is proposed.

[1]  M.T. Islam,et al.  New gradient learning rules for artificial neural nets based on moderatism and feedback model , 2003, Proceedings of the 3rd IEEE International Symposium on Signal Processing and Information Technology (IEEE Cat. No.03EX795).

[2]  Yoichi Okabe Moderationism : Feedback Learning of Neural Networks , 1988 .

[3]  Yoichi Okabe,et al.  Pattern learning by multilayer neural networks trained by a moderatism-based new algorithm , 2002, Proceedings of the 9th International Conference on Neural Information Processing, 2002. ICONIP '02..

[4]  Yoichi Okabe,et al.  Learning algorithm based on moderationism for multi-layer neural networks , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[5]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .