论文信息 - SHAKE-A multi-criterion optimization scheme for neural network training

SHAKE-A multi-criterion optimization scheme for neural network training

This paper presents a new approach for the task of feedforward type neural network training process based on a multi-criterion efficiency measurement. Here we propose a novel hybrid neuro-genetic algorithm that tries to optimize a three dimension criterion vector composed by speed, accuracy, and percentage of convergence, which measures the overall stability of the training algorithm to converge to good minimal. The proposed approach takes the speed advantage of the conventional algorithms as well as the accuracy and percentage of convergence advantages of the genetic algorithms. The empirical results obtained up to now shows the strength and potentiality of the method.

Silvio S. Pacheco | Antonio G. Thomé

[1] Geoffrey E. Hinton,et al. Learning internal representations by error propagation , 1986 .

[2] Lawrence Davis,et al. Training Feedforward Neural Networks Using Genetic Algorithms , 1989, IJCAI.

[3] Roberto Battiti,et al. Accelerated Backpropagation Learning: Two Optimization Methods , 1989, Complex Syst..

[4] David E. Goldberg,et al. Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[5] A.G. Thome,et al. Dynamic adaptation of the error surface for the acceleration of the training of neural networks , 1994, Proceedings of 1994 IEEE International Conference on Neural Networks (ICNN'94).

[6] Robert A. Jacobs,et al. Increased rates of convergence through learning rate adaptation , 1987, Neural Networks.

[7] Lawrence. Davis,et al. Handbook Of Genetic Algorithms , 1990 .

[8] Scott E. Fahlman,et al. An empirical study of learning speed in back-propagation networks , 1988 .

[9] Hiroaki Kitano,et al. Empirical Studies on the Speed of Convergence of Neural Network Training Using Genetic Algorithms , 1990, AAAI.

[10] John H. Holland,et al. Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .