A Novel GA-LM Based Hybrid Algorithm

In order to improve the model's learning capability and convergence rate, the GA and ANN are usually combined together. But the current combination ways have the insufficiencies of premature convergence, weak extensive ability etc. To overcome these shortcomings, we propose a new hybrid study algorithm-GALM, which uses the GA and LM in turn to optimize the neural network, we compare the GALM algorithm with other relevant algorithms through experimentation. The results indicate that our algorithm can effectively overcome the problem about falling into the local optimal solutions, and remarkably improved the network learning capability and the convergence rate.

[1]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[2]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[3]  Ananth Ranganathan,et al.  The Levenberg-Marquardt Algorithm , 2004 .

[4]  Bo Yang,et al.  BP neural network optimization based on an improved genetic algorithm , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[5]  Li Lin-lin Applying and Realizing of Genetic Algorithm in Neural Networks Control , 2001 .

[6]  Sam Kwong,et al.  Genetic Algorithms : Concepts and Designs , 1998 .

[7]  Larry J. Eshelman,et al.  Using genetic search to exploit the emergent behavior of neural networks , 1990 .

[8]  Zhang Jun IMMUNE MODULATED SYMBIONTIC EVOLUTION IN NEURAL NETWORK DESIGN , 2000 .

[9]  Kalyanmoy Deb,et al.  A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimisation: NSGA-II , 2000, PPSN.

[10]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[11]  Fabio Stella,et al.  Some numerical aspects of the training problem for feed-forward neural nets , 1997, Neural Networks.

[12]  Pla Artillery,et al.  A Dynamic Genetic Algorithm Based on the Neural Network with Constraints , 2001 .

[13]  P. J. Fleming,et al.  Elitism, Sharing and Ranking Choices in Evolutionary Multi-Criterion Optimisation , 2002 .

[14]  John A. Bullinaria Evolving efficient learning algorithms for binary mappings , 2003, Neural Networks.

[15]  Philippe Dépincé,et al.  Multi-objective genetic algorithms: A way to improve the convergence rate , 2006, Eng. Appl. Artif. Intell..

[16]  Yang Bo,et al.  A Hybrid Algorithm Based on Attention Model , 2005 .

[17]  Chun Lu,et al.  An improved GA and a novel PSO-GA-based hybrid algorithm , 2005, Inf. Process. Lett..