Speciation and diversity balance for Genetic Algorithms and application to structural neural network learning

Following analyzing existing challenges in addressing the balance between exploration and exploitation encountered by evolutionary algorithms, this paper develops a Genetic Algorithm with speciation (GASP). It first incorporates a novel encoding scheme and recombination method for a balanced genetic divergence when locating global optima in complex applications, such as structural and dynamic design of an artificial neural network (NN). GASP also addresses the problem of defining a measure and track population diversity whose NN structure is subjected to continual reorganization during the evolution process. Further, a novel approach to the neural network phenotype is developed, which maps it to a distinct genome with a variable length capable of fully representing the multilayer feed-forward NN structure. Using the concept generalized from linguistic complexity, the distance between strings can thus be derived from the single string and substring counts. The GASP is then applied to an NN design problem to forecast the energy consumption of a built environment. With the optimal NN structure, diversity is tracked and improved. The results show that the GASP succeeds in obtaining excellent accuracy and speed.

[1]  Claudio De Stefano,et al.  Where Are the Niches? Dynamic Fitness Sharing , 2007, IEEE Transactions on Evolutionary Computation.

[2]  Deepti Gupta,et al.  An Overview of methods maintaining Diversity in Genetic Algorithms , 2012 .

[3]  Samir W. Mahfoud Crowding and Preselection Revisited , 1992, PPSN.

[4]  Xiaodong Li,et al.  Species based evolutionary algorithms for multimodal optimization: A brief review , 2010, IEEE Congress on Evolutionary Computation.

[5]  Heaton T. Jeff,et al.  Introduction to Neural Networks with Java , 2005 .

[6]  Xiaodong Li,et al.  Efficient differential evolution using speciation for multimodal function optimization , 2005, GECCO '05.

[7]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[8]  Marjan Mernik,et al.  Exploration and exploitation in evolutionary algorithms: A survey , 2013, CSUR.

[9]  Jeff Heaton,et al.  Introduction to Neural Networks for C#, 2nd Edition , 2008 .

[10]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[11]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[12]  Kenneth A. De Jong,et al.  Measurement of Population Diversity , 2001, Artificial Evolution.

[13]  David E. Goldberg,et al.  Probabilistic Crowding: Deterministic Crowding with Probabilistic Replacement , 1999 .

[14]  Ke Tang,et al.  History-Based Topological Speciation for Multimodal Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[15]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[16]  Dario Floreano,et al.  Measures of Diversity for Populations and Distances Between Individuals with Highly Reorganizable Genomes , 2004, Evolutionary Computation.

[17]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[18]  Zhi-hui Zhan,et al.  Evolutionary Neural Network Based Energy Consumption Forecast for Cloud Computing , 2015, 2015 International Conference on Cloud Computing Research and Innovation (ICCCRI).

[19]  Tanya Y. Berger-Wolf,et al.  Balancing the exploration and exploitation in an adaptive diversity guided genetic algorithm , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[20]  Yun Li,et al.  Evolutionary neural network modeling for energy prediction of cloud data centers , 2016 .

[21]  Pedro A. Diaz-Gomez,et al.  Initial Population for Genetic Algorithms: A Metric Approach , 2007, GEM.

[22]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.