Adaptive Representations for Improving Evolvability, Parameter Control, and Parallelization of Gene Expression Programming

Gene Expression Programming (GEP) is a genetic algorithm that evolves linear chromosomes encoding nonlinear (tree-like) structures. In the original GEP algorithm, the genome size is problem specific and is determined through trial and error. In this work, a method for adaptive control of the genome size is presented. The approach introduces mutation, transposition, and recombination operators that enable a population of heterogeneously structured chromosomes, something the original GEP algorithm does not support. This permits crossbreeding between normally incompatible individuals, speciation within a population, increases the evolvability of the representations, and enhances parallel GEP. To test our approach, an assortment of problems were used, including symbolic regression, classification, and parameter optimization. Our experimental results show that our approach provides a solution for the problem of self-adaptive control of the genome size of GEP's representation.

[1]  Qiwei Liu,et al.  Multi-population Parallel Genetic Algorithm for Economic Statistical Information Mining Based on Gene Expression Programming , 2007, Third International Conference on Natural Computation (ICNC 2007).

[2]  Risto Miikkulainen,et al.  Efficient evolution of neural networks through complexification , 2004 .

[3]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[4]  Erik D. Goodman,et al.  Coarse-grain parallel genetic algorithms: categorization and new approach , 1994, Proceedings of 1994 6th IEEE Symposium on Parallel and Distributed Processing.

[5]  José Ignacio Hidalgo,et al.  Is the island model fault tolerant? , 2007, GECCO '07.

[6]  Kenneth Alan De Jong,et al.  An analysis of the behavior of a class of genetic adaptive systems. , 1975 .

[7]  John Holland,et al.  Adaptation in Natural and Artificial Sys-tems: An Introductory Analysis with Applications to Biology , 1975 .

[8]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[9]  Risto Miikkulainen,et al.  Towards an empirical measure of evolvability , 2005, GECCO '05.

[10]  Candida Ferreira.  Gene expression programming , 2006 .

[11]  Carlos Alberto Conceição António,et al.  Self-adaptation in Genetic Algorithms applied to structural optimization , 2008 .

[12]  D. E. Goldberg,et al.  Genetic Algorithms in Search , 1989 .

[13]  Limin Huo,et al.  Short-term load forecasting based on improved gene expression programming , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[14]  Enrique Alba,et al.  Influence of the Migration Policy in Parallel Distributed GAs with Structured and Panmictic Populations , 2000, Applied Intelligence.

[15]  Henri Luchian,et al.  AdaGEP - An Adaptive Gene Expression Programming Algorithm , 2007, Ninth International Symposium on Symbolic and Numeric Algorithms for Scientific Computing (SYNASC 2007).

[16]  T. Cipra.  Statistical Analysis of Time Series , 2010 .

[17]  Ho-Hyun Park,et al.  Parallel hybrid evolutionary computation: Automatic tuning of parameters for parallel gene expression programming , 2008, Appl. Math. Comput..

[18]  Abdelaziz Bouroumi,et al.  A multipopulation cultural algorithm using fuzzy clustering , 2007, Appl. Soft Comput..

[19]  Nguyen Xuan Hoai,et al.  Estimating the distribution and propagation of genetic programming building blocks through tree compression , 2009, GECCO.

[20]  Martina Gorges-Schleuter,et al.  Explicit Parallelism of Genetic Algorithms through Population Structures , 1990, PPSN.

[21]  Barbara Di Eugenio,et al.  Using Gene Expression Programming to Construct Sentence Ranking Functions for Text Summarization , 2004, COLING.

[22]  Hong Peng,et al.  A Niching Gene Expression Programming Algorithm Based on Parallel Model , 2007, APPT.

[23]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[24]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[25]  Y. Ho,et al.  Simple Explanation of the No-Free-Lunch Theorem and Its Implications , 2002 .

[26]  Cândida Ferreira,et al.  Gene Expression Programming: A New Adaptive Algorithm for Solving Problems , 2001, Complex Syst..

[27]  Yue Jiang,et al.  Parallel Multi-objective Gene Expression Programming Based on Area Penalty , 2008, 2008 International Conference on Computer Science and Information Technology.

[28]  Ting Hu,et al.  Nonsynonymous to Synonymous Substitution Ratio ka/ks: Measurement for Rate of Evolution in Evolutionary Computation , 2008, PPSN.

[29]  Lixin Ding,et al.  Asynchronous Distributed Parallel Gene Expression Programming Based on Estimation of Distribution Algorithm , 2008, 2008 Fourth International Conference on Natural Computation.

[30]  David E. Goldberg,et al.  Efficient Parallel Genetic Algorithms: Theory and Practice , 2000 .

[31]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[32]  Zbigniew Skolicki,et al.  The influence of migration sizes and intervals on island models , 2005, GECCO '05.

[33]  Cândida Ferreira,et al.  Gene Expression Programming: Mathematical Modeling by an Artificial Intelligence (Studies in Computational Intelligence) , 2006 .

[34]  Jiang Wu,et al.  Adaptive Gene Expression Programming Algorithm Based on Cloud Model , 2008, 2008 International Conference on BioMedical Engineering and Informatics.

[35]  Alexandre Hardy,et al.  Generating plants with gene expression programming , 2007, AFRIGRAPH '07.

[36]  Lei Duan,et al.  The Strategies to Improve Performance of Function Mining By Gene Expression Programming 1-Genetic Modifying , Overlapped Gene , Backtracking and Adaptive Mutation , 2006 .

[37]  Heitor Silvério Lopes,et al.  EGIPSYS: AN ENHANCED GENE EXPRESSION PROGRAMMING APPROACH FOR SYMBOLIC REGRESSION PROBLEMS † , 2004 .

[38]  L. Darrell Whitley,et al.  Building Better Test Functions , 1995, ICGA.

[39]  Enrique Alba,et al.  Analyzing synchronous and asynchronous parallel distributed genetic algorithms , 2001, Future Gener. Comput. Syst..

[40]  Jürgen Branke,et al.  Distribution of Evolutionary Algorithms in Heterogeneous Networks , 2004, GECCO.

[41]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[42]  Erick Cantú-Paz,et al.  Efficient and Accurate Parallel Genetic Algorithms , 2000, Genetic Algorithms and Evolutionary Computation.

[43]  Zbigniew Skolicki,et al.  The importance of a two-level perspective for island model design , 2007, 2007 IEEE Congress on Evolutionary Computation.

[44]  Zbigniew Michalewicz,et al.  Parameter Control in Evolutionary Algorithms , 2007, Parameter Setting in Evolutionary Algorithms.

[45]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[46]  H. H. Rosenbrock,et al.  An Automatic Method for Finding the Greatest or Least Value of a Function , 1960, Comput. J..

[47]  Cândida Ferreira,et al.  Gene Expression Programming: Mathematical Modeling by an Artificial Intelligence , 2014, Studies in Computational Intelligence.

[48]  Maolin Tang,et al.  Dynamic optimization of migration topology in internet-based distributed genetic algorithms , 2005, GECCO '05.

[49]  Kejun Zhang,et al.  Prediction of retention times for a large set of pesticides based on improved gene expression programming , 2008, GECCO '08.

[50]  Ju-Jang Lee,et al.  Balancing the selection pressures and migration schemes in parallel genetic algorithms for planning multiple paths , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[51]  Thomas Bäck,et al.  Niching Methods: Speciation Theory Applied for Multi-modal Function Optimization , 2009, Algorithmic Bioprocesses.

[52]  Pascal Bouvry,et al.  Multiobjective classification with moGEP: an application in the network traffic domain , 2009, GECCO.

[53]  Limin Huo,et al.  Short-Term Load Forecasting Based on Improved Gene Expression Programming , 2008, 2008 4th IEEE International Conference on Circuits and Systems for Communications.