Inductive linkage identification on building blocks of different sizes and types

The goal of linkage identification is to obtain the dependencies among decision variables. Such information or knowledge can be applied to design crossover operators and/or the encoding schemes in genetic and evolutionary methods. Thus, promising sub-solutions to the problem will be disrupted less likely, and successful convergence may be achieved more likely. To obtain linkage information, a linkage identification technique, called Inductive Linkage Identification (ILI), was proposed recently. ILI was established upon the mechanism of perturbation and the idea of decision tree learning. By constructing a decision tree according to decision variables and fitness difference values, the interdependent variables will be determined by the adopted decision tree learning algorithm. In this article, we aim to acquire a better understanding on the characteristics of ILI, especially its behaviour under problems composed of different-sized and different-type building blocks (BBs) which are not overlapped. Experiments showed that ILI can efficiently handle BBs of different sizes and is insensitive to BB types. Our experimental observations indicate the flexibility and the applicability of ILI on various elementary BB types that are commonly adopted in related experiments.

[1]  H. Kargupta Search, polynomial complexity, and the fast messy genetic algorithm , 1996 .

[2]  Chung-Yao Chuang,et al.  Likage identification by perturbation and decision tree induction , 2007, 2007 IEEE Congress on Evolutionary Computation.

[3]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[4]  Heinz Mühlenbein,et al.  The Estimation of Distributions and the Minimum Relative Entropy Principle , 2005, Evol. Comput..

[5]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[6]  Paul A. Viola,et al.  MIMIC: Finding Optima by Estimating Probability Densities , 1996, NIPS.

[7]  Ying-ping Chen,et al.  On the detection of general problem structures by using inductive linkage identification , 2009, GECCO '09.

[8]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[9]  Zengqi Sun,et al.  Detecting the epistatic structure of generalized embedded landscape , 2007, Genetic Programming and Evolvable Machines.

[10]  Hillol Kargupta,et al.  The Gene Expression Messy Genetic Algorithm , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[11]  Zengqi Sun,et al.  Extended probe method for linkage discovery over high-cardinality alphabets , 2007, GECCO '07.

[12]  Chuan-Kang Ting,et al.  Linkage Discovery through Data Mining [Research Frontier] , 2010, IEEE Computational Intelligence Magazine.

[13]  Kesheng Wang,et al.  Application of genetic algorithms to robot kinematics calibration , 2009, Int. J. Syst. Sci..

[14]  G. Harik Linkage Learning via Probabilistic Modeling in the ECGA , 1999 .

[15]  Yaochu Jin,et al.  A comprehensive survey of fitness approximation in evolutionary computation , 2005, Soft Comput..

[16]  Kalyanmoy Deb,et al.  Messy Genetic Algorithms: Motivation, Analysis, and First Results , 1989, Complex Syst..

[17]  Alden H. Wright,et al.  Efficient Linkage Discovery by Limited Probing , 2003, Evolutionary Computation.

[18]  David E. Goldberg,et al.  The compact genetic algorithm , 1999, IEEE Trans. Evol. Comput..

[19]  S. Li,et al.  Spare parts allocation by improved genetic algorithm and Monte Carlo simulation , 2012, Int. J. Syst. Sci..

[20]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[21]  M. Pelikán,et al.  The Bivariate Marginal Distribution Algorithm , 1999 .

[22]  David E. Goldberg,et al.  The Design of Innovation: Lessons from and for Competent Genetic Algorithms , 2002 .

[23]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[24]  Masaharu Munetomo,et al.  Identifying Linkage Groups by Nonlinearity/Non-monotonicity Detection , 1999 .

[25]  D. Goldberg,et al.  A Survey of Linkage Learning Techniques in Genetic and Evolutionary Algorithms , 2007 .

[26]  Chung-Yao Chuang,et al.  Linkage Identification by Perturbation and Decision Tree Induction , 2007 .

[27]  Malay Kumar Kundu,et al.  Self-crossover-a new genetic operator and its application to feature selection , 1998, Int. J. Syst. Sci..

[28]  Masaharu Munetomo,et al.  Linkage Identification by Fitness Difference Clustering , 2006, Evolutionary Computation.

[29]  Bernhard Sendhoff,et al.  Generalizing Surrogate-Assisted Evolutionary Computation , 2010, IEEE Transactions on Evolutionary Computation.

[30]  Daniel T. Gladwin,et al.  Internal combustion engine control for series hybrid electric vehicles by parallel and distributed genetic programming/multiobjective genetic algorithms , 2011, Int. J. Syst. Sci..

[31]  Pedro Larrañaga,et al.  Estimation of Distribution Algorithms , 2002, Genetic Algorithms and Evolutionary Computation.

[32]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[33]  Shumeet Baluja,et al.  Using Optimal Dependency-Trees for Combinational Optimization , 1997, ICML.

[34]  William Rand,et al.  CrossNet: a framework for crossover with network-based chromosomal representations , 2008, GECCO '08.

[35]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[36]  D. Goldberg,et al.  Don't evaluate, inherit , 2001 .

[37]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[38]  Dirk Thierens,et al.  On the complexity of hierarchical problem solving , 2005, GECCO '05.

[39]  Yew-Soon Ong,et al.  Classifier-assisted constrained evolutionary optimization for automated geometry selection of orthodontic retraction spring , 2010, IEEE Congress on Evolutionary Computation.

[40]  A. J. Dentsoras,et al.  Integration of genetic optimisation and neuro-fuzzy approximation in parametric engineering design , 2009, Int. J. Syst. Sci..

[41]  Ying-ping Chen,et al.  Detecting General Problem Structures with Inductive Linkage Identification , 2010, 2010 International Conference on Technologies and Applications of Artificial Intelligence.

[42]  G. Harik Learning gene linkage to efficiently solve problems of bounded difficulty using genetic algorithms , 1997 .

[43]  Heinz Mühlenbein,et al.  FDA -A Scalable Evolutionary Algorithm for the Optimization of Additively Decomposed Functions , 1999, Evolutionary Computation.