Estimation of distribution algorithms: from available implementations to potential developments

This paper focuses on the analysis of estimation of distribution algorithms (EDAs) software. The important role played by EDAs implementations in the usability and range of applications of these algorithms is considered. A survey of available EDA software is presented, and classifications based on the class of programming languages and design strategies used for their implementations are discussed. The paper also reviews different directions to improve current EDA implementations. A number of lines for further expanding the areas of application for EDAs software are proposed.

[1]  Paul A. Viola,et al.  MIMIC: Finding Optima by Estimating Probability Densities , 1996, NIPS.

[2]  Pedro Larrañaga,et al.  Research topics in discrete estimation of distribution algorithms based on factorizations , 2009, Memetic Comput..

[3]  Jerome DiMarzio.  ANDROID A PROGRAMMERS GUIDE , 2008 .

[4]  Qingfu Zhang,et al.  This article has been accepted for inclusion in a future issue of this journal. Content is final as presented, with the exception of pagination. IEEE TRANSACTIONS ON EVOLUTIONARY COMPUTATION 1 RM-MEDA: A Regularity Model-Based Multiobjective Estimation of , 2022 .

[5]  M. Pelikán,et al.  The Bivariate Marginal Distribution Algorithm , 1999 .

[6]  Jeff Heaton.  Introduction to Linden Scripting Language for Second Life , 2007 .

[7]  D. Goldberg,et al.  BOA: the Bayesian optimization algorithm , 1999 .

[8]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[9]  Peter A. N. Bosman,et al.  On empirical memory design, faster selection of bayesian factorizations and parameter-free gaussian EDAs , 2009, GECCO.

[10]  Concha Bielza,et al.  A review of estimation of distribution algorithms in bioinformatics , 2008, BioData Mining.

[11]  John McCall,et al.  Updating the probability vector using MRF technique for a Univariate EDA , 2004 .

[12]  Hua Yu,et al.  General Toolkit for Discrete Estimation of Distribution Algorithms , 2010, 2010 International Conference of Information Science and Management Engineering.

[13]  Jose Miguel Puerta,et al.  Migration of Probability Models Instead of Individuals: An Alternative When Applying the Island Model to EDAs , 2004, PPSN.

[14]  Martin V. Butz,et al.  Effective and Reliable Online Classification Combining XCS with EDA Mechanisms , 2006, Scalable Optimization via Probabilistic Modeling.

[15]  D. Goldberg,et al.  Population Sizing for Entropy-based Model Building in Genetic Algorithms , 2006 .

[16]  David E. Goldberg,et al.  Multiobjective Estimation of Distribution Algorithms , 2006, Scalable Optimization via Probabilistic Modeling.

[17]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[18]  Fernando G. Lobo,et al.  Extended Compact Genetic Algorithm in C , 1999 .

[19]  Martin Pelikan.  A C++ Implementation of the Bayesian Optimization Algorithm (BOA) with Decision Graphs , 2000 .

[20]  Martin V. Butz,et al.  Automated Global Structure Extraction for Effective Local Building Block Processing in XCS , 2006, Evolutionary Computation.

[21]  Alexander Mendiburu,et al.  Parallel implementation of EDAs based on probabilistic graphical models , 2005, IEEE Transactions on Evolutionary Computation.

[22]  Holly A. Yanco,et al.  The Pyro Toolkit for AI and Robotics , 2006, AI Mag..

[23]  Concha Bielza,et al.  MATEDA: A suite of EDA programs in Matlab , 2009 .

[24]  Jaume Bacardit,et al.  Speeding up the evaluation of evolutionary learning systems using GPGPUs , 2010, GECCO '10.

[25]  Iacopo Carreras,et al.  Self-evolving applications over opportunistic communication systems , 2010, 2010 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops).

[26]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[27]  Bartek Wilczynski,et al.  BNFinder: exact and efficient method for learning Bayesian networks , 2008, Bioinform..

[28]  David E. Goldberg,et al.  Efficiency Enhancement of Estimation of Distribution Algorithms , 2006, Scalable Optimization via Probabilistic Modeling.

[29]  Alexander Mendiburu,et al.  Porting Estimation of Distribution Algorithms to the Cell Broadband Engine , 2010, Parallel Comput..

[30]  Martin Pelikan,et al.  Design of Parallel Estimation of Distribution Algorithms , 2006, Scalable Optimization via Probabilistic Modeling.

[31]  Siddhartha Shakya,et al.  An EDA based on local markov property and gibbs sampling , 2008, GECCO '08.

[32]  El-Ghazali Talbi,et al.  ParadisEO: A Framework for the Reusable Design of Parallel and Distributed Metaheuristics , 2004, J. Heuristics.

[33]  Alexander Mendiburu,et al.  Parallel EDAs to create multivariate calibration models for quantitative chemical applications , 2006, J. Parallel Distributed Comput..

[34]  Pedro Larrañaga,et al.  Mathematical modelling of UMDAc algorithm with tournament selection. Behaviour on linear and quadratic functions , 2002, Int. J. Approx. Reason..

[35]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[36]  Michael J. Crawley,et al.  The R book , 2022 .

[37]  Shumeet Baluja,et al.  Using Optimal Dependency-Trees for Combinational Optimization , 1997, ICML.

[38]  Hans Petter Langtangen,et al.  Python scripting for computational science , 2004 .

[39]  J. A. Lozano,et al.  Towards a New Evolutionary Computation: Advances on Estimation of Distribution Algorithms (Studies in Fuzziness and Soft Computing) , 2006 .

[40]  Petros Koumoutsakos,et al.  A Mixed Bayesian Optimization Algorithm with Variance Adaptation , 2004, PPSN.

[41]  Siddhartha Shakya,et al.  DEUM : a framework for an estimation of distribution algorithm based on Markov random fields , 2006 .

[42]  Jiri Ocenasek.  Entropy-based Convergence Measurement in Discrete Estimation of Distribution Algorithms , 2006, Towards a New Evolutionary Computation.

[43]  Qingfu Zhang,et al.  An evolutionary algorithm with guided mutation for the maximum clique problem , 2005, IEEE Transactions on Evolutionary Computation.

[44]  Concha Bielza,et al.  Mining probabilistic models learned by EDAs in the optimization of multi-objective problems , 2009, GECCO.

[45]  Enrique Alba,et al.  Algorithm::Evolutionary, a flexible Perl module for evolutionary computation , 2010, Soft Comput..

[46]  José Antonio Lozano Alonso,et al.  A quantitative analysis of estimation of distribution algorithms based on Bayesian networks , 2009 .

[47]  David E. Goldberg,et al.  The compact genetic algorithm , 1999, IEEE Trans. Evol. Comput..

[48]  El-Ghazali Talbi,et al.  Metaheuristics - From Design to Implementation , 2009 .

[49]  Kumara Sastry,et al.  Extended Compact Genetic Algorithm in Matlab , 2007 .

[50]  Petr Pos ´ ik.  Preventing Premature Convergence in a Simple EDA Via Global Step Size Setting , 2008 .

[51]  Siddhartha K Shakya.  Markov Random Field Modelling of Genetic Algorithms Evaluation of Research , 2004 .

[52]  Roberto Santana.  A Markov Network Based Factorized Distribution Algorithm for Optimization , 2003, ECML.

[53]  David E. Goldberg,et al.  Bayesian Optimization Algorithm, Population Sizing, and Time to Convergence , 2000, GECCO.

[54]  A. E. Eiben,et al.  Parameter calibration using meta-algorithms , 2007, 2007 IEEE Congress on Evolutionary Computation.

[55]  Jirí Jaros,et al.  Parallel Genetic Algorithm on the CUDA Architecture , 2010, EvoApplications.

[56]  Nicolas Lachiche,et al.  Coarse grain parallelization of evolutionary algorithms on GPGPU cards with EASEA , 2009, GECCO.

[57]  Jiri Ocenasek,et al.  Estimation of Distribution Algorithm for Mixed Continuous-Discrete Optimization , 2002 .

[58]  Martin Pelikan,et al.  Analyzing probabilistic models in hierarchical BOA on traps and spin glasses , 2007, GECCO '07.

[59]  Almero Gouws.  A Python implementation of graphical models , 2010 .

[60]  David E. Goldberg,et al.  Bayesian Optimization Algorithm: From Single Level to Hierarchy , 2002 .

[61]  Simon Cozens,et al.  Professional Perl Programming , 2001 .

[62]  Cesare Furlanello,et al.  mlpy: Machine Learning Python , 2012, ArXiv.

[63]  Martin Pelikan,et al.  Scalable Optimization via Probabilistic Modeling: From Algorithms to Applications (Studies in Computational Intelligence) , 2006 .

[64]  Yong Wang,et al.  A regularity model-based multiobjective estimation of distribution algorithm with reducing redundant cluster operator , 2012, Appl. Soft Comput..

[65]  G. Harik.  Linkage Learning via Probabilistic Modeling in the ECGA , 1999 .

[66]  Concha Bielza,et al.  Mateda-2.0: A MATLAB package for the implementation and analysis of estimation of distribution algorithms , 2010 .

[67]  Martin Pelikan.  A Simple Implementation of the Bayesian Optimization Algorithm (BOA) in C++ (version 1.0) , 1999 .

[68]  Pedro Larrañaga,et al.  Parallel Estimation of Distribution Algorithms , 2002, Estimation of Distribution Algorithms.

[69]  Mark Wallace,et al.  Second Life: The Official Guide , 2006 .

[70]  Matteo Matteucci,et al.  Evoptool: An extensible toolkit for evolutionary optimization algorithms comparison , 2010, IEEE Congress on Evolutionary Computation.

[71]  David E. Goldberg,et al.  Population sizing for entropy-based model building in discrete estimation of distribution algorithms , 2007, GECCO '07.

[72]  S. Baluja,et al.  Using Optimal Dependency-Trees for Combinatorial Optimization: Learning the Structure of the Search Space , 1997 .

[73]  Pedro Larrañaga,et al.  Towards a New Evolutionary Computation - Advances in the Estimation of Distribution Algorithms , 2006, Towards a New Evolutionary Computation.

[74]  Dirk Thierens,et al.  Multi-objective optimization with diversity preserving mixture-based iterated density estimation evolutionary algorithms , 2002, Int. J. Approx. Reason..

[75]  E. Talbi,et al.  A Unified Model for Evolutionary Multiobjective Optimization and its Implementation in a General Purpose Software Framework: ParadisEO-MOEO , 2009, 0904.2987.

[76]  Martin Pelikan,et al.  Bayesian Optimization Algorithm , 2005 .

[77]  Carlos M. Oppus,et al.  A mobile disaster management system using the android technology , 2010 .

[78]  David E. Goldberg,et al.  Using Previous Models to Bias Structural Learning in the Hierarchical BOA , 2012, Evolutionary Computation.

[79]  Shumeet Baluja,et al.  Fast Probabilistic Modeling for Combinatorial Optimization , 1998, AAAI/IAAI.