PDE-PEDA: A New Pareto-Based Multi-objective Optimization Algorithm

Differential evolution (DE) algorithm puts emphasis particularly on imitating the microscopic behavior of individuals, while estimation of distribution algorithm (EDA) tries to estimate the probabilistic distribution of the entire population. DE and EDA can be extended to multi-objective optimization problems by using a Pareto-based approach, called Pareto DE (PDE) and Pareto EDA (PEDA) respectively. In this study, we describe a novel combination of PDE and PEDA (PDE-PEDA) for multi-objective optimization problems by taking advantage of the global searching ability of PEDA and the local optimizing ability of PDE, which can, effectively, maintain the balance between exploration and exploitation. The basic idea is that the offspring population of PDE-PEDA is composed of two parts, one part of the trial solution generated originates from PDE and the other part is sampled in the search space from the constructed probabilistic distribution model of PEDA. A scaling factor Pr used to balance contributions of PDE and PEDA can be adjusted in an on-line manner using a simulated annealing method. At an early evolutionary stage, a larger Pr should be adopted to ensure PEDA is used more frequently, whereas at later stage, a smaller Pr should be adopted to ensure that offspring is generated more often using PDE. The hybrid algorithm is evaluated on a set of benchmark problems and the experimental results show that PDE-PEDA outperforms the NSGA-II and PDE algorithms.

[1]  Tong Heng Lee,et al.  Evolutionary Algorithms for Multi-Objective Optimization: Performance Assessments and Comparisons , 2004, Artificial Intelligence Review.

[2]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[3]  Bogdan Filipic,et al.  DEMO: Differential Evolution for Multiobjective Optimization , 2005, EMO.

[4]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[5]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[6]  Vadlamani Ravi,et al.  An improved differential evolution method for efficient parameter estimation in biofilter modeling , 2006 .

[7]  Kalyanmoy Deb,et al.  MULTI-OBJECTIVE FUNCTION OPTIMIZATION USING NON-DOMINATED SORTING GENETIC ALGORITHMS , 1994 .

[8]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[9]  N. Madavan Multiobjective optimization using a Pareto differential evolution approach , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[10]  R. Storn,et al.  Differential Evolution - A simple and efficient adaptive scheme for global optimization over continuous spaces , 2004 .

[11]  Larry Bull,et al.  Genetic Programming with a Genetic Algorithm for Feature Construction and Selection , 2005, Genetic Programming and Evolvable Machines.

[12]  C. A. Coello Coello,et al.  A Comprehensive Survey of Evolutionary-Based Multiobjective Optimization Techniques , 1999, Knowledge and Information Systems.

[13]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[14]  Leandro dos Santos Coelho,et al.  Coevolutionary Particle Swarm Optimization Using Gaussian Distribution for Solving Constrained Optimization Problems , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  D. Lowther,et al.  Differential Evolution Strategy for Constrained Global Optimization and Application to Practical Engineering Problems , 2006, IEEE Transactions on Magnetics.

[16]  Xin Yao,et al.  Performance Scaling of Multi-objective Evolutionary Algorithms , 2003, EMO.

[17]  David E. Goldberg,et al.  A Survey of Optimization by Building and Using Probabilistic Models , 2002, Comput. Optim. Appl..

[18]  P. A. Simionescu,et al.  Teeth-Number Synthesis of a Multispeed Planetary Transmission Using an Estimation of Distribution Algorithm , 2006 .

[19]  José Antonio Lozano,et al.  On The Performance Of Estimation Of Distribution Algorithms Applied To Software Testing , 2005, Appl. Artif. Intell..

[20]  Amin Nobakhti,et al.  A simple self-adaptive Differential Evolution algorithm with application on the ALSTOM gasifier , 2008, Appl. Soft Comput..

[21]  Eckart Zitzler,et al.  Evolutionary multi-objective optimization , 2007, Eur. J. Oper. Res..

[22]  Kit Po Wong,et al.  Differential Evolution, an Alternative Approach to Evolutionary Algorithm , 2006, Proceedings of the 13th International Conference on, Intelligent Systems Application to Power Systems.

[23]  Ivan Stojmenovic,et al.  Evolutionary strategy for learning multiple-valued logic functions , 2004, Proceedings. 34th International Symposium on Multiple-Valued Logic.

[24]  Pedro Larrañaga,et al.  Feature Subset Selection by Bayesian network-based optimization , 2000, Artif. Intell..

[25]  Arthur C. Sanderson,et al.  Pareto-based multi-objective differential evolution , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[26]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[27]  C.A. Coello Coello,et al.  MOPSO: a proposal for multiple objective particle swarm optimization , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[28]  A. R. Aoki,et al.  Particle swarm optimization for fuzzy membership functions optimization , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[29]  M.A. El-Sharkawi,et al.  Pareto Multi Objective Optimization , 2005, Proceedings of the 13th International Conference on, Intelligent Systems Application to Power Systems.

[30]  Martin Pelikan,et al.  Edge histogram based sampling with local search for solving permutation problems , 2006, Int. J. Hybrid Intell. Syst..

[31]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[32]  D. Goldberg,et al.  Evolutionary Algorithm Using Marginal Histogram Models in Continuous Domain , 2007 .