Empirical and analytical study of many-objective optimization problems: analysing distribution of nondominated solutions and population size for scalability of randomized heuristics

Nature inspired randomized heuristics have been used successfully for single-objective and multi-objective optimization problems. However, with increasing number of objectives, what are called as “dominance resistant solutions” present a challenge to heuristics because they make it harder to locate and converge to the Pareto-optimal front. In the present work, the scalability of population-based heuristics for many-objective problems is studied using techniques from probability theory. Work in this domain tends to be more problem-specific and is largely empirical. Here a more general theoretical framework to study the problem arising from escalation of objectives is developed. This framework allows application of probability concentration inequalities to complicated multiobjective optimization heuristics. It also helps isolate the effects of escalation of objective space dimension from those of problem structure and of design space dimension. It opens up the possibility of combining the framework with more problem-specific models and with empirical work, to tune algorithms and to make problems amenable to heuristic search.

[1]  Klaus Weihrauch,et al.  A Tutorial on Computable Analysis , 2008 .

[2]  David E. Goldberg,et al.  Decomposable Problems, Niching, and Scalability of Multiobjective Estimation of Distribution Algorithms , 2005, ArXiv.

[3]  Jianjun Hu,et al.  HEMO: A Sustainable Multi-objective Evolutionary Optimization Framework , 2003, GECCO.

[4]  Tomoyuki Hiroyasu,et al.  SPEA2+: Improving the Performance of the Strength Pareto Evolutionary Algorithm 2 , 2004, PPSN.

[5]  Kiyoshi Tanaka,et al.  Working principles, behavior, and performance of MOEAs on MNK-landscapes , 2007, Eur. J. Oper. Res..

[6]  Bharat M. Deshpande,et al.  Scalability of Population-Based Search Heuristics for Many-Objective Optimization , 2013, EvoApplications.

[7]  Peter J. Fleming,et al.  On the Evolutionary Optimization of Many Conflicting Objectives , 2007, IEEE Transactions on Evolutionary Computation.

[8]  H. Kita,et al.  Failure of Pareto-based MOEAs: does non-dominated really mean near to optimal? , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[9]  Carlos A. Coello Coello,et al.  Using gradient-based information to deal with scalability in multi-objective evolutionary algorithms , 2009, 2009 IEEE Congress on Evolutionary Computation.

[10]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[11]  Peter J. Fleming,et al.  Evolutionary many-objective optimisation: an exploratory analysis , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[12]  Kalyanmoy Deb,et al.  Multi-objective optimization using evolutionary algorithms , 2001, Wiley-Interscience series in systems and optimization.

[13]  Lenore Blum,et al.  Complexity and Real Computation , 1997, Springer New York.

[14]  L. Jain,et al.  Evolutionary multiobjective optimization : theoretical advances and applications , 2005 .

[15]  Lam Thu Bui The role of communication messages andexplicit niching in distributed evolutionarymulti-objective optimization , 2007 .

[16]  A. Hernández Aguirre,et al.  IMPROVED MAXIMIN SELECTION FOR WELL SPREAD PARETO FRONTS , 2007 .

[17]  Dirk Thierens,et al.  The balance between proximity and diversity in multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[18]  Martin J. Oates,et al.  The Pareto Envelope-Based Selection Algorithm for Multi-objective Optimisation , 2000, PPSN.

[19]  Kiyoshi Tanaka,et al.  Effects of elitism and population climbing on multiobjective MNK-landscapes , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[20]  María Cristina Riff,et al.  Towards an immune system that solves CSP , 2007, 2007 IEEE Congress on Evolutionary Computation.

[21]  Christian Haubelt,et al.  Solving Hierarchical Optimization Problems Using MOEAs , 2003, EMO.

[22]  Hernán E. Aguirre,et al.  Preliminary Study on the Performance of Multiobjective Evolutionary Algorithms with MNK-Landscapes , 2004 .

[23]  Marco Laumanns,et al.  Scalable Test Problems for Evolutionary Multiobjective Optimization , 2005, Evolutionary Multiobjective Optimization.

[24]  Kiyoshi Tanaka,et al.  A Hybrid Selection Strategy Using Scalarization and Adaptive ε-Ranking for Many-objective Optimization , 2011 .

[25]  Erik D. Goodman,et al.  The hierarchical fair competition (HFC) model for parallel evolutionary algorithms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[26]  Kenneth A. De Jong,et al.  Using Markov Chains to Analyze GAFOs , 1994, FOGA.

[27]  Kiyoshi Tanaka,et al.  Selection, Drift, Recombination, and Mutation in Multiobjective Evolutionary Algorithms on Scalable MNK-Landscapes , 2005, EMO.

[28]  E. Hughes Multiple single objective Pareto sampling , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[29]  Lothar Thiele,et al.  An evolutionary algorithm for multiobjective optimization: the strength Pareto approach , 1998 .

[30]  Kiyoshi Tanaka,et al.  Insights on properties of multiobjective MNK-landscapes , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[31]  Robin Charles Purshouse,et al.  On the evolutionary optimisation of many objectives , 2003 .

[32]  Andrea Sorbi,et al.  New Computational Paradigms: Changing Conceptions of What is Computable , 2007 .

[33]  Xin Yao,et al.  Performance Scaling of Multi-objective Evolutionary Algorithms , 2003, EMO.

[34]  Devdatt P. Dubhashi,et al.  Concentration of Measure for the Analysis of Randomized Algorithms: Contents , 2009 .

[35]  Kiyoshi Tanaka,et al.  Random Bit Climbers on Multiobjective MNK-Landscapes: Effects of Memory and Population Climbing , 2005, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[36]  Carlos A. Coello Coello,et al.  Alternative Fitness Assignment Methods for Many-Objective Optimization Problems , 2009, Artificial Evolution.

[37]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[38]  Hajime Kita,et al.  Multi-Objective Optimization by Means of the Thermodynamical Genetic Algorithm , 1996, PPSN.

[39]  Doina Bucur,et al.  Influence Maximization in Social Networks with Genetic Algorithms , 2016, EvoApplications.

[40]  David E. Goldberg,et al.  Limits of scalability of multiobjective estimation of distribution algorithms , 2005, 2005 IEEE Congress on Evolutionary Computation.

[41]  Xin Yao,et al.  How well do multi-objective evolutionary algorithms scale to large problems , 2007, 2007 IEEE Congress on Evolutionary Computation.