Reducing complexity in many objective optimization using community detection

Multi-objective optimization problems with many objective functions (≫3) are difficult to solve. This is because the time complexity of optimization algorithms often grows fast with the number of objective functions and the results of many objective optimization algorithms (Pareto front approximation) require large memory and their interpretation can be difficult for the decision maker. It is therefore attractive to reduce complexity of these problems. This can be achieved by decomposing them into a set of independent lower dimensional subproblems, or by aggregating some objective functions into a single objective function. This work introduces a new approach for decomposition and aggregation based on techniques from social network analysis. The key idea is to interpret an objective function as a node (agent) in a social network, and arcs between nodes indicate relationships: Negatively weighted arcs stand for conflicting objectives, zero weighted arcs for independent objectives, and positively weighted arcs for objectives that support each other. Using well-known algorithms BGLL for community detection we show that - given certain preconditions - it is possible to decompose a many objective optimization problem to a set of lower dimensional multi-objective optimization problems. This makes it easier to solve the problem and interpret the resulting trade-off (hyper-)surfaces. In the paper, after introducing the idea of Communtiy Detection for Many-Objective Optimization (CoDeMO), we lay out an interactive workflow and test it on simple, scalable many-objective optimization problems - variants of facility location problems - and thereby provide a prove-of-concept study.

[1]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[2]  M E J Newman,et al.  Finding and evaluating community structure in networks. , 2003, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[4]  Nicola Beume,et al.  Pareto-, Aggregation-, and Indicator-Based Methods in Many-Objective Optimization , 2007, EMO.

[5]  M E J Newman,et al.  Community structure in social and biological networks , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[7]  Eckart Zitzler,et al.  HypE: An Algorithm for Fast Hypervolume-Based Many-Objective Optimization , 2011, Evolutionary Computation.

[8]  Hisao Ishibuchi,et al.  Behavior of EMO algorithms on many-objective optimization problems with correlated objectives , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[9]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[10]  Carlos A. Coello Coello,et al.  Online Objective Reduction to Deal with Many-Objective Problems , 2009, EMO.

[11]  Qingfu Zhang,et al.  Objective Reduction in Many-Objective Optimization: Linear and Nonlinear Algorithms , 2013, IEEE Transactions on Evolutionary Computation.

[12]  DebK.,et al.  A fast and elitist multiobjective genetic algorithm , 2002 .

[13]  Peter J. Fleming,et al.  Evolutionary many-objective optimisation: an exploratory analysis , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[14]  Pablo Jensen,et al.  Analysis of community structure in networks of correlated data. , 2008, Physical review. E, Statistical, nonlinear, and soft matter physics.

[15]  Vladimir Batagelj,et al.  Pajek Program for Analysis and Visualization of Large Networks , 2007 .

[16]  Jean-Loup Guillaume,et al.  Fast unfolding of communities in large networks , 2008, 0803.0476.

[17]  Ramanathan V. Guha,et al.  Propagation of trust and distrust , 2004, WWW '04.