A Parallel Tabu Search Heuristic to Approximate Uniform Designs for Reference Set Based MOEAs

Recent Multi-objective Optimization (MO) algorithms such as MOEA/D or NSGA-III make use of an uniformly scattered set of reference points indicating search directions in the objective space in order to achieve diversity. Apart from the mixture-design based techniques such as the simplex lattice, the mixture-design based techniques, there exists the Uniform Design (DU) approach, which is based on based on the minimization of a discrepancy metric, which measures how well equidistributed the points are in a sample space. In this work, this minimization problem is tackled through the \(L_2\) discrepancy function and solved with a parallel heuristic based on several Tabu Searches, distributed over multiple processors. The computational burden does not allow us to perform many executions but the solution technique is able to produce nearly Uniform Designs. These point sets were used to solve some classical MO test problems with two different algorithms, MOEA/D and NSGA-III. The computational experiments proves that, when the dimension increases, the algorithms working with a set generated by Uniform Design significantly outperform their counterpart working with other state-of-the-art strategies, such as the simplex lattice or two layer designs.

[1]  John A. Cornell,et al.  A Primer on Experiments with Mixtures: Cornell/A Primer on Mixtures , 2011 .

[2]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[3]  John E. Dennis,et al.  Normal-Boundary Intersection: A New Method for Generating the Pareto Surface in Nonlinear Multicriteria Optimization Problems , 1998, SIAM J. Optim..

[4]  Hong Li,et al.  MOEA/D + uniform design: A new version of MOEA/D for optimization problems with many objectives , 2013, Comput. Oper. Res..

[5]  Saúl Zapotecas Martínez,et al.  On the low-discrepancy sequences and their use in MOEA/D for high-dimensional objective spaces , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[6]  Kiyoshi Tanaka,et al.  A Review of Features and Limitations of Existing Scalable Multiobjective Test Suites , 2019, IEEE Transactions on Evolutionary Computation.

[7]  Dennis K. J. Lin,et al.  Ch. 4. Uniform experimental designs and their applications in industry , 2003 .

[8]  J. Cornell Experiments with Mixtures: Designs, Models and the Analysis of Mixture Data , 1982 .

[9]  Saúl Zapotecas Martínez,et al.  LIBEA: A Lebesgue Indicator-Based Evolutionary Algorithm for multi-objective optimization , 2019, Swarm Evol. Comput..

[10]  K. Fang,et al.  A new approach to construction of nearly uniform designs , 2004 .

[11]  H. Keng,et al.  Applications of number theory to numerical analysis , 1981 .

[12]  H. Scheffé Experiments with Mixtures , 1958 .

[13]  Y. Wang,et al.  An Historical Overview of Lattice Point Sets , 2002 .

[14]  Kai-Tai Fang,et al.  Admissibility and minimaxity of the uniform design measure in nonparametric regression model , 2000 .

[15]  Fred W. Glover,et al.  Future paths for integer programming and links to artificial intelligence , 1986, Comput. Oper. Res..

[16]  Kai-Tai Fang,et al.  A note on construction of nearly uniform designs with large number of runs , 2003 .

[17]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[18]  K. F. Roth,et al.  Rational approximations to algebraic numbers , 1955 .