Make Evolutionary Multiobjective Algorithms Scale Better with Advanced Data Structures: Van Emde Boas Tree for Non-dominated Sorting

We improve the worst-case time complexity of non-dominated sorting, an operation frequently used in evolutionary multiobjective algorithms, to \(O(n \cdot (\log n)^{k-2} \log \log n)\), where n is the number of solutions, k is the number of objectives, and the random-access memory computation model is assumed. This improvement was possible thanks to the van Emde Boas tree, an “advanced” data structure which stores a set of non-negative integers less than n and supports many queries in \(O(\log \log n)\). This is not only a theoretical improvement, as we also provide an efficient implementation of the van Emde Boas tree, which resulted in a competitive algorithm that scales better than other algorithms when n grows, at least for small numbers of objectives greater than two.

[1]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[2]  Peter A. N. Bosman,et al.  Exploiting linkage information in real-valued optimization with the real-valued gene-pool optimal mixing evolutionary algorithm , 2017, GECCO.

[3]  Tobias Friedrich,et al.  Approximating the Least Hypervolume Contributor: NP-Hard in General, But Fast in Practice , 2009, EMO.

[4]  Kalyanmoy Deb,et al.  A population-based fast algorithm for a billion-dimensional resource allocation problem with integer variables , 2017, Eur. J. Oper. Res..

[5]  Marc Parizeau,et al.  Generalizing the improved run-time complexity algorithm for non-dominated sorting , 2013, GECCO '13.

[6]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[7]  Michael T. Goodrich,et al.  Three-Dimensional Layers of Maxima , 2004, Algorithmica.

[8]  Mikkel T. Jensen,et al.  Reducing the run-time complexity of multiobjective EAs: The NSGA-II and other algorithms , 2003, IEEE Trans. Evol. Comput..

[9]  Kiyoshi Tanaka,et al.  Ieee Transactions on Evolutionary Computation Computational Cost Reduction of Non-dominated Sorting Using the M-front , 2022 .

[10]  Peter van Emde Boas,et al.  Preserving order in a forest in less than logarithmic time , 1975, 16th Annual Symposium on Foundations of Computer Science (sfcs 1975).

[11]  Anna Syberfeldt,et al.  A New Algorithm Using the Non-Dominated Tree to Improve Non-Dominated Sorting , 2017, Evolutionary Computation.

[12]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[13]  Samarth Gupta,et al.  A scalable parallel implementation of evolutionary algorithms for multi-objective optimization on GPUs , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[14]  Kalyanmoy Deb,et al.  An Efficient Nondominated Sorting Algorithm for Large Number of Fronts , 2019, IEEE Transactions on Cybernetics.

[15]  L. Darrell Whitley,et al.  Optimizing one million variable NK landscapes by hybridizing deterministic recombination and local search , 2017, GECCO.

[16]  Kalyanmoy Deb,et al.  Muiltiobjective Optimization Using Nondominated Sorting in Genetic Algorithms , 1994, Evolutionary Computation.

[17]  Maxim Buzdalov,et al.  Generalized offline orthant search: one code for many problems in multiobjective optimization , 2018, GECCO.

[18]  Peter van Emde Boas,et al.  Design and implementation of an efficient priority queue , 1976, Mathematical systems theory.

[19]  Kalyanmoy Deb,et al.  Best Order Sort: A New Algorithm to Non-dominated Sorting for Evolutionary Multi-objective Optimization , 2016, GECCO.

[20]  Yakov Nekrich A Fast Algorithm for Three-Dimensional Layers of Maxima Problem , 2011, WADS.

[21]  Maxim Buzdalov,et al.  A Provably Asymptotically Fast Version of the Generalized Jensen Algorithm for Non-dominated Sorting , 2014, PPSN.

[22]  Kalyanmoy Deb,et al.  An Evolutionary Many-Objective Optimization Algorithm Using Reference-Point-Based Nondominated Sorting Approach, Part I: Solving Problems With Box Constraints , 2014, IEEE Transactions on Evolutionary Computation.

[23]  Ye Tian,et al.  An Efficient Approach to Nondominated Sorting for Evolutionary Multiobjective Optimization , 2015, IEEE Transactions on Evolutionary Computation.

[24]  Maxim Buzdalov,et al.  Towards Large-Scale Multiobjective Optimisation with a Hybrid Algorithm for Non-dominated Sorting , 2018, PPSN.

[25]  Tobias Glasmachers,et al.  A Fast Incremental BSP Tree Archive for Non-dominated Points , 2016, EMO.