Parallel Implementation of MOEA/D with Parallel Weight Vectors for Feature Selection

In machine learning field, feature selection can be treated as a bi-objective optimization problem. It is reported that a decomposition-based evolutionary multi-objective optimization algorithm (i.e., MOEA/D-STAT) has good diversity performance when coping with feature selection. However, feature selection is also a time-consuming problem considering a large dataset it involves. The computation time can be easily reduced by introducing the parallelization into MOEA/D-STAT, thanks to the decomposition idea of MOEA/D. To the best of our knowledge, this is the first attempt to implement the parallelization of MOEA/D-STAT for feature selection. In this paper, we consider both master-slave models and island models, which are two different approaches of parallelization. In the master-slave models, different offspring assignment mechanisms are considered. In the island models, different island size specification mechanisms are examined. Our experimental results show that the master-slave models can achieve higher speedup and better performance than the island models.

[1]  Hisao Ishibuchi,et al.  Multiple Reference Points-Based Decomposition for Multiobjective Feature Selection in Classification: Static and Dynamic Mechanisms , 2020, IEEE Transactions on Evolutionary Computation.

[2]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[3]  Jakub M. Tomczak,et al.  Ensemble boosted trees with synthetic features generation in application to bankruptcy prediction , 2016, Expert Syst. Appl..

[4]  Mengjie Zhang,et al.  Feature Selection to Improve Generalization of Genetic Programming for High-Dimensional Symbolic Regression , 2017, IEEE Transactions on Evolutionary Computation.

[5]  LiHui,et al.  Multiobjective optimization problems with complicated Pareto sets, MOEA/D and NSGA-II , 2009 .

[6]  Yu Wu,et al.  Universal partially evolved parallelization of MOEA/D for multi-objective optimization on message-passing clusters , 2017, Soft Comput..

[7]  Dario Izzo,et al.  PaDe: A Parallel Algorithm Based on the MOEA/D Framework and the Island Model , 2014, PPSN.

[8]  Bilel Derbel,et al.  A fine-grained message passing MOEA/D , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[9]  Klaus Pohl,et al.  Comparing and Combining Predictive Business Process Monitoring Techniques , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[10]  Gary B. Lamont,et al.  Considerations in engineering parallel multiobjective evolutionary algorithms , 2003, IEEE Trans. Evol. Comput..

[11]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[12]  Antonio J. Nebro,et al.  A Study of the Parallelization of the Multi-Objective Metaheuristic MOEA/D , 2010, LION.

[13]  Kalyanmoy Deb,et al.  Distributed Computing of Pareto-Optimal Solutions with Evolutionary Algorithms , 2003, EMO.

[14]  Hisao Ishibuchi,et al.  Modified Distance Calculation in Generational Distance and Inverted Generational Distance , 2015, EMO.

[15]  Ronald L. Graham,et al.  Bounds on Multiprocessing Timing Anomalies , 1969, SIAM Journal of Applied Mathematics.

[16]  Hisao Ishibuchi,et al.  Performance of Decomposition-Based Many-Objective Algorithms Strongly Depends on Pareto Front Shapes , 2017, IEEE Transactions on Evolutionary Computation.

[17]  Antonio J. Nebro,et al.  jMetal: A Java framework for multi-objective optimization , 2011, Adv. Eng. Softw..

[18]  Mengjie Zhang,et al.  Multi-objective particle swarm optimisation (PSO) for feature selection , 2012, GECCO '12.

[19]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[20]  El-Ghazali Talbi,et al.  A unified view of parallel multi-objective evolutionary algorithms , 2019, J. Parallel Distributed Comput..

[21]  Enrique Alba,et al.  A Parallel Version of SMS-EMOA for Many-Objective Optimization Problems , 2016, PPSN.

[22]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[23]  Antoni Wibowo,et al.  Effective local evolutionary searches distributed on an island model solving bi-objective optimization problems , 2012, Applied Intelligence.

[24]  Qingfu Zhang,et al.  Multiobjective Optimization Problems With Complicated Pareto Sets, MOEA/D and NSGA-II , 2009, IEEE Transactions on Evolutionary Computation.