Multiobjective decomposition-based Mallows Models estimation of distribution algorithm. A case of study for permutation flowshop scheduling problem

Mallows Models and Generalized Mallows Models have demonstrated their validity in the context of EDAs to deal with permutation-based optimization problems.We introduce a novel general multi-objective decomposition-based Mallows Models EDA for solving multi-objective permutation optimization problems.We show the potentiality of the proposed framework for solving the multi-objective permutation flowshop scheduling problem minimizing total flow time and makespan. Estimation of distribution algorithms (EDAs) have become a reliable alternative to solve a broad range of single and multi-objective optimization problems. Recently, distance-based exponential models, such as Mallows Model (MM) and Generalized Mallows Model (GMM), have demonstrated their validity in the context of EDAs to deal with permutation-based optimization problems. The aim of this paper is two-fold. First, we introduce a novel general multi-objective decomposition-based EDA using Kernels of Mallows models (MEDA/D-MK framework) for solving multi-objective permutation-based optimization problems. Second, in order to demonstrate the validity of the MEDA/D-MK, we have applied it to solve the multi-objective permutation flowshop scheduling problem (MoPFSP) minimizing the total flow time and the makespan. The permutation flowshop scheduling problem is one of the most studied problems of this kind due to its fields of application and algorithmic challenge. The results of our experiments show that MEDA/D-MK outperforms an improved MOEA/D variant specific tailored for minimizing makespan and total flowtime. Furthermore, our approach achieves competitive results compared to the best-known approximated Pareto fronts reported in the literature for the benchmark considered.

[1]  Martin Pelikan,et al.  An application of a multivariate estimation of distribution algorithm to cancer chemotherapy , 2008, GECCO '08.

[2]  Ralph E. Steuer.  Multiple criteria optimization , 1986 .

[3]  Aurora Trinidad Ramirez Pozo,et al.  MOEA/D-GM: Using probabilistic graphical models in MOEA/D for solving combinatorial optimization problems , 2015, ArXiv.

[4]  Yi Mao,et al.  Non-parametric Modeling of Partially Ranked Data , 2007, NIPS.

[5]  Qingfu Zhang,et al.  A multiobjective evolutionary algorithm based on decomposition and probability model , 2012, 2012 IEEE Congress on Evolutionary Computation.

[6]  H. Mühlenbein,et al.  From Recombination of Genes to the Estimation of Distributions I. Binary Parameters , 1996, PPSN.

[7]  Jesús García,et al.  Multi-Objective Optimization with an Adaptive Resonance Theory-Based Estimation of Distribution Algorithm: A Comparative Study , 2011, LION.

[8]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems , 2002, Genetic Algorithms and Evolutionary Computation.

[9]  Rubén Ruiz,et al.  Restarted Iterated Pareto Greedy algorithm for multi-objective flowshop scheduling problems , 2011, Comput. Oper. Res..

[10]  Qingfu Zhang,et al.  MOEA/D for flowshop scheduling problems , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[11]  Carlos A. Coello Coello,et al.  Using the Averaged Hausdorff Distance as a Performance Measure in Evolutionary Multiobjective Optimization , 2012, IEEE Transactions on Evolutionary Computation.

[12]  Concha Bielza,et al.  A review on probabilistic graphical models in evolutionary computation , 2012, Journal of Heuristics.

[13]  Éric D. Taillard,et al.  Benchmarks for basic scheduling problems , 1993 .

[14]  Alexander Mendiburu,et al.  A review on estimation of distribution algorithms in permutation-based combinatorial optimization problems , 2012, Progress in Artificial Intelligence.

[15]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[16]  Mehmet Mutlu Yenisey,et al.  Multi-objective permutation flow shop scheduling problem: Literature review, classification and current trends , 2014 .

[17]  Gary B. Lamont,et al.  Evolutionary Algorithms for Solving Multi-Objective Problems (Genetic and Evolutionary Computation) , 2006 .

[18]  Jiyin Liu,et al.  Constructive and composite heuristic solutions to the P// Sigma Ci scheduling problem , 2001, Eur. J. Oper. Res..

[19]  Alexander Mendiburu,et al.  Introducing the Mallows Model on Estimation of Distribution Algorithms , 2011, ICONIP.

[20]  Qingfu Zhang,et al.  An Evolutionary Many-Objective Optimization Algorithm Based on Dominance and Decomposition , 2015, IEEE Transactions on Evolutionary Computation.

[21]  Alexander Mendiburu,et al.  Extending distance-based ranking models in estimation of distribution algorithms , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[22]  Alexander Mendiburu,et al.  A Distance-Based Ranking Model Estimation of Distribution Algorithm for the Flowshop Scheduling Problem , 2014, IEEE Transactions on Evolutionary Computation.

[23]  Shigeyoshi Tsutsui,et al.  Node Histogram vs. Edge Histogram: A Comparison of Probabilistic Model-Building Genetic Algorithms in Permutation Domains , 2006, 2006 IEEE International Conference on Evolutionary Computation.

[24]  M. Fligner,et al.  Multistage Ranking Models , 1988 .

[25]  Xiao Xu,et al.  An asynchronous genetic local search algorithm for the permutation flowshop scheduling problem with total flowtime minimization , 2011, Expert Syst. Appl..

[26]  Giovanni Ravazzani,et al.  Regionalization of Flow-Duration Curves through Catchment Classification with Streamflow Signatures and Physiographic–Climate Indices , 2016 .

[27]  Dipti Srinivasan,et al.  A Survey of Multiobjective Evolutionary Algorithms Based on Decomposition , 2017, IEEE Transactions on Evolutionary Computation.

[28]  Qingfu Zhang,et al.  Hybridization of Decomposition and Local Search for Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.

[29]  Rubén Ruiz,et al.  A Review and Evaluation of Multiobjective Algorithms for the Flowshop Scheduling Problem , 2008, INFORMS J. Comput..

[30]  Hisao Ishibuchi,et al.  Performance evaluation of genetic algorithms for flowshop scheduling problems , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[31]  Alfredo Milani,et al.  Algebraic Differential Evolution Algorithm for the Permutation Flowshop Scheduling Problem With Total Flowtime Criterion , 2016, IEEE Transactions on Evolutionary Computation.

[32]  Shigeyoshi Tsutsui,et al.  Probabilistic Model-Building Genetic Algorithms in Permutation Representation Domain Using Edge Histogram , 2002, PPSN.

[33]  Alexander Mendiburu,et al.  Parallel EDAs to create multivariate calibration models for quantitative chemical applications , 2006, J. Parallel Distributed Comput..

[34]  Thomas Stützle,et al.  Automatic Component-Wise Design of Multiobjective Evolutionary Algorithms , 2016, IEEE Transactions on Evolutionary Computation.

[35]  Qingfu Zhang,et al.  MOEA/D with Tabu Search for multiobjective permutation flow shop scheduling problems , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[36]  Thomas Stützle,et al.  A hybrid TP+PLS algorithm for bi-objective flow-shop scheduling problems , 2011, Comput. Oper. Res..

[37]  Francisco Herrera,et al.  A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms , 2011, Swarm Evol. Comput..

[38]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[39]  C. L. Mallows.  NON-NULL RANKING MODELS. I , 1957 .

[40]  R. S. Laundy,et al.  Multiple Criteria Optimisation: Theory, Computation and Application , 1989 .

[41]  Alexander Mendiburu,et al.  Kernels of Mallows Models for Solving Permutation-based Problems , 2015, GECCO.

[42]  Concha Bielza,et al.  Multi-objective Optimization with Joint Probabilistic Modeling of Objectives and Variables , 2011, EMO.

[43]  Hisao Ishibuchi,et al.  Balance between genetic search and local search in memetic algorithms for multiobjective permutation flowshop scheduling , 2003, IEEE Trans. Evol. Comput..

[44]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[45]  Xiangtao Li,et al.  Multiobjective Local Search Algorithm-Based Decomposition for Multiobjective Permutation Flow Shop Scheduling Problem , 2015, IEEE Transactions on Engineering Management.

[46]  Kaisa Miettinen,et al.  Nonlinear multiobjective optimization , 1998, International series in operations research and management science.

[47]  S. Brooks,et al.  Optimization Using Simulated Annealing , 1995 .

[48]  J. A. Lozano,et al.  Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation , 2001 .

[49]  Charles Gide,et al.  Cours d'économie politique , 1911 .

[50]  Chongguo Li,et al.  Diversity Metrics in Multi-objective Optimization: Review and Perspective , 2007, 2007 IEEE International Conference on Integration Technology.

[51]  Marco César Goldbarg,et al.  New VNS heuristic for total flowtime flowshop scheduling problem , 2012, Expert Syst. Appl..

[52]  Roberto Santana,et al.  Mixtures of Generalized Mallows models for solving the quadratic assignment problem , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[53]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[54]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[55]  J. A. Lozano,et al.  Sampling and learning the Mallows and Generalized Mallows models under the Cayley distance , 2014 .

[56]  Pan Liu,et al.  Evaluation of Estimation of Distribution Algorithm to Calibrate Computationally Intensive Hydrologic Model , 2016 .

[57]  Dirk Thierens,et al.  Multi-objective optimization with diversity preserving mixture-based iterated density estimation evolutionary algorithms , 2002, Int. J. Approx. Reason..

[58]  David E. Goldberg,et al.  Multiobjective Estimation of Distribution Algorithms , 2006, Scalable Optimization via Probabilistic Modeling.