Multitask Genetic Programming-Based Generative Hyperheuristics: A Case Study in Dynamic Scheduling

Evolutionary multitask learning has achieved great success due to its ability to handle multiple tasks simultaneously. However, it is rarely used in the hyperheuristic domain, which aims at generating a heuristic for a class of problems rather than solving one specific problem. The existing multitask hyperheuristic studies only focus on heuristic selection, which is not applicable to heuristic generation. To fill the gap, we propose a novel multitask generative hyperheuristic approach based on genetic programming (GP) in this article. Specifically, we introduce the idea in evolutionary multitask learning to GP hyperheuristics with a suitable evolutionary framework and individual selection pressure. In addition, an origin-based offspring reservation strategy is developed to maintain the quality of individuals for each task. To verify the effectiveness of the proposed approach, comprehensive empirical studies have been conducted on the homogeneous and heterogeneous multitask dynamic flexible job shop scheduling. The results show that the proposed algorithm can significantly improve the quality of scheduling heuristics for each task in all the examined scenarios. In addition, the evolved scheduling heuristics verify the mutual help among the tasks in a multitask scenario.

[1]  Mengjie Zhang,et al.  Collaborative Multifidelity-Based Surrogate Models for Genetic Programming in Dynamic Flexible Job Shop Scheduling , 2021, IEEE Transactions on Cybernetics.

[2]  Yi Mei,et al.  Correlation Coefficient-Based Recombinative Guidance for Genetic Programming Hyperheuristics in Dynamic Flexible Job Shop Scheduling , 2021, IEEE Transactions on Evolutionary Computation.

[3]  Mengjie Zhang,et al.  An Evolutionary Multitasking-Based Feature Selection Method for High-Dimensional Classification , 2020, IEEE Transactions on Cybernetics.

[4]  Wentong Cai,et al.  Multifactorial Genetic Programming for Symbolic Regression Problems , 2020, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Yi Mei,et al.  Evolving Scheduling Heuristics via Genetic Programming With Feature Selection in Dynamic Flexible Job-Shop Scheduling , 2020, IEEE Transactions on Cybernetics.

[6]  Yi Mei,et al.  A preliminary approach to evolutionary multitasking for dynamic flexible job shop scheduling via genetic programming , 2020, GECCO Companion.

[7]  Jing Liu,et al.  A Unified Framework of Graph-Based Evolutionary Multitasking Hyper-Heuristic , 2020, IEEE Transactions on Evolutionary Computation.

[8]  Su Nguyen,et al.  Genetic Programming with Adaptive Search Based on the Frequency of Features for Dynamic Flexible Job Shop Scheduling , 2020, EvoCOP.

[9]  Su Nguyen,et al.  Guided Subtree Selection for Genetic Operators in Genetic Programming for Dynamic Flexible Job Shop Scheduling , 2020, EuroGP.

[10]  Kay Chen Tan,et al.  An Effective Knowledge Transfer Approach for Multiobjective Multitasking Optimization , 2020, IEEE Transactions on Cybernetics.

[11]  Zexuan Zhu,et al.  Toward Adaptive Knowledge Transfer in Multifactorial Evolutionary Computation , 2020, IEEE Transactions on Cybernetics.

[12]  Qiuzhen Lin,et al.  Multifactorial optimization via explicit multipopulation evolutionary framework , 2020, Inf. Sci..

[13]  Yi Mei,et al.  Multitasking Genetic Programming for Stochastic Team Orienteering Problem with Time Windows , 2019, 2019 IEEE Symposium Series on Computational Intelligence (SSCI).

[14]  Maoguo Gong,et al.  Evolutionary Multitasking Sparse Reconstruction: Framework and Case Study , 2019, IEEE Transactions on Evolutionary Computation.

[15]  Lei Zhou,et al.  Evolutionary Multitasking via Explicit Autoencoding , 2019, IEEE Transactions on Cybernetics.

[16]  Yi Mei,et al.  A two-stage genetic programming hyper-heuristic approach with feature selection for dynamic flexible job shop scheduling , 2019, GECCO.

[17]  Yi Mei,et al.  Can Stochastic Dispatching Rules Evolved by Genetic Programming Hyper-heuristics Help in Dynamic Flexible Job Shop Scheduling? , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[18]  Yi Mei,et al.  Evolving Dispatching Rules for Multi-objective Dynamic Flexible Job Shop Scheduling via Genetic Programming Hyper-heuristics , 2019, 2019 IEEE Congress on Evolutionary Computation (CEC).

[19]  Fangfang Zhang,et al.  A New Representation in Genetic Programming for Evolving Dispatching Rules for Dynamic Flexible Job Shop Scheduling , 2019, EvoCOP.

[20]  Tianyou Chai,et al.  Generalized Multitasking for Evolutionary Optimization of Expensive Problems , 2019, IEEE Transactions on Evolutionary Computation.

[21]  Maoguo Gong,et al.  Evolutionary Multitasking With Dynamic Resource Allocating Strategy , 2019, IEEE Transactions on Evolutionary Computation.

[22]  Gang Chen,et al.  Evolutionary Multitask Optimisation for Dynamic Job Shop Scheduling Using Niched Genetic Programming , 2018, Australasian Conference on Artificial Intelligence.

[23]  Fangfang Zhang,et al.  Genetic Programming with Multi-tree Representation for Dynamic Flexible Job Shop Scheduling , 2018, Australasian Conference on Artificial Intelligence.

[24]  Fangfang Zhang,et al.  Surrogate-Assisted Genetic Programming for Dynamic Flexible Job Shop Scheduling , 2018, Australasian Conference on Artificial Intelligence.

[25]  Enzo Morosini Frazzon,et al.  Solving the Job-Shop Scheduling Problem in the Industry 4.0 Era , 2018, Technologies.

[26]  Kay Chen Tan,et al.  Visualizing the Evolution of Computer Programs for Genetic Programming [Research Frontier] , 2018, IEEE Computational Intelligence Magazine.

[27]  Domagoj Jakobovic,et al.  Evolving dispatching rules for optimising many-objective criteria in the unrelated machines environment , 2018, Genetic Programming and Evolvable Machines.

[28]  Liang Feng,et al.  Insights on Transfer Optimization: Because Experience is the Best Teacher , 2018, IEEE Transactions on Emerging Topics in Computational Intelligence.

[29]  Kay Chen Tan,et al.  Multiobjective Multifactorial Optimization in Evolutionary Multitasking , 2017, IEEE Transactions on Cybernetics.

[30]  Qingfu Zhang,et al.  Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results , 2017, ArXiv.

[31]  Yi Mei,et al.  Genetic programming for production scheduling: a survey with a unified framework , 2017, Complex & Intelligent Systems.

[32]  Sad Salhi,et al.  Heuristic Search: The Emerging Science of Problem Solving , 2017 .

[33]  Lei Zhou,et al.  Evolutionary multitasking in combinatorial search spaces: A case study in capacitated vehicle routing problem , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[34]  Domagoj Jakobovic,et al.  Adaptive scheduling on unrelated machines with genetic programming , 2016, Appl. Soft Comput..

[35]  Hua Xu,et al.  Evolutionary multitasking in permutation-based combinatorial optimization problems: Realization with TSP, QAP, LOP, and JSP , 2016, 2016 IEEE Region 10 Conference (TENCON).

[36]  Yew-Soon Ong,et al.  Multifactorial Evolution: Toward Evolutionary Multitasking , 2016, IEEE Transactions on Evolutionary Computation.

[37]  Mengjie Zhang,et al.  Automated Design of Production Scheduling Heuristics: A Review , 2016, IEEE Transactions on Evolutionary Computation.

[38]  Wentong Cai,et al.  Self-Learning Gene Expression Programming , 2016, IEEE Transactions on Evolutionary Computation.

[39]  Jürgen Branke,et al.  On Using Surrogates with Genetic Programming , 2015, Evolutionary Computation.

[40]  Bernd Scholz-Reiter,et al.  Hyper-heuristic Evolution of Dispatching Rules: A Comparison of Rule Representations , 2015, Evolutionary Computation.

[41]  Nguyen Quang Uy,et al.  Transfer learning in genetic programming , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[42]  Pascal Bouvry,et al.  A Survey of Evolutionary Computation for Resource Management of Processing in Cloud Computing [Review Article] , 2015, IEEE Computational Intelligence Magazine.

[43]  Mark Johnston,et al.  Genetic Programming for Evolving Due-Date Assignment Models in Job Shop Environments , 2014, Evolutionary Computation.

[44]  Michel Gendreau,et al.  Hyper-heuristics: a survey of the state of the art , 2013, J. Oper. Res. Soc..

[45]  Bernd Scholz-Reiter,et al.  Evolutionary generation of dispatching rule sets for complex dynamic scheduling problems , 2013 .

[46]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[47]  Liang Gao,et al.  Evolving scheduling rules with gene expression programming for dynamic single-machine scheduling problems , 2010 .

[48]  Nhu Binh Ho,et al.  Evolving dispatching rules using genetic programming for solving multi-objective flexible job-shop problems , 2008, Comput. Ind. Eng..

[49]  Marshall L. Fisher,et al.  Reducing the Cost of Demand Uncertainty Through Accurate Response to Early Sales , 1996, Oper. Res..

[50]  Peter Brucker,et al.  Job-shop scheduling with multi-purpose machines , 1991, Computing.

[51]  John R. Koza,et al.  Genetic programming: a paradigm for genetically breeding populations of computer programs to solve problems , 1990 .

[52]  Mark Johnston,et al.  Automatic Programming via Iterated Local Search for Dynamic Job Shop Scheduling , 2015, IEEE Transactions on Cybernetics.

[53]  Graham Kendall,et al.  A Classification of Hyper-heuristic Approaches , 2010 .

[54]  Graham Kendall,et al.  Exploring Hyper-heuristic Methodologies with Genetic Programming , 2009 .

[55]  Vidroha Debroy,et al.  Genetic Programming , 1998, Lecture Notes in Computer Science.

[56]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .