Evolving Scheduling Heuristics via Genetic Programming With Feature Selection in Dynamic Flexible Job-Shop Scheduling

Dynamic flexible job-shop scheduling (DFJSS) is a challenging combinational optimization problem that takes the dynamic environment into account. Genetic programming hyperheuristics (GPHH) have been widely used to evolve scheduling heuristics for job-shop scheduling. A proper selection of the terminal set is a critical factor for the success of GPHH. However, there is a wide range of features that can capture different characteristics of the job-shop state. Moreover, the importance of a feature is unclear from one scenario to another. The irrelevant and redundant features may lead to performance limitations. Feature selection is an important task to select relevant and complementary features. However, little work has considered feature selection in GPHH for DFJSS. In this article, a novel two-stage GPHH framework with feature selection is designed to evolve scheduling heuristics only with the selected features for DFJSS automatically. Meanwhile, individual adaptation strategies are proposed to utilize the information of both the selected features and the investigated individuals during the feature selection process. The results show that the proposed algorithm can successfully achieve more interpretable scheduling heuristics with fewer unique features and smaller sizes. In addition, the proposed algorithm can reach comparable scheduling heuristic quality with much shorter training time.

[1]  Natalia V. Shakhlevich,et al.  NP-hardness of Shop-scheduling Problems with Three Jobs , 1995, Discret. Appl. Math..

[2]  Riccardo Poli,et al.  Evolving timetabling heuristics using a grammar-based genetic programming hyper-heuristic framework , 2009, Memetic Comput..

[3]  Lalana Kagal,et al.  Explaining Explanations: An Overview of Interpretability of Machine Learning , 2018, 2018 IEEE 5th International Conference on Data Science and Advanced Analytics (DSAA).

[4]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[5]  Chengbin Chu,et al.  An improvement of the Lagrangean relaxation approach for job shop scheduling: a dynamic programming method , 1998, IEEE Trans. Robotics Autom..

[6]  Yi Mei,et al.  Genetic Programming Hyper-Heuristic with Cooperative Coevolution for Dynamic Flexible Job Shop Scheduling , 2018, EuroGP.

[7]  Aboul Ella Hassanien,et al.  Feature selection via a novel chaotic crow search algorithm , 2017, Neural Computing and Applications.

[8]  Bing Xue,et al.  Genetic Programming for Feature Selection and Feature Construction in Skin Cancer Image Classification , 2018, PRICAI.

[9]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[10]  Domagoj Jakobovic,et al.  Evolving dispatching rules for optimising many-objective criteria in the unrelated machines environment , 2018, Genetic Programming and Evolvable Machines.

[11]  Huan Liu,et al.  Feature Selection for Classification , 1997, Intell. Data Anal..

[12]  Mark Johnston,et al.  Genetic Programming for Evolving Due-Date Assignment Models in Job Shop Environments , 2014, Evolutionary Computation.

[13]  Manuel Laguna,et al.  Tabu Search , 1997 .

[14]  Yi Mei,et al.  A two-stage genetic programming hyper-heuristic approach with feature selection for dynamic flexible job shop scheduling , 2019, GECCO.

[15]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[16]  Ian Welch,et al.  A genetic programming approach to feature selection and construction for ransomware, phishing and spam detection , 2019, GECCO.

[17]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[18]  Àngela Nebot,et al.  Hybrid methodologies for electricity load forecasting: Entropy-based feature selection with machine learning and soft computing techniques , 2015 .

[19]  Yi Mei,et al.  Feature Selection in Evolving Job Shop Dispatching Rules with Genetic Programming , 2016, GECCO.

[20]  Nikhil R. Pal,et al.  A Multiobjective Genetic Programming-Based Ensemble for Simultaneous Feature Selection and Classification , 2016, IEEE Transactions on Cybernetics.

[21]  Nadia Essoussi,et al.  Hybrid Feature Selection Method Based on the Genetic Algorithm and Pearson Correlation Coefficient , 2018, Machine Learning Paradigms.

[22]  Lawrence. Davis,et al.  Handbook Of Genetic Algorithms , 1990 .

[23]  Peter Brucker,et al.  Job-shop Scheduling Problem , 2009, Encyclopedia of Optimization.

[24]  Yi Mei,et al.  An Efficient Feature Selection Algorithm for Evolving Job Shop Scheduling Rules With Genetic Programming , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[25]  Ke Chen,et al.  Particle Swarm Optimization for Feature Selection with Adaptive Mechanism and New Updating Strategy , 2018, Australasian Conference on Artificial Intelligence.

[26]  Mark Johnston,et al.  Automatic Programming via Iterated Local Search for Dynamic Job Shop Scheduling , 2015, IEEE Transactions on Cybernetics.

[27]  Domagoj Jakobovic,et al.  A survey of dispatching rules for the dynamic unrelated machines environment , 2018, Expert Syst. Appl..

[28]  Yaochu Jin,et al.  Feature selection for high-dimensional classification using a competitive swarm optimizer , 2016, Soft Computing.

[29]  Rachel Hunt Genetic Programming Hyper-heuristics for Job Shop Scheduling , 2016 .

[30]  Nhu Binh Ho,et al.  Evolving dispatching rules using genetic programming for solving multi-objective flexible job-shop problems , 2008, Comput. Ind. Eng..

[31]  Yi Mei,et al.  Genetic programming for production scheduling: a survey with a unified framework , 2017, Complex & Intelligent Systems.

[32]  Mengjie Zhang,et al.  Particle swarm optimisation representations for simultaneous clustering and feature selection , 2016, 2016 IEEE Symposium Series on Computational Intelligence (SSCI).

[33]  Gang Chen,et al.  Investigating a Machine Breakdown Genetic Programming Approach for Dynamic Job Shop Scheduling , 2018, EuroGP.

[34]  Fangfang Zhang,et al.  A New Representation in Genetic Programming for Evolving Dispatching Rules for Dynamic Flexible Job Shop Scheduling , 2019, EvoCOP.

[35]  Reha Uzsoy,et al.  Rapid Modeling and Discovery of Priority Dispatching Rules: An Autonomous Learning Approach , 2006, J. Sched..

[36]  Kazuo Miyashita,et al.  Job-shop scheduling with genetic programming , 2000 .

[37]  Matthew R. Hyde A genetic programming hyper-heuristic approach to automated packing , 2010 .

[38]  Peter Rossmanith,et al.  Simulated Annealing , 2008, Taschenbuch der Algorithmen.

[39]  Yoshiyasu Takefuji,et al.  Integer linear programming neural networks for job-shop scheduling , 1988, IEEE 1988 International Conference on Neural Networks.

[40]  Alper Kursat Uysal,et al.  An improved global feature selection scheme for text classification , 2016, Expert Syst. Appl..

[41]  Mengjie Zhang,et al.  Surrogate-Assisted Genetic Programming With Simplified Models for Automated Design of Dispatching Rules , 2017, IEEE Transactions on Cybernetics.

[42]  Su Nguyen,et al.  A hybrid discrete particle swarm optimisation method for grid computation scheduling , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[43]  Fangfang Zhang,et al.  Surrogate-Assisted Genetic Programming for Dynamic Flexible Job Shop Scheduling , 2018, Australasian Conference on Artificial Intelligence.

[44]  Graham Kendall,et al.  A Genetic Programming Hyper-Heuristic Approach for Evolving 2-D Strip Packing Heuristics , 2010, IEEE Transactions on Evolutionary Computation.

[45]  Su Nguyen,et al.  Guided Subtree Selection for Genetic Operators in Genetic Programming for Dynamic Flexible Job Shop Scheduling , 2020, EuroGP.

[46]  Fangfang Zhang,et al.  Genetic Programming with Multi-tree Representation for Dynamic Flexible Job Shop Scheduling , 2018, Australasian Conference on Artificial Intelligence.

[47]  Graham Kendall,et al.  Exploring Hyper-heuristic Methodologies with Genetic Programming , 2009 .

[48]  Mengjie Zhang,et al.  Automated Design of Production Scheduling Heuristics: A Review , 2016, IEEE Transactions on Evolutionary Computation.

[49]  Wolfgang Banzhaf,et al.  A Genetic Programming Approach to the Generation of Hyper-Heuristics for the Uncapacitated Examination Timetabling Problem , 2007, EPIA Workshops.

[50]  Kathleen M. Eisenhardt,et al.  Developing Theory Through Simulation Methods , 2006 .

[51]  Mengjie Zhang,et al.  Feature Selection to Improve Generalization of Genetic Programming for High-Dimensional Symbolic Regression , 2017, IEEE Transactions on Evolutionary Computation.

[52]  Mengjie Zhang,et al.  Structural Risk Minimization-Driven Genetic Programming for Enhancing Generalization in Symbolic Regression , 2019, IEEE Transactions on Evolutionary Computation.

[53]  Jürgen Branke,et al.  On Using Surrogates with Genetic Programming , 2015, Evolutionary Computation.

[54]  Jian Xiong,et al.  Robust scheduling for multi-objective flexible job-shop problems with random machine breakdowns , 2013 .

[55]  Peter Brucker,et al.  Job-shop scheduling with multi-purpose machines , 1991, Computing.

[56]  Ke Chen,et al.  Hybrid particle swarm optimization with spiral-shaped mechanism for feature selection , 2019, Expert Syst. Appl..