An Efficient Feature Selection Algorithm for Evolving Job Shop Scheduling Rules With Genetic Programming

Automated design of job shop scheduling rules using genetic programming as a hyper-heuristic is an emerging topic that has become more and more popular in recent years. For evolving dispatching rules, feature selection is an important issue for deciding the terminal set of genetic programming. There can be a large number of features, whose importance/relevance varies from one to another. It has been shown that using a promising feature subset can lead to a significant improvement over using all the features. However, the existing feature selection algorithm for job shop scheduling is too slow and inapplicable in practice. In this paper, we propose the first “practical” feature selection algorithm for job shop scheduling. Our contributions are twofold. First, we develop a Niching-based search framework for extracting a diverse set of good rules. Second, we reduce the complexity of fitness evaluation by using a surrogate model. As a result, the proposed feature selection algorithm is very efficient. The experimental studies show that it takes less than 10% of the training time of the standard genetic programming training process, and can obtain much better feature subsets than the entire feature set. Furthermore, it can find better feature subsets than the best-so-far feature subset.

[1]  Mengjie Zhang,et al.  Surrogate-Assisted Genetic Programming With Simplified Models for Automated Design of Dispatching Rules , 2017, IEEE Transactions on Cybernetics.

[2]  S. Kreipl A large step random walk for minimizing total weighted tardiness in a job shop , 2000 .

[3]  Bernd Scholz-Reiter,et al.  Towards improved dispatching rules for complex shop floor scenarios: a genetic programming approach , 2010, GECCO '10.

[4]  Bruno Sareni,et al.  Fitness sharing and niching methods revisited , 1998, IEEE Trans. Evol. Comput..

[5]  Bin Li,et al.  A New Memetic Algorithm With Fitness Approximation for the Defect-Tolerant Logic Mapping in Crossbar-Based Nanoarchitectures , 2014, IEEE Transactions on Evolutionary Computation.

[6]  Yoke San Wong,et al.  Job Shop Scheduling with Dynamic Fuzzy Selection of Dispatching Rules , 2000 .

[7]  Isabelle Guyon,et al.  An Introduction to Variable and Feature Selection , 2003, J. Mach. Learn. Res..

[8]  Don T. Phillips,et al.  A state-of-the-art survey of dispatching rules for manufacturing job shop operations , 1982 .

[9]  Xin-She Yang,et al.  A Discrete Firefly Algorithm for the Multi-Objective Hybrid Flowshop Scheduling Problems , 2014, IEEE Transactions on Evolutionary Computation.

[10]  Mark Johnston,et al.  Automatic Design of Scheduling Policies for Dynamic Multi-objective Job Shop Scheduling via Cooperative Coevolution Genetic Programming , 2014, IEEE Transactions on Evolutionary Computation.

[11]  Chandrasekharan Rajendran,et al.  New dispatching rules for shop scheduling: A step forward , 2000 .

[12]  R. Haupt,et al.  A survey of priority rule-based scheduling , 1989 .

[13]  Graham Kendall,et al.  Automating the Packing Heuristic Design Process with Genetic Programming , 2012, Evolutionary Computation.

[14]  Yi Mei,et al.  A comprehensive analysis on reusability of GP-evolved job shop dispatching rules , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[15]  Michael J. Shaw,et al.  Genetic algorithms with dynamic niche sharing for multimodal function optimization , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[16]  Ali S. Kiran,et al.  Simulation studies in job shop sheduling—I a survey , 1984 .

[17]  Mengjie Zhang,et al.  Meta-learning and feature ranking using genetic programming for classification: Variable terminal weighting , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[18]  Nhu Binh Ho,et al.  Evolving dispatching rules using genetic programming for solving multi-objective flexible job-shop problems , 2008, Comput. Ind. Eng..

[19]  Qingfu Zhang,et al.  MOEA/D: A Multiobjective Evolutionary Algorithm Based on Decomposition , 2007, IEEE Transactions on Evolutionary Computation.

[20]  Yingwu Chen,et al.  A Knowledge-Based Evolutionary Multiobjective Approach for Stochastic Extended Resource Investment Project Scheduling Problems , 2014, IEEE Transactions on Evolutionary Computation.

[21]  Bernd Scholz-Reiter,et al.  Evolutionary generation of dispatching rule sets for complex dynamic scheduling problems , 2013 .

[22]  Domagoj Jakobovic,et al.  Dynamic Scheduling with Genetic Programming , 2006, EuroGP.

[23]  Mark Johnston,et al.  Dynamic Multi-objective Job Shop Scheduling: A Genetic Programming Approach , 2013, Automated Scheduling and Planning.

[24]  Handing Wang,et al.  Data-Driven Surrogate-Assisted Multiobjective Evolutionary Optimization of a Trauma System , 2016, IEEE Transactions on Evolutionary Computation.

[25]  Chandrasekharan Rajendran,et al.  Efficient dispatching rules for scheduling in a job shop , 1997 .

[26]  Bernd Scholz-Reiter,et al.  Hyper-heuristic Evolution of Dispatching Rules: A Comparison of Rule Representations , 2015, Evolutionary Computation.

[27]  Mark Johnston,et al.  Evolving "less-myopic" scheduling rules for dynamic job shop scheduling with genetic programming , 2014, GECCO.

[28]  Philip Bille,et al.  A survey on tree edit distance and related problems , 2005, Theor. Comput. Sci..

[29]  Mario Vanhoucke,et al.  A comparison of priority rules for the job shop scheduling problem under different flow time- and tardiness-related objective functions , 2012 .

[30]  Mark Johnston,et al.  A Computational Study of Representations in Genetic Programming to Evolve Dispatching Rules for the Job Shop Scheduling Problem , 2013, IEEE Transactions on Evolutionary Computation.

[31]  Christopher D. Geiger,et al.  Learning effective dispatching rules for batch processor scheduling , 2008 .

[32]  Kazuo Miyashita,et al.  Improving Performance of GP by Adaptive Terminal Selection , 2000, PRICAI.

[33]  Kalyan Veeramachaneni,et al.  Learning regression ensembles with genetic programming at scale , 2013, GECCO '13.

[34]  Yim Mei Fast Bi-Objective Feature Selection Using Entropy Measures and Bayesian Inference , 2016 .

[35]  Jing J. Liang,et al.  Niching particle swarm optimization with local search for multi-modal optimization , 2012, Inf. Sci..

[36]  Chandrasekharan Rajendran,et al.  A comparative study of dispatching rules in dynamic flowshops and jobshops , 1999, Eur. J. Oper. Res..

[37]  David E. Goldberg,et al.  Genetic Algorithms with Sharing for Multimodalfunction Optimization , 1987, ICGA.

[38]  Ben Niu,et al.  Improving generalisation of genetic programming for high-dimensional symbolic regression with feature selection , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[39]  Chandrasekharan Rajendran,et al.  Efficient jobshop dispatching rules: Further developments , 2000 .

[40]  Domagoj Jakobovic,et al.  Evolving priority scheduling heuristics with genetic programming , 2012, Appl. Soft Comput..

[41]  Dana H. Ballard,et al.  Genetic Programming with Adaptive Representations , 1994 .

[42]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[43]  Kaizhong Zhang,et al.  Simple Fast Algorithms for the Editing Distance Between Trees and Related Problems , 1989, SIAM J. Comput..

[44]  Alexander Mendiburu,et al.  A Distance-Based Ranking Model Estimation of Distribution Algorithm for the Flowshop Scheduling Problem , 2014, IEEE Transactions on Evolutionary Computation.

[45]  Yi Mei,et al.  Feature Selection in Evolving Job Shop Dispatching Rules with Genetic Programming , 2016, GECCO.

[46]  Milton L. Smith,et al.  Simulation studies in job shop scheduling—II: Performance of priority rules , 1984 .

[47]  Huan Liu,et al.  Toward integrating feature selection algorithms for classification and clustering , 2005, IEEE Transactions on Knowledge and Data Engineering.

[48]  Samir W. Mahfoud Niching methods for genetic algorithms , 1996 .

[49]  Jürgen Branke,et al.  On Using Surrogates with Genetic Programming , 2015, Evolutionary Computation.

[50]  Michel Gendreau,et al.  Hyper-heuristics: a survey of the state of the art , 2013, J. Oper. Res. Soc..

[51]  Xin Yao,et al.  A Survey on Evolutionary Computation Approaches to Feature Selection , 2016, IEEE Transactions on Evolutionary Computation.

[52]  Michael Pinedo,et al.  Scheduling: Theory, Algorithms, and Systems , 1994 .

[53]  Yaochu Jin,et al.  Surrogate-assisted evolutionary computation: Recent advances and future challenges , 2011, Swarm Evol. Comput..

[54]  Alain Pétrowski,et al.  A clearing procedure as a niching method for genetic algorithms , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[55]  Mengjie Zhang,et al.  Particle Swarm Optimization for Feature Selection in Classification: A Multi-Objective Approach , 2013, IEEE Transactions on Cybernetics.

[56]  Mengjie Zhang,et al.  Automated Design of Production Scheduling Heuristics: A Review , 2016, IEEE Transactions on Evolutionary Computation.

[57]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[58]  Georges R. Harik,et al.  Finding Multimodal Solutions Using Restricted Tournament Selection , 1995, ICGA.

[59]  Ranga V. Ramasesh Dynamic job shop scheduling: A survey of simulation research , 1990 .