Evolutionary Learning Based Simulation Optimization for Stochastic Job Shop Scheduling Problems

Abstract Simulation Optimization (SO) techniques refer to a set of methods that have been applied to stochastic optimization problems, structured so that the optimizer(s) are integrated with simulation experiments. Although SO techniques provide promising solutions for large and complex stochastic problems, the simulation model execution is potentially expensive in terms of computation time. Thus, the overall purpose of this research is to advance the evolutionary SO methods literature by researching the use of metamodeling within these techniques. Accordingly, we present a new Evolutionary Learning Based Simulation Optimization (ELBSO) method embedded within Ordinal Optimization. In ELBSO a Machine Learning (ML) based simulation metamodel is created using Genetic Programming (GP) to replace simulation experiments aimed at reducing computation. ELBSO is evaluated on a Stochastic Job Shop Scheduling Problem (SJSSP), which is a well known complex production planning problem in most industries such as semiconductor manufacturing. To build the metamodel from SJSSP instances that replace simulation replications, we employ a novel training vector to train GP. This then is integrated into an evolutionary two-phased Ordinal Optimization approach to optimize an SJSSP which forms the ELBSO method. Using a variety of experimental SJSSP instances, ELBSO is compared with evolutionary optimization methods from the literature and typical dispatching rules. Our findings include the superiority of ELBSO over all other algorithms in terms of the quality of solutions and computation time. Furthermore, the integrated procedures and results provided within this article establish a basis for future SO applications to large and complex stochastic problems.

[1]  Cathal Heavey,et al.  A comparison of genetic programming and artificial neural networks in metamodeling of discrete-event simulation models , 2012, Comput. Oper. Res..

[2]  Shiji Song,et al.  hybrid differential evolution algorithm for job shop scheduling problems with xpected total tardiness criterion , 2013 .

[3]  Nikolay Tchernev,et al.  A metaheuristic based on simulation for stochastic Job-shop optimization , 2015, 2015 International Conference on Industrial Engineering and Systems Management (IESM).

[4]  Ruhul A. Sarker,et al.  Genetic algorithm for job-shop scheduling with machine unavailability and breakdowns , 2011 .

[5]  Wei Chen,et al.  Graph-based machine learning algorithm with application in data mining , 2017, 2017 Third International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN).

[6]  Amin Jamili,et al.  Job shop scheduling with consideration of floating breaking times under uncertainty , 2019, Eng. Appl. Artif. Intell..

[7]  Cathal Heavey,et al.  Optimizing capacity allocation in semiconductor manufacturing photolithography area – Case study: Robert Bosch , 2020 .

[8]  Hans-Paul Schwefel,et al.  Evolution strategies – A comprehensive introduction , 2002, Natural Computing.

[9]  Mehmet Fatih Tasgetiren,et al.  Artificial bee colony algorithm for scheduling and rescheduling fuzzy flexible job shop problem with new job insertion , 2016, Knowl. Based Syst..

[10]  Jing Liu,et al.  Ensemble multi-objective evolutionary algorithm for gene regulatory network reconstruction based on fuzzy cognitive maps , 2019, CAAI Trans. Intell. Technol..

[11]  Huaguang Zhang,et al.  Chaotic Dynamics in Smart Grid and Suppression Scheme via Generalized Fuzzy Hyperbolic Model , 2014 .

[12]  Sheik Meeran,et al.  Deterministic job-shop scheduling: Past, present and future , 1999, Eur. J. Oper. Res..

[13]  Yi Mei,et al.  Genetic programming for production scheduling: a survey with a unified framework , 2017, Complex & Intelligent Systems.

[14]  Rajan Suri,et al.  An overview of evaluative models for flexible manufacturing systems , 1985 .

[15]  A. A. Cunningham,et al.  Decision analysis for job shop scheduling , 1973 .

[16]  Y. Ho,et al.  Ordinal Optimization: Soft Optimization for Hard Problems , 2007 .

[17]  Mitsuo Gen,et al.  Effective multiobjective EDA for bi-criteria stochastic job-shop scheduling problem , 2017, J. Intell. Manuf..

[18]  Quan-Ke Pan,et al.  A hybrid local-search algorithm for robust job-shop scheduling under scenarios , 2018, Appl. Soft Comput..

[19]  Cathal Heavey,et al.  IMPLEMENTING A NEW GENETIC ALGORITHM TO SOLVE THE CAPACITY ALLOCATION PROBLEM IN THE PHOTOLITHOGRAPHY AREA , 2018, 2018 Winter Simulation Conference (WSC).

[20]  Amir Ghasemi,et al.  A multi-objective and integrated model for supply chain scheduling optimization in a multi-site manufacturing system , 2017 .

[21]  M. Beheshtinia,et al.  Supply chain scheduling and routing in multi-site manufacturing system (case study: a drug manufacturing company) , 2017 .

[22]  M. Sakawa,et al.  An efficient genetic algorithm for job-shop scheduling problems with fuzzy processing time and fuzzy duedate , 1999 .

[23]  Deming Lei,et al.  Simplified multi-objective genetic algorithms for stochastic job shop scheduling , 2011, Appl. Soft Comput..

[24]  Pedro Amorim,et al.  Optimizing Dispatching Rules for Stochastic Job Shop Scheduling , 2018, HIS.

[25]  Cathal Heavey,et al.  Comparison of experimental designs for simulation-based symbolic regression of manufacturing systems , 2011, Comput. Ind. Eng..

[26]  Ajai Jain,et al.  Performance analysis of dispatching rules in a stochastic dynamic job shop manufacturing system with sequence-dependent setup times: Simulation approach , 2015 .

[27]  S. C. Kim,et al.  Scheduling jobs with uncertain setup times and sequence dependency , 1997 .

[28]  Mahmoud Efatmaneshnik,et al.  A probabilistic approach to the Stochastic Job-Shop Scheduling problem , 2018 .

[29]  Deming Lei Pareto archive particle swarm optimization for multi-objective fuzzy job shop scheduling problems , 2008 .

[30]  Sanja Petrovic,et al.  Fuzzy job shop scheduling with lot-sizing , 2008, Ann. Oper. Res..

[31]  Han Hoogeveen,et al.  Finding Robust Solutions for the Stochastic Job Shop Scheduling Problem by Including Simulation in Local Search , 2013, SEA.

[32]  Mohammad Mehdi Ebadzadeh,et al.  Statistical genetic programming for symbolic regression , 2017, Appl. Soft Comput..

[33]  Michael Pinedo On the Computational Complexity of Stochastic Scheduling Problems , 1982 .

[34]  Shih-Cheng Horng,et al.  Embedding evolutionary strategy in ordinal optimization for hard optimization problems , 2012 .

[35]  Yuanguo Zhu,et al.  Chance-constrained model for uncertain job shop scheduling problem , 2016, Soft Comput..

[36]  Ran Liu,et al.  A survey on simulation optimization for the manufacturing system operation , 2018 .

[37]  Jatoth Mohan,et al.  A Review of Dynamic Job Shop Scheduling Techniques , 2019, Procedia Manufacturing.

[38]  Yi-Kuei Lin,et al.  Bi-objective optimization for a multistate job-shop production network using NSGA-II and TOPSIS , 2019, Journal of Manufacturing Systems.

[39]  Shih-Cheng Horng,et al.  Evolutionary algorithm for stochastic job shop scheduling with random processing time , 2012, Expert Syst. Appl..

[40]  Dimitri Golenko-Ginzburg,et al.  Industrial job-shop scheduling with random operations and different priorities , 1995 .

[41]  Michael Pinedo,et al.  Scheduling: Theory, Algorithms, and Systems , 1994 .

[42]  Yuichi Mori,et al.  Handbook of computational statistics : concepts and methods , 2004 .

[43]  Ranga V. Ramasesh Dynamic job shop scheduling: A survey of simulation research , 1990 .

[44]  Shudong Sun,et al.  Optimal Computing Budget Allocation for Ordinal Optimization in Solving Stochastic Job Shop Scheduling Problems , 2014 .

[45]  S. Horng,et al.  Integrating Ant Colony System and Ordinal Optimization for Solving Stochastic Job Shop Scheduling Problem , 2015, 2015 6th International Conference on Intelligent Systems, Modelling and Simulation.

[46]  John R. Koza,et al.  Genetic programming as a means for programming computers by natural selection , 1994 .

[47]  Jinwei Gu,et al.  A novel competitive co-evolutionary quantum genetic algorithm for stochastic job shop scheduling problem , 2010, Comput. Oper. Res..

[48]  Heungsun Park,et al.  Relative-error prediction , 1998 .

[49]  Chang Shu,et al.  Hybrid meta-model based search method for expensive problems , 2019, Appl. Soft Comput..

[50]  Jian Zhang,et al.  Review of job shop scheduling research and its new perspectives under Industry 4.0 , 2017, Journal of Intelligent Manufacturing.

[51]  Fabian Dunke,et al.  Neural networks for the metamodeling of simulation models with online decision making , 2020, Simul. Model. Pract. Theory.

[52]  Bernardo Almada-Lobo,et al.  Hybrid simulation-optimization methods: A taxonomy and discussion , 2014, Simul. Model. Pract. Theory.

[53]  Cathal Heavey,et al.  A REVIEW OF SIMULATION-OPTIMIZATION METHODS WITH APPLICATIONS TO SEMICONDUCTOR OPERATIONAL PROBLEMS , 2018, 2018 Winter Simulation Conference (WSC).

[54]  Xinchang Hao,et al.  Advances in Hybrid Metaheuristics for Stochastic Manufacturing Scheduling: Part I Models and Methods , 2017 .