Multi-Agent Based Hyper-Heuristics for Multi-Objective Flexible Job Shop Scheduling: A Case Study in an Aero-Engine Blade Manufacturing Plant

In the paper, a case study focusing on multi-objective flexible job shop scheduling problem (MO-FJSP) in an aero-engine blade manufacturing plant is presented. The problem considered in this paper involves many attributes, including working calendar, due dates, and lot size. Moreover, dynamic events occur frequently in the shop-floor, making the problem more challenging and requiring real-time responses. Therefore, the priority-based methods are more suitable than the computationally intensive search-based methods for the online scheduling. However, developing an effective heuristic for online scheduling problem is a tedious work even for domain experts. Furthermore, the domain knowledge of the practical production scheduling needs to be integrated into the algorithm to guide the search direction, accelerate the convergence of the algorithm, and improve the solution quality. To this end, three multi-agent-based hyper-heuristics (MAHH) integrated with the prior knowledge of the shop floor are proposed to evolve scheduling policies (SPs) for the online scheduling problem. To evaluate the performance of evolved SPs, a 5-fold cross-validation method which is frequently used in machine learning is adopted to avoid the overfitting problem. Both the training and test results demonstrate that the bottleneck-agent-based hyper-heuristic method produces the best result among the three MAHH methods. Furthermore, both the effectiveness and the efficiency of the evolved SPs are verified by comparison with the well-known heuristics and two multi-objective particle swarm optimization (MOPSO) algorithms on the practical case. The proposed method has been embedded in the manufacturing execution system that is built on JAVA and successfully applied in several manufacturing plants.

[1]  Adil Baykasoglu,et al.  A multi-agent based approach to dynamic scheduling of machines and automated guided vehicles in manufacturing systems , 2012, Appl. Soft Comput..

[2]  Lihui Wang,et al.  Current status and advancement of cyber-physical systems in manufacturing , 2015 .

[3]  Sanja Petrovic,et al.  A new dispatching rule based genetic algorithm for the multi-objective job shop problem , 2010, J. Heuristics.

[4]  Shih-Wei Lin,et al.  Effective dynamic dispatching rule and constructive heuristic for solving single-machine scheduling problems with a common due window , 2017, Int. J. Prod. Res..

[5]  Rong-Ho Lin,et al.  Meta-heuristic algorithms for wafer sorting scheduling problems , 2011, J. Oper. Res. Soc..

[6]  Hua Xu,et al.  Multiobjective Flexible Job Shop Scheduling Using Memetic Algorithms , 2015, IEEE Transactions on Automation Science and Engineering.

[7]  S. S. Mahapatra,et al.  Particle swarm optimization algorithm embedded with maximum deviation theory for solving multi-objective flexible job shop scheduling problem , 2016 .

[8]  Banu Çalis,et al.  A research survey: review of AI solution strategies of job shop scheduling problem , 2013, Journal of Intelligent Manufacturing.

[9]  Przemyslaw Korytkowski,et al.  An evolutionary simulation-based optimization approach for dispatching scheduling , 2013, Simul. Model. Pract. Theory.

[10]  Mark Johnston,et al.  Evolving machine-specific dispatching rules for a two-machine job shop using genetic programming , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[11]  Zhi-Hua Hu,et al.  Path-relinking Tabu search for the multi-objective flexible job shop scheduling problem , 2014, Comput. Oper. Res..

[12]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[13]  Wei Xiong,et al.  A new immune multi-agent system for the flexible job shop scheduling problem , 2018, J. Intell. Manuf..

[14]  Lin Lin,et al.  Multiobjective evolutionary algorithm for manufacturing scheduling problems: state-of-the-art survey , 2014, J. Intell. Manuf..

[15]  Bernd Scholz-Reiter,et al.  Hyper-heuristic Evolution of Dispatching Rules: A Comparison of Rule Representations , 2015, Evolutionary Computation.

[16]  Xin Yao,et al.  Mathematical modeling and multi-objective evolutionary algorithms applied to dynamic flexible job shop scheduling problems , 2015, Inf. Sci..

[17]  Lei Ren,et al.  Cloud manufacturing: key characteristics and applications , 2017, Int. J. Comput. Integr. Manuf..

[18]  Yibing Li,et al.  An Efficient Meta-Heuristic for Multi-Objective Flexible Job Shop Inverse Scheduling Problem , 2018, IEEE Access.

[19]  Kai Ding,et al.  RFID-enabled social manufacturing system for inter-enterprise monitoring and dispatching of integrated production and transportation tasks , 2018 .

[20]  Salwani Abdullah,et al.  Fuzzy job-shop scheduling problems: A review , 2014, Inf. Sci..

[21]  Adil Baykasoglu,et al.  Dynamic virtual cellular manufacturing through agent-based modelling , 2017, Int. J. Comput. Integr. Manuf..

[22]  Jing Huang,et al.  A dispatching rule-based genetic algorithm for multi-objective job shop scheduling using fuzzy satisfaction levels , 2015, Comput. Ind. Eng..

[23]  Jin Wang,et al.  Game theory based real-time multi-objective flexible job shop scheduling considering environmental impact , 2017 .

[24]  Sanja Petrovic,et al.  SURVEY OF DYNAMIC SCHEDULING IN MANUFACTURING SYSTEMS , 2006 .

[25]  Dimitris Mourtzis,et al.  A cloud-based cyber-physical system for adaptive shop-floor scheduling and condition-based maintenance , 2018 .

[26]  Yi Mei,et al.  Genetic programming for production scheduling: a survey with a unified framework , 2017, Complex & Intelligent Systems.

[27]  Bozena Skolud,et al.  A hybrid multi-objective immune algorithm for predictive and reactive scheduling , 2017, J. Sched..

[28]  Jian-jun Yang,et al.  Flexible job-shop scheduling with flexible workdays, preemption, overlapping in operations and satisfaction criteria: an industrial application , 2016 .

[29]  Bernd Scholz-Reiter,et al.  Towards improved dispatching rules for complex shop floor scenarios: a genetic programming approach , 2010, GECCO '10.

[30]  Nasser Mebarki,et al.  Data mining based job dispatching using hybrid simulation-optimization approach for shop scheduling problem , 2012, Eng. Appl. Artif. Intell..

[31]  Lale Özbakir,et al.  Using multiple objective tabu search and grammars to model and solve multi-objective flexible job shop scheduling problems , 2004, J. Intell. Manuf..

[32]  Ling Wang,et al.  A knowledge-guided fruit fly optimization algorithm for dual resource constrained flexible job-shop scheduling problem , 2016 .

[33]  Paolo Brandimarte,et al.  Routing and scheduling in a flexible job shop by tabu search , 1993, Ann. Oper. Res..

[34]  Andrew Kusiak,et al.  Data-driven smart manufacturing , 2018, Journal of Manufacturing Systems.

[35]  Kazuo Miyashita,et al.  Job-shop scheduling with genetic programming , 2000 .

[36]  Antonio J. Nebro,et al.  SMPSO : A New PSO Metaheuristic for Multi-objective Optimization , 2009 .

[37]  Chao Lu,et al.  A hybrid multi-objective grey wolf optimizer for dynamic scheduling in a real-world welding industry , 2017, Eng. Appl. Artif. Intell..

[38]  Carlos A. Coello Coello,et al.  Handling multiple objectives with particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[39]  Xun Xu,et al.  From cloud computing to cloud manufacturing , 2012 .

[40]  Thomas Philip Runarsson,et al.  Discovering dispatching rules from data using imitation learning: A case study for the job-shop problem , 2018, J. Sched..

[41]  Adil Baykasoğlu,et al.  Linguistic-based meta-heuristic optimization model for flexible job shop scheduling , 2002 .

[42]  Adil Baykasoğlu,et al.  Dynamic scheduling of parallel heat treatment furnaces: A case study at a manufacturing system , 2018 .

[43]  Cheng Wu,et al.  A dispatching rule-based hybrid genetic algorithm focusing on non-delay schedules for the job shop scheduling problem , 2013 .

[44]  Ahmed Chiheb Ammari,et al.  An effective and distributed particle swarm optimization algorithm for flexible job-shop scheduling problem , 2015, Journal of Intelligent Manufacturing.

[45]  Vahit Kaplanoğlu,et al.  A Multi-Agent Based Approach to Dynamic Scheduling of Machines and Automated Guided Vehicles (AGV) in Manufacturing Systems by Considering AGV Breakdowns , 2014 .

[46]  Domagoj Jakobovic,et al.  Comparison of ensemble learning methods for creating ensembles of dispatching rules for the unrelated machines environment , 2018, Genetic Programming and Evolvable Machines.

[47]  Mark Johnston,et al.  Automatic Design of Scheduling Policies for Dynamic Multi-objective Job Shop Scheduling via Cooperative Coevolution Genetic Programming , 2014, IEEE Transactions on Evolutionary Computation.

[48]  Jason R. Schott Fault Tolerant Design Using Single and Multicriteria Genetic Algorithm Optimization. , 1995 .

[49]  Michel Gendreau,et al.  Hyper-heuristics: a survey of the state of the art , 2013, J. Oper. Res. Soc..

[50]  Ling Wang,et al.  A Pareto-based estimation of distribution algorithm for the multi-objective flexible job-shop scheduling problem , 2013 .

[51]  Quan-Ke Pan,et al.  Discrete harmony search algorithm for flexible job shop scheduling problem with multiple objectives , 2016, J. Intell. Manuf..

[52]  Domagoj Jakobovic,et al.  Adaptive scheduling on unrelated machines with genetic programming , 2016, Appl. Soft Comput..

[53]  Liang Gao,et al.  An effective multi-objective discrete virus optimization algorithm for flexible job-shop scheduling problem with controllable processing times , 2017, Comput. Ind. Eng..

[54]  Marco Laumanns,et al.  SPEA2: Improving the strength pareto evolutionary algorithm , 2001 .

[55]  Bernd Scholz-Reiter,et al.  Evolutionary generation of dispatching rule sets for complex dynamic scheduling problems , 2013 .

[56]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[57]  Yong Zhou,et al.  Robust scheduling for multi-objective flexible job-shop problems with flexible workdays , 2016 .

[58]  Miao Li,et al.  A Hyperheuristic Approach for Intercell Scheduling With Single Processing Machines and Batch Processing Machines , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[59]  Mengjie Zhang,et al.  Automated Design of Production Scheduling Heuristics: A Review , 2016, IEEE Transactions on Evolutionary Computation.

[60]  Ying Han,et al.  Robustness measures and robust scheduling for multi-objective stochastic flexible job shop scheduling problems , 2017, Soft Comput..

[61]  Wei Liu,et al.  A new double flexible job-shop scheduling problem integrating processing time, green production, and human factor indicators , 2018 .

[62]  Jinde Cao,et al.  A Hybrid Pareto-Based Tabu Search for the Distributed Flexible Job Shop Scheduling Problem With E/T Criteria , 2018, IEEE Access.

[63]  Christopher D. Geiger,et al.  Learning effective dispatching rules for batch processor scheduling , 2008 .

[64]  Quan-Ke Pan,et al.  A hybrid artificial bee colony algorithm for a flexible job shop scheduling problem with overlapping in operations , 2018, Int. J. Prod. Res..

[65]  Kun Chen,et al.  Two-generation Pareto ant colony algorithm for multi-objective job shop scheduling problem with alternative process plans and unrelated parallel machines , 2015, Journal of Intelligent Manufacturing.

[66]  Liang Gao,et al.  An effective hybrid particle swarm optimization algorithm for multi-objective flexible job-shop scheduling problem , 2009, Comput. Ind. Eng..

[67]  Quan-Ke Pan,et al.  Pareto-based grouping discrete harmony search algorithm for multi-objective flexible job shop scheduling , 2014, Inf. Sci..

[68]  Jürgen Branke,et al.  Dynamic adjustment of dispatching rule parameters in flow shops with sequence-dependent set-up times , 2016 .

[69]  Gholam R. Amin,et al.  A minimax linear programming model for dispatching rule selection , 2018, Comput. Ind. Eng..

[70]  Tom Page,et al.  A hybrid discrete firefly algorithm for solving multi-objective flexible job shop scheduling problems , 2015, Int. J. Bio Inspired Comput..

[71]  Liang Gao,et al.  A GEP-based reactive scheduling policies constructing approach for dynamic flexible job shop scheduling problem with job release dates , 2013, J. Intell. Manuf..

[72]  Fangfang Zhang,et al.  Surrogate-Assisted Genetic Programming for Dynamic Flexible Job Shop Scheduling , 2018, Australasian Conference on Artificial Intelligence.

[73]  Zhuoning Chen,et al.  An effective detailed operation scheduling in MES based on hybrid genetic algorithm , 2018, J. Intell. Manuf..

[74]  Abid Ali Khan,et al.  A research survey: review of flexible job shop scheduling techniques , 2016, Int. Trans. Oper. Res..

[75]  Qiong Liu,et al.  A hybrid fruit fly algorithm for solving flexible job-shop scheduling to reduce manufacturing carbon footprint , 2017 .

[76]  Reha Uzsoy,et al.  Rapid Modeling and Discovery of Priority Dispatching Rules: An Autonomous Learning Approach , 2006, J. Sched..

[77]  Davood Golmohammadi,et al.  A neural network decision-making model for job-shop scheduling , 2013 .

[78]  Carlos A. Coello Coello,et al.  Solving Multiobjective Optimization Problems Using an Artificial Immune System , 2005, Genetic Programming and Evolvable Machines.

[79]  Quan-Ke Pan,et al.  An effective shuffled frog-leaping algorithm for multi-objective flexible job shop scheduling problems , 2012, Appl. Math. Comput..

[80]  Lihui Wang,et al.  Big data analytics based fault prediction for shop floor scheduling , 2017 .

[81]  Dazhong Wu,et al.  Deep learning for smart manufacturing: Methods and applications , 2018, Journal of Manufacturing Systems.

[82]  Kejia Zhuang,et al.  Hybrid artificial bee colony algorithm with a rescheduling strategy for solving flexible job shop scheduling problems , 2017, Comput. Ind. Eng..

[83]  Adil Baykasoğlu,et al.  Analyzing the effect of dispatching rules on the scheduling performance through grammar based flexible scheduling system , 2010 .

[84]  Yong Zhou,et al.  Hyper-Heuristic Coevolution of Machine Assignment and Job Sequencing Rules for Multi-Objective Dynamic Flexible Job Shop Scheduling , 2019, IEEE Access.

[85]  Hongzhi Liu,et al.  An improved artificial bee colony algorithm , 2013, 2013 25th Chinese Control and Decision Conference (CCDC).

[86]  Ikou Kaku,et al.  A Hybrid Evolutionary Hyper-Heuristic Approach for Intercell Scheduling Considering Transportation Capacity , 2016, IEEE Transactions on Automation Science and Engineering.

[87]  Adiel Teixeira de Almeida,et al.  A multi-attribute, rank-dependent utility model for selecting dispatching rules , 2018 .

[88]  Adil Baykasoglu,et al.  A multi-agent based approach to dynamic scheduling with flexible processing capabilities , 2017, J. Intell. Manuf..

[89]  Mitsuo Gen,et al.  Hybrid evolutionary optimisation with learning for production scheduling: state-of-the-art survey on algorithms and applications , 2018, Int. J. Prod. Res..

[90]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[91]  C. Coello,et al.  Improving PSO-based Multi-Objective Optimization using Crowding , Mutation and �-Dominance , 2005 .

[92]  Sean Luke,et al.  A Comparison of Bloat Control Methods for Genetic Programming , 2006, Evolutionary Computation.

[93]  Na Li,et al.  Semiconductor final test scheduling with Sarsa(λ, k) algorithm , 2011, Eur. J. Oper. Res..

[94]  Axel Tuma,et al.  On the flexibility of a decision theory-based heuristic for single machine scheduling , 2019, Comput. Oper. Res..

[95]  Deming Lei,et al.  A shuffled frog-leaping algorithm for flexible job shop scheduling with the consideration of energy consumption , 2017, Int. J. Prod. Res..

[96]  Xinyu Li,et al.  An effective hybrid genetic algorithm and tabu search for flexible job shop scheduling problem , 2016 .

[97]  Ch. Ratnam,et al.  An effective hybrid multi objective evolutionary algorithm for solving real time event in flexible job shop scheduling problem , 2018 .

[98]  Adil Baykasoğlu,et al.  Solving comprehensive dynamic job shop scheduling problem by using a GRASP-based approach , 2017, Int. J. Prod. Res..

[99]  Gary B. Lamont,et al.  Multiobjective evolutionary algorithm test suites , 1999, SAC '99.

[100]  Chao Zhang,et al.  Application of Grey Wolf Optimization for Solving Combinatorial Problems: Job Shop and Flexible Job Shop Scheduling Cases , 2018, IEEE Access.

[101]  Sicheng Zhang,et al.  Flexible job-shop scheduling/rescheduling in dynamic environment: a hybrid MAS/ACO approach , 2017, Int. J. Prod. Res..

[102]  Domagoj Jakobovic,et al.  A survey of dispatching rules for the dynamic unrelated machines environment , 2018, Expert Syst. Appl..

[103]  S. Karthikeyan,et al.  A hybrid discrete firefly algorithm for multi-objective flexible job shop scheduling problem with limited resource constraints , 2014, The International Journal of Advanced Manufacturing Technology.