Particle swarm optimization and differential evolution for multi-objective multiple machine scheduling

Production scheduling is one of the most important issues in the planning and operation of manufacturing systems. Customers increasingly expect to receive the right product at the right price at the right time. Various problems experienced in manufacturing, for example low machine utilization and excessive work-in-process, can be attributed directly to inadequate scheduling. In this dissertation a production scheduling algorithm is developed for Optimatix, a South African-based company specializing in supply chain optimization. To address the complex requirements of the customer, the problem was modeled as a flexible job shop scheduling problem with sequence-dependent set-up times, auxiliary resources and production down time. The algorithm development process focused on investigating the application of both particle swarm optimization (PSO) and differential evolution (DE) to production scheduling environments characterized by multiple machines and multiple objectives. Alternative problem representations, algorithm variations and multi-objective optimization strategies were evaluated to obtain an algorithm which performs well against both existing rule-based algorithms and an existing complex flexible job shop scheduling solution strategy. Finally, the generality of the priority-based algorithm was evaluated by applying it to the scheduling of production and maintenance activities at Centurion Ice Cream and Sweets. The production environment was modeled as a multi-objective uniform parallel machine shop problem with sequence-dependent set-up times and unavailability intervals. A self-adaptive modified vector evaluated DE algorithm was developed and compared to classical PSO and DE vector evaluated algorithms. Promising results were obtained with respect to the suitability of the algorithms for solving a range of multi-objective multiple machine scheduling problems.

[1]  Mitsuo Gen,et al.  Multistage-Based Genetic Algorithm for Flexible Job-Shop Scheduling Problem , 2009 .

[2]  Jouni Lampinen,et al.  A Fuzzy Adaptive Differential Evolution Algorithm , 2005, Soft Comput..

[3]  Peter Brucker,et al.  Polynomial algorithms for resource-constrained and multiprocessor task scheduling problems , 1996 .

[4]  D. Harrison,et al.  The Application of Parallel Multipopulation Genetic Algorithms to Dynamic Job-Shop Scheduling , 2000 .

[5]  Ling Wang,et al.  An effective hybrid particle swarm optimization for no-wait flow shop scheduling , 2007 .

[6]  Erhan Kozan,et al.  Evolutionary Algorithms For Resource Constrained Non-Serial Mixed Flow Shops , 2003, Int. J. Comput. Intell. Appl..

[7]  Pierre Borne,et al.  Approach by localization and multiobjective evolutionary optimization for flexible job-shop scheduling problems , 2002, IEEE Trans. Syst. Man Cybern. Part C.

[8]  Krishna R. Pattipati,et al.  A practical approach to job-shop scheduling problems , 1993, IEEE Trans. Robotics Autom..

[9]  A. Land,et al.  An Automatic Method for Solving Discrete Programming Problems , 1960, 50 Years of Integer Programming.

[10]  M Reyes Sierra,et al.  Multi-Objective Particle Swarm Optimizers: A Survey of the State-of-the-Art , 2006 .

[11]  Mehmet Fatih Tasgetiren,et al.  Minimizing Total Earliness and Tardiness Penalties with a Common Due Date on a Single-Machine Using a Discrete Particle Swarm Optimization Algorithm , 2006, ANTS Workshop.

[12]  Andries Petrus Engelbrecht,et al.  Fundamentals of Computational Swarm Intelligence , 2005 .

[13]  Hitoshi Iba,et al.  Enhancing differential evolution performance with local search for high dimensional function optimization , 2005, GECCO '05.

[14]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[15]  Ling Wang,et al.  Scheduling multi-objective job shops using a memetic algorithm based on differential evolution , 2008 .

[16]  Ling Wang,et al.  No-idle permutation flow shop scheduling based on a hybrid discrete particle swarm optimization algorithm , 2008 .

[17]  Rakesh Angira,et al.  OPTIMIZATION OF NON-LINEAR FUNCTIONS USING EVOLUTIONARY COMPUTATION , 2002 .

[18]  David H. Wolpert,et al.  No free lunch theorems for optimization , 1997, IEEE Trans. Evol. Comput..

[19]  Scott J. Mason,et al.  Scheduling complex job shops using disjunctive graphs: A cycle elimination procedure , 2003 .

[20]  Jianguo Yang,et al.  Study on job shop scheduling with sequence-dependent setup times using biological immune algorithm , 2006 .

[21]  Ling Wang,et al.  An effective hybrid PSO-based algorithm for flow shop scheduling with limited buffers , 2008, Comput. Oper. Res..

[22]  Mehmet Fatih Tasgetiren,et al.  Particle swarm optimization algorithm for single machine total weighted tardiness problem , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[23]  S. S. Panwalkar,et al.  A Survey of Scheduling Rules , 1977, Oper. Res..

[24]  K. Preston White,et al.  Job-shop scheduling: limits of the binary disjunctive formulation , 1990 .

[25]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[26]  Camino R. Vela,et al.  Comparing Schedule Generation Schemes in Memetic Algorithms for the Job Shop Scheduling Problem with Sequence Dependent Setup Times , 2006, MICAI.

[27]  Andries Petrus Engelbrecht,et al.  Cooperative learning in neural networks using particle swarm optimizers , 2000, South Afr. Comput. J..

[28]  T.C.E. Cheng,et al.  A state-of-the-art review of parallel-machine scheduling research , 1990 .

[29]  Ajith Abraham,et al.  Variable Neighborhood Particle Swarm Optimization for Multi-objective Flexible Job-Shop Scheduling Problems , 2006, SEAL.

[30]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[31]  Jean-Charles Billaut,et al.  Production , Manufacturing and Logistics A genetic algorithm for an industrial multiprocessor flow shop scheduling problem with recirculation , 2004 .

[32]  Peter J. Bentley,et al.  Improvised music with swarms , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[33]  John W. Fowler,et al.  A modified shifting bottleneck heuristic for minimizing total weighted tardiness in complex job shops , 2002 .

[34]  Ronald L. Rardin,et al.  Optimization in operations research , 1997 .

[35]  Chung-Yee Lee,et al.  Machine Scheduling with Availability Constraints , 2004, Handbook of Scheduling.

[36]  Yi Hong,et al.  A Hybrid Approach Based on Artificial Neural Network and Genetic Algorithm for Job-shop Scheduling Problem , 2005, 2005 International Conference on Neural Networks and Brain.

[37]  Wen-Hwa Yang,et al.  Survey of scheduling research involving setup times , 1999, Int. J. Syst. Sci..

[38]  Yaochu Jin,et al.  Dynamic Weighted Aggregation for evolutionary multi-objective optimization: why does it work and how? , 2001 .

[39]  Vidyaranya B. Gargeya,et al.  Scheduling research in multiple resource constrained job shops: a review and critique , 1996 .

[40]  Dario Pacciarelli,et al.  A Rollout Metaheuristic for Job Shop Scheduling Problems , 2004, Ann. Oper. Res..

[41]  Bohuslav Růžek,et al.  Determination of the Earthquake Hypocenter: A Challenge for the Differential Evolution Algorithm , 2005 .

[42]  Jacek Blazewicz,et al.  The job shop scheduling problem: Conventional and new solution techniques , 1996 .

[43]  Thomas Stützle,et al.  Ant Colony Optimization Theory , 2004 .

[44]  Yuhui Shi,et al.  Particle swarm optimization: developments, applications and resources , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).

[45]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[46]  Hussein A. Abbass,et al.  A Memetic Pareto Evolutionary Approach to Artificial Neural Networks , 2001, Australian Joint Conference on Artificial Intelligence.

[47]  Massimo Paolucci,et al.  A new discrete particle swarm optimization approach for the single-machine total weighted tardiness scheduling problem with sequence-dependent setup times , 2009, Eur. J. Oper. Res..

[48]  Egon Balas,et al.  The Shifting Bottleneck Procedure for Job Shop Scheduling , 1988 .

[49]  G. Thompson,et al.  Algorithms for Solving Production-Scheduling Problems , 1960 .

[50]  Philippe Baptiste,et al.  Heuristic Control of a Constraint-Based Algorithm for the Preemptive Job-Shop Scheduling Problem , 1999, J. Heuristics.

[51]  Bin Jiao,et al.  A similar particle swarm optimization algorithm for permutation flowshop scheduling to minimize makespan , 2006, Appl. Math. Comput..

[52]  Mehmet Fatih Tasgetiren,et al.  A Discrete Differential Evolution Algorithm for the No-Wait Flowshop Scheduling Problem with Total Flowtime Criterion , 2007, 2007 IEEE Symposium on Computational Intelligence in Scheduling.

[53]  Jie Gao,et al.  A Hybrid of Genetic Algorithm and Bottleneck Shifting for Flexible Job-Shop Scheduling Problem , 2005 .

[54]  Fred W. Glover,et al.  Tabu Search - Part I , 1989, INFORMS J. Comput..

[55]  Taïcir Loukil,et al.  A multi-objective production scheduling case study solved by simulated annealing , 2007, Eur. J. Oper. Res..

[56]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[57]  James F. Frenzel,et al.  Training product unit neural networks with genetic algorithms , 1993, IEEE Expert.

[58]  Lawrence D. Fredendall,et al.  Information and scheduling in a dual resource constrained job shop , 1996 .

[59]  Hong Zhou,et al.  Using Genetic Algorithms and Heuristics for Job Shop Scheduling with Sequence-Dependent Setup Times , 2001, Ann. Oper. Res..

[60]  Joshua D. Knowles Local-search and hybrid evolutionary algorithms for Pareto optimization , 2002 .

[61]  Jinwoo Park,et al.  A new approach to job shop scheduling problems with due date constraints considering operation subcontracts , 2005 .

[62]  Jong-Bae Park,et al.  An Improved Particle Swarm Optimization for , 2010 .

[63]  Graham Kendall,et al.  A Tabu-Search Hyperheuristic for Timetabling and Rostering , 2003, J. Heuristics.

[64]  Jose M. Framiñan,et al.  Approximative procedures for no-wait job shop scheduling , 2003, Oper. Res. Lett..

[65]  Andries Petrus Engelbrecht,et al.  Empirical analysis of self-adaptive differential evolution , 2007, Eur. J. Oper. Res..

[66]  J. Grobler,et al.  A scheduling-specific modeling approach for real world scheduling , 2007, 2007 IEEE International Conference on Industrial Engineering and Engineering Management.

[67]  R. Storn,et al.  Differential Evolution: A Practical Approach to Global Optimization (Natural Computing Series) , 2005 .

[68]  Zhiming Wu,et al.  An effective hybrid optimization approach for multi-objective flexible job-shop scheduling problems , 2005, Comput. Ind. Eng..

[69]  Cliff T. Ragsdale,et al.  Modified differential evolution: a greedy random strategy for genetic recombination , 2005 .

[70]  Lothar Thiele,et al.  Comparison of Multiobjective Evolutionary Algorithms: Empirical Results , 2000, Evolutionary Computation.

[71]  J. C. Bean,et al.  A GENETIC ALGORITHM METHODOLOGY FOR COMPLEX SCHEDULING PROBLEMS , 1999 .

[72]  Marcos Singer,et al.  Forecasting policies for scheduling a stochastic due date job shop , 2000 .

[73]  A. G. Lockett,et al.  Technical Note - A Scheduling Problem Involving Sequence Dependent Changeover Times , 1972, Oper. Res..

[74]  M. Asano,et al.  Scheduling with shutdowns and sequence dependent set-up times , 1999 .

[75]  Ling Wang,et al.  Multi-objective Flow Shop Scheduling Using Differential Evolution , 2006 .

[76]  Jihui Zhang,et al.  A New Differential Evolution for Discontinuous Optimization Problems , 2007, Third International Conference on Natural Computation (ICNC 2007).

[77]  Andreas C. Nearchou,et al.  Differential evolution for sequencing and scheduling optimization , 2006, J. Heuristics.

[78]  R. Ramesh,et al.  Cyclic scheduling heuristics for a re-entrant job shop manufacturing environment , 2001 .

[79]  Ajith Abraham,et al.  A novel Variable Neighborhood Particle Swarm Optimization for multi-objective Flexible Job-Shop Scheduling Problems , 2007, 2007 2nd International Conference on Digital Information Management.

[80]  E.L. Lawler,et al.  Optimization and Approximation in Deterministic Sequencing and Scheduling: a Survey , 1977 .

[81]  Jaroslaw Sobieszczanski-Sobieski,et al.  Multidisciplinary optimization of a transport aircraft wing using particle swarm optimization , 2002 .

[82]  Hua-ping Chen,et al.  A New Multi-objective Fully-Informed Particle Swarm Algorithm for Flexible Job-Shop Scheduling Problems , 2007, 2007 International Conference on Computational Intelligence and Security Workshops (CISW 2007).

[83]  Kalyanmoy Deb,et al.  On self-adaptive features in real-parameter evolutionary algorithms , 2001, IEEE Trans. Evol. Comput..

[84]  Martin Rüttgers Differential Evolution : A Method for Optimization of real Scheduling Problems , 2022 .

[85]  M. N. Vrahatis,et al.  Particle swarm optimization method in multiobjective problems , 2002, SAC '02.

[86]  Sanja Petrovic,et al.  JOB SHOP SCHEDULING WITH LOT-SIZING AND BATCHING IN AN UNCERTAIN REAL-WORLD ENVIRONMENT , 2005 .

[87]  Kenji Onaga,et al.  Cyclic job-shop-scheduling based on evolutionary Petri nets , 2000, 2000 26th Annual Conference of the IEEE Industrial Electronics Society. IECON 2000. 2000 IEEE International Conference on Industrial Electronics, Control and Instrumentation. 21st Century Technologies.

[88]  N. Madavan Multiobjective optimization using a Pareto differential evolution approach , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[89]  Andreas C. Nearchou,et al.  A differential evolution approach for the common due date early/tardy job scheduling problem , 2008, Comput. Oper. Res..

[90]  Klaus Jansen,et al.  Approximation schemes for job shop scheduling problems with controllable processing times , 2005, Eur. J. Oper. Res..

[91]  Mauro Birattari,et al.  Swarm Intelligence , 2012, Lecture Notes in Computer Science.

[92]  D. Y. Sha,et al.  A hybrid particle swarm optimization for job shop scheduling problem , 2006, Comput. Ind. Eng..

[93]  Bin Jiao,et al.  A similar particle swarm optimization algorithm for job-shop scheduling to minimize makespan , 2006, Appl. Math. Comput..

[94]  Jatinder N. D. Gupta,et al.  A review of scheduling research involving setup considerations , 1999 .

[95]  Sheik Meeran,et al.  Deterministic job-shop scheduling: Past, present and future , 1999, Eur. J. Oper. Res..

[96]  Maurice Clerc,et al.  L'optimisation par essaim particulaire , 2002, Techniques et sciences informatiques.

[97]  Richard F. Hartl,et al.  Applying ant colony optimization to solve the single machine total tardiness problem , 1999 .

[98]  Ehl Emile Aarts,et al.  A computational study of constraint satisfaction for multiple capacitated job shop scheduling , 1996 .

[99]  Peter Brucker,et al.  Scheduling Algorithms , 1995 .

[100]  Christian Blum,et al.  An Ant Colony Optimization Algorithm for Shop Scheduling Problems , 2004, J. Math. Model. Algorithms.

[101]  Haibin Yu,et al.  Neural network and genetic algorithm-based hybrid approach to expanded job-shop scheduling , 2001 .

[102]  Pierre Borne,et al.  Pareto-optimality approach for flexible job-shop scheduling problems: hybridization of evolutionary algorithms and fuzzy logic , 2002, Math. Comput. Simul..

[103]  Godfrey C. Onwubolu,et al.  Scheduling flow shops using differential evolution algorithm , 2006, Eur. J. Oper. Res..

[104]  Mehmet Emin Aydin,et al.  Dynamic job-shop scheduling using reinforcement learning agents , 2000, Robotics Auton. Syst..

[105]  Graham Kendall,et al.  Hyper-Heuristics: An Emerging Direction in Modern Search Technology , 2003, Handbook of Metaheuristics.

[106]  Fawaz S. Al-Anzi,et al.  A self-adaptive differential evolution heuristic for two-stage assembly scheduling problem to minimize maximum lateness with setup times , 2007, Eur. J. Oper. Res..

[107]  V. Patel,et al.  Scheduling in dual-resources constrained manufacturing systems using genetic algorithms , 1999, 1999 7th IEEE International Conference on Emerging Technologies and Factory Automation. Proceedings ETFA '99 (Cat. No.99TH8467).

[108]  YoungSu Yun Genetic algorithm with fuzzy logic controller for preemptive and non-preemptive job-shop scheduling problems , 2002 .

[109]  Stéphane Dauzère-Pérès,et al.  An integrated approach for modeling and solving the general multiprocessor job-shop scheduling problem using tabu search , 1997, Ann. Oper. Res..

[110]  M. F. Tasgetiren,et al.  A hybrid discrete particle swarm optimization algorithm for the no-wait flow shop scheduling problem with makespan criterion , 2008 .

[111]  A. Engelbrecht,et al.  A new locally convergent particle swarm optimiser , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[112]  Weijun Xia,et al.  A hybrid particle swarm optimization approach for the job-shop scheduling problem , 2006 .

[113]  Arben Asllani,et al.  Job scheduling with dual criteria and sequence-dependent setups: mathematical versus genetic programming , 2004 .

[114]  Ailsa H. Land,et al.  An Automatic Method of Solving Discrete Programming Problems , 1960 .

[115]  Hark Hwang,et al.  Production sequencing problem with reentrant work flows and sequence dependent setup times , 1997 .

[116]  Zhang Wei,et al.  A new hybrid optimization algorithm for the job-shop scheduling problem , 2004, Proceedings of the 2004 American Control Conference.

[117]  Rémy Dupas,et al.  A genetic approach to solving the problem of cyclic job shop scheduling with linear constraints , 2005, Eur. J. Oper. Res..

[118]  Imtiaz Ahmad,et al.  Particle swarm optimization for task assignment problem , 2002, Microprocess. Microsystems.

[119]  Arthur C. Sanderson,et al.  Pareto-based multi-objective differential evolution , 2003, The 2003 Congress on Evolutionary Computation, 2003. CEC '03..

[120]  Yu-Fai Fung,et al.  Performance of Particle Swarm Optimization in Scheduling Hybrid Flow-Shops with Multiprocessor Tasks , 2007, ICCSA.

[121]  Graham Kendall,et al.  Search Methodologies: Introductory Tutorials in Optimization and Decision Support Techniques , 2013 .

[122]  Daniel Vanderpooten L'approche interactive dans l'aide multicritère à la décision : aspects conceptuels, méthodologiques et informatiques , 1990 .

[123]  Dario Pacciarelli,et al.  Job-shop scheduling with blocking and no-wait constraints , 2002, Eur. J. Oper. Res..

[124]  Ling Wang,et al.  A hybrid differential evolution method for permutation flow-shop scheduling , 2008 .

[125]  R. Storn,et al.  On the usage of differential evolution for function optimization , 1996, Proceedings of North American Fuzzy Information Processing.

[126]  Dirk C. Mattfeld,et al.  Evolutionary Search and the Job Shop - Investigations on Genetic Algorithms for Production Scheduling , 1996, Production and Logistics.

[127]  Carlos A. Brizuela,et al.  No-wait and blocking job-shops: challenging problems for GA's , 2001, 2001 IEEE International Conference on Systems, Man and Cybernetics. e-Systems and e-Man for Cybernetics in Cyberspace (Cat.No.01CH37236).

[128]  Michael Pinedo,et al.  A computational study of branch and bound techniques for minimizing the total weighted tardiness in job shops , 1998 .

[129]  Mostafa Zandieh,et al.  An immune algorithm approach to hybrid flow shops scheduling with sequence-dependent setup times , 2006, Appl. Math. Comput..

[130]  J. Kennedy,et al.  Population structure and particle swarm performance , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[131]  De-Ming Lei,et al.  An Efficient Evolutionary Algorithm for Multi-Objective Stochastic Job Shop Scheduling , 2007, 2007 International Conference on Machine Learning and Cybernetics.

[132]  Deming Lei,et al.  A Pareto archive particle swarm optimization for multi-objective job shop scheduling , 2008, Comput. Ind. Eng..

[133]  Peigen Li,et al.  A tabu search algorithm with a new neighborhood structure for the job shop scheduling problem , 2007, Comput. Oper. Res..

[134]  Y. Yoshitomi,et al.  A genetic algorithm and the Monte Carlo method for stochastic job‐shop scheduling , 2003 .

[135]  Jen-Shiang Chen,et al.  Integer programming models for the re-entrant shop scheduling problems , 2006 .

[136]  Mehmet Fatih Tasgetiren,et al.  A discrete differential evolution algorithm for the permutation flowshop scheduling problem , 2007, GECCO '07.

[137]  Jun Tang,et al.  An improved particle swarm optimization for multi-objective flexible job-shop scheduling problem , 2007, 2007 IEEE International Conference on Grey Systems and Intelligent Services.

[138]  Chris N. Potts,et al.  Scheduling with batching: A review , 2000, Eur. J. Oper. Res..

[139]  Rainer Storn,et al.  Differential Evolution – A Simple and Efficient Heuristic for global Optimization over Continuous Spaces , 1997, J. Glob. Optim..

[140]  Bo Liu,et al.  Hybrid Particle Swarm Optimization for Flow Shop Scheduling with Stochastic Processing Time , 2005, CIS.

[141]  M. G. A. Verhoeven,et al.  Tabu search for resource-constrained scheduling , 1998, Eur. J. Oper. Res..

[142]  Dimitris K. Tasoulis,et al.  Vector evaluated differential evolution for multiobjective optimization , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[143]  Mehmet Fatih Tasgetiren,et al.  A Discrete Differential Evolution Algorithm for the Total Earliness and Tardiness Penalties with a Common Due Date on a Single-Machine , 2007, 2007 IEEE Symposium on Computational Intelligence in Scheduling.

[144]  Fred Glover,et al.  Tabu Search - Part II , 1989, INFORMS J. Comput..

[145]  Chris N. Potts,et al.  Scheduling batches with simultaneous job processing for two-machine shop problems , 2001 .

[146]  Jean-Charles Billaut,et al.  Multicriteria scheduling , 2005, Eur. J. Oper. Res..

[147]  Peter Brucker,et al.  Tabu Search Algorithms for Cyclic Machine Scheduling Problems , 2005, J. Sched..

[148]  H. Abbass,et al.  PDE: a Pareto-frontier differential evolution approach for multi-objective optimization problems , 2001, Proceedings of the 2001 Congress on Evolutionary Computation (IEEE Cat. No.01TH8546).