Multi Objective Dynamic Job Shop Scheduling using Composite Dispatching Rule and Reinforcement Learning

The applications of composite dispatching rules for multi objective dynamic scheduling have been widely studied in literature. In general, a composite dispatching rule is a combination of several elementary dispatching rules, which is designed to optimize multiple objectives of interest under a certain scheduling environment. The relative importance of elementary dispatching rules is modeled by weight factors. A critical issue for implementation of composite dispatching rule is that the inappropriate weight values may result in poor performance. This paper presents an offline scheduling knowledge acquisition method based on reinforcement learning using simulation technique. The scheduling knowledge is applied to adjust the appropriate weight values of elementary dispatching rules in composite manner with respect to work in process fluctuation of machines during online scheduling. Implementation of the proposed method in a two objectives dynamic job shop scheduling problem is demonstrated and the results are satisfactory.

[1]  V. Vinod,et al.  Scheduling a dynamic job shop production system with sequence-dependent setups: An experimental study , 2008 .

[2]  C. Hwang,et al.  Fuzzy Multiple Objective Decision Making: Methods And Applications , 1996 .

[3]  Ranga V. Ramasesh.  Dynamic job shop scheduling: A survey of simulation research , 1990 .

[4]  John W. Fowler,et al.  A new scheduling approach using combined dispatching criteria in wafer fabs , 2003 .

[5]  W. Cooper,et al.  Data Envelopment Analysis: A Comprehensive Text with Models, Applications, References and DEA-Solver Software , 1999 .

[6]  Mehmet Emin Aydin,et al.  Dynamic job-shop scheduling using reinforcement learning agents , 2000, Robotics Auton. Syst..

[7]  John W. Fowler,et al.  Multiple response optimization using mixture-designed experiments and desirability functions in semiconductor scheduling , 2003 .

[8]  R. Haupt,et al.  A survey of priority rule-based scheduling , 1989 .

[9]  Hao Wen Lin,et al.  Rule driven multi objective dynamic scheduling by data envelopment analysis and reinforcement learning , 2010, 2010 IEEE International Conference on Automation and Logistics.

[10]  Chinyao Low,et al.  Modelling and heuristics of FMS scheduling with multiple objectives , 2006, Comput. Oper. Res..

[11]  Yi-Chi Wang,et al.  Application of reinforcement learning for agent-based production scheduling , 2005, Eng. Appl. Artif. Intell..

[12]  Appa Iyer Sivakumar,et al.  Criteria selection and analysis for single machine dynamic on-line scheduling with multiple objectives and sequence-dependent setups , 2009, Comput. Ind. Eng..

[13]  S. S. Panwalkar,et al.  A Survey of Scheduling Rules , 1977, Oper. Res..

[14]  G. Ragatz,et al.  A simulation analysis of due date assignment rules , 1984 .