Coupling of centralized and decentralized scheduling for robust production in agile production systems

Abstract Individualized products and timely delivery require agile just-in-time manufacturing operations. Scheduling needs to deliver a robust performance with high and stable results even when facing disruptions such as machine failures. Existing approaches often generate predictive schedules and adjust them reactively as disturbances occur. However, the effectiveness of rescheduling approaches highly depends on the available degrees of freedom in the predictive schedule. In the proposed approach, a centralized robust scheduling procedure is coupled with a decentralized reinforcement learning algorithm in order to adjust the required degrees of freedom for a maximally efficient production control in real-time.

[1]  Sanjay Mehta,et al.  Predictable scheduling of a single machine subject to breakdowns , 1999, Int. J. Comput. Integr. Manuf..

[2]  Mohamed Haouari,et al.  Robust scheduling and robustness measures for the discrete time/cost trade-off problem , 2010, Eur. J. Oper. Res..

[3]  Alan S. Manne,et al.  On the Job-Shop Scheduling Problem , 1960 .

[4]  Martin A. Riedmiller,et al.  Distributed policy search reinforcement learning for job-shop scheduling tasks , 2012 .

[5]  Gary D. Scudder,et al.  Sequencing with Earliness and Tardiness Penalties: A Review , 1990, Oper. Res..

[6]  Zuobao Wu,et al.  Multiagent scheduling method with earliness and tardiness objectives in flexible job shops , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Hermann Lödding Handbook of Manufacturing Control , 2013 .

[8]  Robert H. Storer,et al.  Robustness Measures and Robust Scheduling for Job Shops , 1994 .

[9]  Sanja Petrovic,et al.  SURVEY OF DYNAMIC SCHEDULING IN MANUFACTURING SYSTEMS , 2006 .

[10]  Andrew G. Barto,et al.  Reinforcement learning , 1998 .

[11]  K. Feldmann,et al.  Highly flexible Assembly – Scope and Justification , 2001 .

[12]  R. Leus,et al.  The trade-off between stability and makespan in resource-constrained project scheduling , 2004 .

[13]  Ihsan Sabuncuoglu,et al.  Robustness and stability measures for scheduling: single-machine environment , 2008 .

[14]  Jian Xiong,et al.  Robust scheduling for multi-objective flexible job-shop problems with random machine breakdowns , 2013 .

[15]  Christian Rabitsch,et al.  Agile Produktion - Ein Produktionskonzept für gesteigerten Unternehmenserfolg in volatilen Zeiten , 2016 .

[16]  Ying Han,et al.  Robustness measures and robust scheduling for multi-objective stochastic flexible job shop scheduling problems , 2017, Soft Comput..

[17]  Bart De Schutter,et al.  A Comprehensive Survey of Multiagent Reinforcement Learning , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  Sebastian Thiede,et al.  Simulation of matrix-structured manufacturing systems , 2015 .

[19]  Gisela Lanza,et al.  The Concept of Robustness in Production Systems and its Correlation to Disturbances , 2014 .