Due date assignment using feedback control with reinforcement learning

Good due date assignment for an order requires the calculation of a time buffer that will account for the uncertainties associated with the arrival of future orders in a dynamic environment. This paper presents a method that controls the size of this time buffer for a discrete manufacturing system. The applicability of the method to an unrestricted class of discrete manufacturing systems is preserved by the use of a feedback control paradigm, and control knowledge is acquired using reinforcement learning. The current trajectory of the state of the shop is considered so that due date performance is improved during transient conditions. Results of simulation experiments demonstrate the effectiveness of the approach.

[1]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[2]  D. W. Trigg,et al.  Exponential Smoothing with an Adaptive Response Rate , 1967 .

[3]  Lotfi A. Zadeh,et al.  Fuzzy Algorithms , 1968, Inf. Control..

[4]  C. Jones An Economic Evaluation of Job Shop Dispatching Rules , 1973 .

[5]  Samuel Eilon,et al.  Due dates in job shop scheduling , 1976 .

[6]  E. L. Heard,et al.  Due-Dates and Instantaneous Load in the One-Machine Shop , 1976 .

[7]  P.J. King,et al.  The application of fuzzy control systems to industrial processes , 1977, Autom..

[8]  E. H. Mamdani,et al.  Application of Fuzzy Logic to Approximate Reasoning Using Linguistic Synthesis , 1976, IEEE Transactions on Computers.

[9]  James K. Weeks,et al.  A Methodology for Assigning Minimum Cost Due-Dates , 1977 .

[10]  V. Vemuri,et al.  Modeling of Complex Systems: An Introduction , 1978 .

[11]  James K. Weeks A Simulation Study of Predictable Due-Dates , 1979 .

[12]  Ebrahim H. Mamdani,et al.  A linguistic self-organizing process controller , 1979, Autom..

[13]  Abraham Seidmann,et al.  Due Date Assignment for Production Systems , 1981 .

[14]  K. R. Baker,et al.  An investigation of due-date assignment rules with constrained tightness , 1981 .

[15]  Abraham Seidmann,et al.  Due date selection procedures for job-shop simulation , 1983 .

[16]  Paul Bratley,et al.  A guide to simulation , 1983 .

[17]  J. Bertrand The Effect of Workload Dependent Due-Dates on Job Shop Performance , 1983 .

[18]  G. Ragatz,et al.  A simulation analysis of due date assignment rules , 1984 .

[19]  Gary L. Ragatz,et al.  A framework for the study of due date management in job shops , 1984 .

[20]  T.C.E. Cheng Optimal due-date assignment in a job shop† , 1986 .

[21]  T. Cheng Integration of priority dispatching and due-date assignment in a job shop , 1988 .

[22]  J. Shanthikumar,et al.  Approximations for the time spent in a dynamic job shop with applications to due-date assignment , 1988 .

[23]  T.C.E. Cheng,et al.  Survey of scheduling research involving due date determination decisions , 1989 .

[24]  Chuen-Chien Lee FUZZY LOGIC CONTROL SYSTEMS: FUZZY LOGIC CONTROLLER - PART I , 1990 .

[25]  Chuen-Chien Lee,et al.  Fuzzy logic in control systems: fuzzy logic controller. II , 1990, IEEE Trans. Syst. Man Cybern..

[26]  Joseph J. Talavage,et al.  A transient-based real-time scheduling algorithm in FMS , 1991 .

[27]  Kut C. So,et al.  A due-date assignment model for a flow shop with application in a lightguide cable shop , 1991 .

[28]  Piero P. Bonissone,et al.  Automated fuzzy knowledge base generation and tuning , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[29]  Lawrence M. Wein,et al.  A broader view of the job-shop scheduling problem , 1992 .

[30]  C. L. Karr,et al.  Fuzzy control of pH using genetic algorithms , 1993, IEEE Trans. Fuzzy Syst..

[31]  Reha Uzsoy,et al.  Exploiting shop floor status information to schedule complex job shops , 1994 .

[32]  Chuen-Tsai Sun,et al.  Neuro-fuzzy modeling and control , 1995, Proc. IEEE.

[33]  Stephen R. Lawrence,et al.  Estimating flowtimes and setting due-dates in complex production systems , 1995 .

[34]  Stanley F. Bullington,et al.  Development of manufacturing control strategies using unsupervised machine learning , 1996 .