An impulse control problem of a production model with interruptions to follow stochastic demand

Abstract The paper deals with the stochastic optimal intervention problem which arises in a production & storage system involving identical items. The requests for items arrive at random and the production of an item can be interrupted during production to meet the corresponding demand. The operational costs considered are due to the stock/backlog, running costs and set up costs associated to interruptions and re-initializations. The process presents distinct behaviour on each of two disjoint identical subsets of the state space, and the state process can only be transferred from one subset to the other by interventions associated to interruptions/re-initializations. A characterization is given in terms of piecewise deterministic Markov process, which explores the aforementioned structure, and a method of solution with assured convergence, that does not require any special initialization, is provided. Additionally, we demonstrate that under conditions on the data, the optimal policy is to produce the item completely in a certain region of the state space of low stock level.

[1]  M. H. A. Davis,et al.  Impulse control of piecewise-deterministic processes , 1989, Math. Control. Signals Syst..

[2]  R. Akella,et al.  Optimal control of production rate in a failure prone manufacturing system , 1985, 1985 24th IEEE Conference on Decision and Control.

[3]  E. K. Boukas.  Numerical methods for HJB equations of optimization problems for piecewise deterministic systems , 1995 .

[4]  Michael Monticino,et al.  Optimal cutoff strategies in capacity expansion problems , 1995 .

[5]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[6]  Robert J. Elliott,et al.  Stochastic calculus and applications , 1984, IEEE Transactions on Automatic Control.

[7]  Mark H. Davis.  Markov Models and Optimization , 1995 .

[8]  Qing Zhang,et al.  A numerical method in optimal production and setup scheduling of stochastic manufacturing systems , 1997 .

[9]  El-Kébir Boukas,et al.  Manufacturing flow control and preventing maintenance: a stochastic control approach , 1988 .

[10]  Henk Tijms,et al.  Stochastic modelling and analysis: a computational approach , 1986 .

[11]  D. Gatarek.  On first-order quasi-variational inequalities with integral terms , 1991 .

[12]  M. Dempster,et al.  Optimal capacity expansion under uncertainty , 1987, Advances in Applied Probability.

[13]  Dariusz Gatarek,et al.  Optimality conditions for impulsive control of piecewise-deterministic processes , 1992, Math. Control. Signals Syst..

[14]  João Bosco Ribeiro do Val,et al.  Optimal production with preemption to meet stochastic demand , 1999, Autom..

[15]  S.X.C. Lou,et al.  Production control of manufacturing systems: a multiple time scale approach , 1994, IEEE Trans. Autom. Control..

[16]  W. Fleming,et al.  An Optimal Stochastic Production Planning Problem with Randomly Fluctuating Demand , 1987 .

[17]  A. Sharifnia,et al.  Production control of a manufacturing system with multiple machine states , 1988 .