Optimal control of switching diffusions with application to flexible manufacturing systems

A controlled switching diffusion model is developed to study the hierarchical control of flexible manufacturing systems. The existence of a homogeneous Markov nonrandomized optimal policy is established by a convex analytic method. Using the existence of such a policy, the existence of a unique solution in a certain class to the associated Hamilton-Jacobi-Bellman equations is established and the optimal policy is characterized as a minimizing selector of an appropriate Hamiltonian.

[1]  R. Phelps.  Lectures on Choquet's Theorem , 1966 .

[2]  D. Aronson,et al.  Bounds for the fundamental solution of a parabolic equation , 1967 .

[3]  H. J. Kushner,et al.  Optimal Discounted Stochastic Control for Diffusion Processes , 1967 .

[4]  O. A. Ladyzhenskai︠a︡,et al.  Linear and quasilinear elliptic equations , 1968 .

[5]  O. Ladyženskaja.  Linear and Quasilinear Equations of Parabolic Type , 1968 .

[6]  D. Sworder.  Feedback control of a class of linear systems with jump parameters , 1969 .

[7]  V. Benes.  Existence of Optimal Strategies Based on Specified Information, for a Class of Stochastic Decision Problems , 1970 .

[8]  W. Wonham.  Random differential equations in control theory , 1970 .

[9]  R. Rishel.  Dynamic Programming and Minimum Principles for Systems with Jump Markov Disturbances , 1975 .

[10]  I. Gihman,et al.  Controlled Stochastic Processes , 1979 .

[11]  N. Krylov.  Controlled Diffusion Processes , 1980 .

[12]  Alain Bensoussan,et al.  Stochastic Production Planning with Production Constraints , 1980 .

[13]  R. Suri,et al.  Time-optimal control of parts-routing in a manufacturing system with failure-prone machines , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[14]  Alan S. Willsky,et al.  Asymptotic analysis, approximation, and aggregation methods for stochastic hybrid systems , 1980 .

[15]  P. Lions,et al.  Optimal control of random evolutions , 1981 .

[16]  J. Chabrowski,et al.  Properties of Solutions of Weakly Coupled Parabolic Systems , 1981 .

[17]  G. Kallianpur.  Stochastic differential equations and diffusion processes , 1981 .

[18]  A. Bensoussan.  Stochastic control by functional analysis methods , 1982 .

[19]  L. Rogers.  Stochastic differential equations and diffusion processes: Nobuyuki Ikeda and Shinzo Watanabe North-Holland, Amsterdam, 1981, xiv + 464 pages, Dfl.175.00 , 1982 .

[20]  Stanley B. Gershwin,et al.  An algorithm for the computer control of a flexible manufacturing system , 1983 .

[21]  Alain Bensoussan,et al.  Impulse Control and Quasi-Variational Inequalities , 1984 .

[22]  Stanley B. Gershwin,et al.  Performance of hierarchical production scheduling policy , 1984 .

[23]  Ram Akella,et al.  Optimal control of production rate in a failure prone manufacturing system , 1985 .

[24]  A. Shiryaev,et al.  Limit Theorems for Stochastic Processes , 1987 .

[25]  W. Fleming,et al.  An Optimal Stochastic Production Planning Problem with Randomly Fluctuating Demand , 1987 .

[26]  A. Veretennikov.  On Strong Solutions of Itô Stochastic Equations with Jumps , 1988 .

[27]  El-Kébir Boukas,et al.  An optimal control problem with a random stopping time , 1988 .

[28]  A. Sharifnia,et al.  Production control of a manufacturing system with multiple machine states , 1988 .

[29]  Panganamala Ramana Kumar,et al.  Optimality of Zero-Inventory Policies for Unreliable Manufacturing Systems , 1988, Oper. Res..

[30]  A. Haurie,et al.  Optimality conditions for continuous time systems with controlled jump Markov disturbances: application to an FMS planning problem , 1988 .

[31]  El-Kébir Boukas,et al.  Manufacturing flow control and preventing maintenance: a stochastic control approach , 1988 .

[32]  Stanley B. Gershwin,et al.  Hierarchical flow control: a framework for scheduling and planning discrete events in manufacturing systems , 1989, Proc. IEEE.

[33]  Vivek S. Borkar,et al.  Optimal Control of Diffusion Processes , 1989 .

[34]  Juan Ye.  Optimal control of piecewise deterministic Markov processes. , 1990 .

[35]  M. K. Ghosh,et al.  Controlled diffusions with constraints , 1990 .

[36]  Suresh P. Sethi,et al.  Deterministic equivalent for a continuous-time linear-convex stochastic control problem , 1990 .

[37]  Suresh P. Sethi,et al.  An Asymptotic Analysis of Hierarchical Control of Manufacturing Systems Under Uncertainty , 1991, Math. Oper. Res..