A sufficient condition for near-optimal stochastic controls and its application to manufacturing systems

This paper presents an asymptotic analysis of control models governed by stochastic ordinary differential equations. A sufficient condition of near-optimal controls is given based on Ekeland's principle. It is shown that, under some concavity assumptions, theε-maximum condition in terms of the Hamiltonian implies the √ε-optimality. By applying this result to a general manufacturing system, the common practice of “hierarchical controls” employed in order to reduce the overall complexity of the system is justified on a rigorous basis. A near-optimal control for the operational level is constructed from a near-optimal control at the corporate level, and an asymptotic error bound is obtained. A stochastic extension of the classical HMMS model is treated as a specific example. The approach of this paper is different from those in the literature, and it allows us to handle some previously unsolved problems with nonlinear state equations as well as nonseparable cost functions.

[1]  S. Sethi,et al.  Multilevel hierarchical controls in dynamic stochastic marketing-production systems , 1992, [1992] Proceedings of the 31st IEEE Conference on Decision and Control.

[2]  Maximum principle of stochastic controlled systems of functional type , 1991 .

[3]  I. Ekeland.  On the variational principle , 1974 .

[4]  O. Mangasarian.  Sufficient Conditions for the Optimal Control of Nonlinear Systems , 1966 .

[5]  C. C. Holt,et al.  Planning Production, Inventories, and Work Force. , 1962 .

[6]  Suresh P. Sethi,et al.  An Asymptotic Analysis of Hierarchical Control of Manufacturing Systems Under Uncertainty , 1991, Math. Oper. Res..

[7]  S. Sethi.  Dynamic Optimal Control Models in Advertising: A Survey , 1977 .

[8]  L. S. Pontryagin,et al.  Mathematical Theory of Optimal Processes , 1962 .

[9]  Suresh P. Sethi,et al.  Hierarchical controls in stochastic manufacturing systems with convex costs , 1994 .

[10]  Suresh P. Sethi,et al.  Hierarchical Production Planning in Dynamic Stochastic Manufacturing Systems: Asymptotic Optimality and Error Bounds , 1994 .

[11]  Suresh P. Sethi,et al.  Hierarchical controls in stochastic manufacturing systems with machines in tandem , 1992 .

[12]  J. Bismut,et al.  Intégrales convexes et probabilités , 1973 .

[13]  A. Bensoussan.  On the theory of option pricing , 1984, Acta Applicandae Mathematicae.

[14]  A. Bensoussan.  Lectures on stochastic control , 1982 .

[15]  Stanley B. Gershwin,et al.  Hierarchical flow control: a framework for scheduling and planning discrete events in manufacturing systems , 1989, Proc. IEEE.

[16]  H. Kushner.  Necessary conditions for continuous parameter stochastic optimization problems , 1972 .