AN OPTIMAL CONTROL THEORY FOR DISCRETE EVENT SYSTEMS

In certain discrete event applications it may be desirable to find a particular controller, within the set of acceptable controllers, which optimizes some quantitative performance measure. In this paper we propose a theory of optimal control to meet such design requirements for deterministic systems. The discrete event system (DES) is modeled by a formal language. Event and cost functions are defined which induce costs on controlled system behavior. The event costs associated with the system behavior can be reduced, in general, only by increasing the control costs. Thus it is nontrivial to find the optimal amount of control to use, and the formulation captures the fundamental tradeoff motivating classical optimal control. Results on the existence of minimally restrictive optimal solutions are presented. Communication protocols are analyzed to motivate the formulation and demonstrate optimal controller synthesis. Algorithms for the computation of optimal controllers are developed for the special case of DES modeled by regular languages. It is shown that this framework generalizes some of the existing literature.

[1]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[2]  Stéphane Lafortune,et al.  Dealing with blocking in supervisory control of discrete event systems , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[3]  Stéphane Lafortune,et al.  A graph-theoretic optimal control problem for terminating discrete event processes , 1992, Discret. Event Dyn. Syst..

[4]  Stéphane Lafortune,et al.  Optimal Control of a Class of Discrete Event Systems , 1991 .

[5]  M. W. Shields.  An Introduction to Automata Theory , 1988 .

[6]  Stéphane Lafortune,et al.  A deterministic optimal control theory for discrete event systems , 1993, Proceedings of 32nd IEEE Conference on Decision and Control.

[7]  W. M. Wonham,et al.  The control of discrete event systems , 1989 .

[8]  R. Sengupta,et al.  Extensions to the Theory of Optimal Control of Discrete Event Systems , 1993 .

[9]  P. Ramadge,et al.  On the supremal controllable sublanguage of a given language , 1984, The 23rd IEEE Conference on Decision and Control.

[10]  K. Passino,et al.  On the optimal control of discrete event systems , 1989, Proceedings of the 28th IEEE Conference on Decision and Control,.

[11]  Optimal Supervisory Control of Discrete Event Dynamical Systems 1 , 2 , 1995 .

[12]  F. Beutler,et al.  Optimal policies for controlled markov chains with a constraint , 1985 .

[13]  Michael Heymann,et al.  On optimal attraction in discrete-event processes , 1993, Inf. Sci..

[14]  P. Ramadge,et al.  Supervisory control of a class of discrete event processes , 1987 .

[15]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .