On LQG joint optimal scheduling and control under communication constraints

In this paper, we consider a discrete-time stochastic system, where sensor measurements are sent over a network to the controller. The design objective is a non-classical multicriterion optimization problem for finite horizon, where the cost function consists of the linear quadratic cost reflecting the control performance and a communication cost penalizing information exchange between sensor and controller. It is shown that the joint optimization of scheduling and control can be separated into three subproblems: an optimal regulator problem, an estimation problem and an optimal scheduling problem. The obtained results are extended to TCP-like networks with random packet loss. In the proposed framework, we classify three classes of schedulers, a purely randomized, a deterministic and a state-dependent scheme, and compare their performance by a numerical example.

[1]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[2]  H. Witsenhausen.  A Counterexample in Stochastic Optimum Control , 1968 .

[3]  Peter J Seiler,et al.  Coordinated Control of Unmanned Aerial Vehicles , 2001 .

[4]  T. Başar,et al.  To measure or to control: optimal control with scheduled measurements and controls , 2006, 2006 American Control Conference.

[5]  M. Athans.  On the Determination of Optimal Costly Measurement Strategies for Linear Stochastic Systems , 1972 .

[6]  K. Åström.  Introduction to Stochastic Control Theory , 1970 .

[7]  B. Kurtaran.  Decentralized stochastic control with delayed sharing information pattern , 1976 .

[8]  S. Sastry,et al.  An LQG Optimal Linear Controller for Control Systems with Packet Losses , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[9]  Harold J. Kushner,et al.  On the optimum timing of observations for linear control systems with unknown initial state , 1964 .

[10]  J.P. Hespanha,et al.  Optimal communication logics in networked control systems , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[11]  Ramez M. Daoud,et al.  Ethernet-Based Car Control Network , 2006, 2006 Canadian Conference on Electrical and Computer Engineering.

[12]  Tamer Basar,et al.  Optimal control with limited controls , 2006, 2006 American Control Conference.

[13]  Y. Bar-Shalom,et al.  Dual effect, certainty equivalence, and separation in stochastic control , 1974 .

[14]  Sandra Hirche,et al.  Bilateral Control Architectures for Telerobotics , 2007, Advances in Telerobotics.

[15]  Michael Athans,et al.  1972 IFAC congress paper: On the determination of optimal costly measurement strategies for linear stochastic systems , 1972 .

[16]  Sekhar Tatikonda,et al.  Stochastic linear control over a communication channel , 2004, IEEE Transactions on Automatic Control.

[17]  Wei Wu,et al.  Optimal control of stochastic systems with costly observations - the general Markovian model and the LQG problem , 2005, Proceedings of the 2005, American Control Conference, 2005..

[18]  Karl Henrik Johansson,et al.  Optimal stopping for event-triggered sensing and actuation , 2008, 2008 47th IEEE Conference on Decision and Control.

[19]  T. Başar,et al.  Optimal Estimation with Limited Measurements , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[20]  Tamer Basar,et al.  Optimal control with limited control actions and lossy transmissions , 2008, 2008 47th IEEE Conference on Decision and Control.

[21]  J.P. Hespanha,et al.  A Constant Factor Approximation Algorithm for Event-Based Sampling , 2007, 2007 American Control Conference.

[22]  J.S. Baras,et al.  Multiple Sampling for Estimation on a Finite Horizon , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[23]  R. P. Marques,et al.  Discrete-Time Markov Jump Linear Systems , 2004, IEEE Transactions on Automatic Control.