Decentralized minimax control problems with partial history sharing

We consider a decentralized minimax control problem with the partial history sharing information structure. The partial history sharing model is a general decentralized model where (i) controllers sequentially share part of their past data (past observations and control) with each other by means of a shared memory; and (ii) all controllers have perfect recall of the shared data (common information). Instead of modeling the noise variables in dynamics and observations as random variables, we model them as uncertain quantities that take values in some fixed and known finite sets. The objective is to find control strategies that minimize the worst-case cost. We first consider a terminal cost problem. We provide a common information based dynamic program for this decentralized problem. The information state in the dynamic program is the set of feasible values of the current state and local information consistent with the information that is commonly known to all controllers. We then extend the terminal cost problem to incorporate additive costs and common observations.

[1]  Girish N. Nair,et al.  A Nonstochastic Information Theory for Communication and State Estimation , 2011, IEEE Transactions on Automatic Control.

[2]  Sanjay Lall,et al.  A Characterization of Convex Problems in Decentralized Control$^ast$ , 2005, IEEE Transactions on Automatic Control.

[3]  Nuno C. Martins,et al.  Information structures in optimal decentralized control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[4]  Sanjay Lall,et al.  Optimal Control of Two-Player Systems With Output Feedback , 2013, IEEE Transactions on Automatic Control.

[5]  T. Başar,et al.  Solutions to a class of linear-quadratic-Gaussian (LQG) stochastic team problems with nonclassical information , 1987, 26th IEEE Conference on Decision and Control.

[6]  M. Athans,et al.  Solution of some nonclassical LQG stochastic decision problems , 1974 .

[7]  Laurent Lessard,et al.  State-space solution to a minimum-entropy $\mathcal{H}_\infty$-optimal control problem with a nested information constraint , 2014 .

[8]  Ashutosh Nayyar,et al.  Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach , 2012, IEEE Transactions on Automatic Control.

[9]  Y. Ho,et al.  Team decision theory and information structures in optimal control problems--Part II , 1972 .

[10]  D. Bertsekas,et al.  Sufficiently informative functions and the minimax feedback control of uncertain dynamic systems , 1973 .

[11]  Centralized minimax control , 2016 .

[12]  Ashutosh Nayyar,et al.  Structural results for partially nested LQG systems over graphs , 2015, 2015 American Control Conference (ACC).

[13]  J. Bismut An example of interaction between information and control , 1973 .

[14]  Aditya Mahajan,et al.  Optimal Decentralized Control of Coupled Subsystems With Control Sharing , 2011, IEEE Transactions on Automatic Control.

[15]  Gregory W. Wornell,et al.  A separation theorem for periodic sharing information patterns in decentralized control , 1997 .

[16]  H. Witsenhausen Separation of estimation and control for discrete time systems , 1971 .

[17]  Ashutosh Nayyar,et al.  Optimal Control Strategies in Delayed Sharing Information Structures , 2010, IEEE Transactions on Automatic Control.

[18]  Pablo A. Parrilo,et al.  ℋ2-optimal decentralized control over posets: A state space solution for state-feedback , 2010, 49th IEEE Conference on Decision and Control (CDC).

[19]  J. Walrand,et al.  On delayed sharing patterns , 1978 .

[20]  T. Başar,et al.  Solutions to a class of linear-quadratic-Gaussian (LQG) stochastic team problems with nonclassical information , 1987 .

[21]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .