Decentralized control problems with substitutable actions

We consider a decentralized system with multiple controllers and define substitutability of one controller by another in open-loop strategies. We explore the implications of this property on the optimization of closed-loop strategies. In particular, we focus on the decentralized LQG problem with substitutable actions. Even though the problem we formulate does not belong to the known classes of “simpler” decentralized problems such as partially nested or quadratically invariant problems, our results show that, under the substitutability assumption, linear strategies are optimal and we provide a complete state space characterization of optimal strategies. We also identify a family of information structures that all give the same optimal cost as the centralized information structure under the substitutability assumption. Our results suggest that open-loop substitutability can work as a counterpart of the information structure requirements that enable simplification of decentralized control problems.

[1]  Sanjay Lall,et al.  A Characterization of Convex Problems in Decentralized Control$^ast$ , 2005, IEEE Transactions on Automatic Control.

[2]  Nuno C. Martins,et al.  Information structures in optimal decentralized control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[3]  Seyed Mohammad Asghari,et al.  Dynamic Teams and Decentralized Control Problems With Substitutable Actions , 2016, IEEE Transactions on Automatic Control.

[4]  Nuno C. Martins,et al.  Optimal memoryless control in Gaussian noise: A simple counterexample , 2011, Autom..

[5]  Serdar Yüksel,et al.  Stochastic Nestedness and the Belief Sharing Information Pattern , 2009, IEEE Transactions on Automatic Control.

[6]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[7]  Y. Ho,et al.  Team decision theory and information structures in optimal control problems--Part II , 1972 .

[8]  John N. Tsitsiklis,et al.  A survey of computational complexity results in systems and control , 2000, Autom..

[9]  Tamer Basar,et al.  Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints , 2013 .

[10]  Petros G. Voulgaris,et al.  A convex characterization of distributed control problems in spatially invariant systems with communication constraints , 2005, Syst. Control. Lett..

[11]  Sanjay Lall,et al.  Internal quadratic invariance and decentralized control , 2010, Proceedings of the 2010 American Control Conference.

[12]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[13]  Adi Ben-Israel,et al.  Generalized inverses: theory and applications , 1974 .