Common Knowledge and Sequential Team Problems

We consider a general sequential team problem based on Witsenhausen's intrinsic model. Our formulation encompasses all teams in which the uncontrolled inputs can be viewed as random variables on a finite probability space, the number of control inputs/decisions is finite and the decisions take values in finite spaces. We define the concept of common knowledge in such teams and use it to construct a sequential decomposition of the problem of optimizing the team strategy profile. If the information structure is classical, our common knowledge based decomposition is identical to classical dynamic program. If the information structure is such that the common knowledge is trivial, our decomposition is similar in spirit to Witsenhausen's standard form based decomposition <xref ref-type="bibr" rid="ref17">[17]</xref>. In this case, the sequential decomposition is essentially a sequential reformulation of the strategy optimization problem and appears to have limited value. For information structures with nontrivial common knowledge, our sequential decomposition differs from Witsenhausen's standard form based decomposition because of its dependence on common knowledge. Our common knowledge based approach generalizes the common information based methods of <xref ref-type="bibr" rid="ref12">[12]</xref>–<xref ref-type="bibr" rid="ref13"/><xref ref-type="bibr" rid="ref14">[14]</xref>.

[1]  Demosthenis Teneketzis,et al.  Information structures, causality, and nonsequential stochastic control I: design-independent properties , 1992 .

[2]  Y. Ho,et al.  Teams, signaling, and information theory , 1977, 1977 IEEE Conference on Decision and Control including the 16th Symposium on Adaptive Processes and A Special Symposium on Fuzzy Set Theory and Applications.

[3]  Nuno C. Martins,et al.  Information structures in optimal decentralized control , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[4]  Yu-Chi Ho,et al.  Team decision theory and information structures , 1980 .

[5]  H. Witsenhausen On Information Structures, Feedback and Causality , 1971 .

[6]  R. Aumann Agreeing to disagree. , 1976, Nature cell biology.

[7]  Hans S. Witsenhausen,et al.  The Intrinsic Model for Discrete Stochastic Control: Some Open Problems , 1975 .

[8]  R. Radner,et al.  Team Decision Problems , 1962 .

[9]  Ashutosh Nayyar,et al.  Sequential Decision Making in Decentralized Systems , 2011 .

[10]  Hans S. Witsenhausen,et al.  A standard form for sequential stochastic control , 1973, Mathematical systems theory.

[11]  Hans S. Witsenhausen,et al.  Equivalent stochastic control problems , 1988, Math. Control. Signals Syst..

[12]  Demosthenis Teneketzis,et al.  Sequential decomposition of sequential dynamic teams: applications to real-time communication and networked control systems , 2008 .

[13]  R. Radner,et al.  Economic theory of teams , 1972 .

[14]  G. Hexner,et al.  Information structure: Common and private (Corresp.) , 1977, IEEE Trans. Inf. Theory.

[15]  Jan H. van Schuppen,et al.  A Class of Team Problems with Discrete Action Spaces: Optimality Conditions Based on Multimodularity , 2000, SIAM J. Control. Optim..

[16]  Ashutosh Nayyar,et al.  Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach , 2012, IEEE Transactions on Automatic Control.

[17]  Ashutosh Nayyar,et al.  Optimal Control Strategies in Delayed Sharing Information Structures , 2010, IEEE Transactions on Automatic Control.

[18]  Tamer Basar,et al.  Stochastic Networked Control Systems: Stabilization and Optimization under Information Constraints , 2013 .

[19]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[20]  G. Hexner,et al.  On common information in decision problems , 1977, IEEE Trans. Inf. Theory.

[21]  Y. Ho,et al.  Team decision theory and information structures in optimal control problems--Part II , 1972 .

[22]  Joan Feigenbaum,et al.  Information Structures , 1999, Handbook of Discrete and Combinatorial Mathematics.