A Sufficient Information Approach to Decentralized Decision Making

We study a general class of decentralized dynamic decision-making problems with many agents, asymmetric information, and hidden actions. We propose the notion of sufficient information that provides a mutually consistent compression of the agents' private and common information for decision-making purposes. We define a class of strategies, called sufficient information-based (SIB) strategies, that are based on the agents' sufficient information. We show that restriction to SIB strategies is without loss of optimality in decentralized decision problems with non-strategic agents (i.e. teams). Accordingly, we provide a sequential decomposition of dynamic teams over time that specifies an algorithm for determining globally optimal strategies. For decentralized decision problems with strategic agents (i.e. games), we show that the class of SIB strategies is closed under the best response map. Consequently, we propose a notion of sufficient information-based equilibrium and provide a sequential decomposition of dynamic games over time that specifies an algorithm for determining Sufficient Information Based Perfect Bayesian Equilibria (SIB-PBE).

[1]  Yi Ouyang,et al.  On stochastic dynamic games with delayed sharing information structure , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[2]  Shmuel Zamir,et al.  Repeated games of incomplete information: Zero-sum , 1992 .

[3]  Tamer Basar,et al.  Common Information based Markov Perfect Equilibria for Linear-Gaussian Games with Asymmetric Information , 2014, SIAM J. Control. Optim..

[4]  Yi Ouyang,et al.  Dynamic oligopoly games with private Markovian dynamics , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[5]  Aditya Mahajan,et al.  Optimal Decentralized Control of Coupled Subsystems With Control Sharing , 2011, IEEE Transactions on Automatic Control.

[6]  Ashutosh Nayyar,et al.  Decentralized Stochastic Control with Partial History Sharing: A Common Information Approach , 2012, IEEE Transactions on Automatic Control.

[7]  Yi Ouyang,et al.  Dynamic Games With Asymmetric Information: Common Information Based Perfect Bayesian Equilibria and Sequential Decomposition , 2015, IEEE Transactions on Automatic Control.

[8]  Tamer Basar,et al.  Common Information Based Markov Perfect Equilibria for Stochastic Games With Asymmetric Information: Finite Games , 2014, IEEE Transactions on Automatic Control.

[9]  F. Forges.  Repeated games of incomplete information: Non-zero-sum , 1992 .

[10]  J. Sobel,et al.  STRATEGIC INFORMATION TRANSMISSION , 1982 .

[11]  Hamidreza Tavafoghi Jahromi,et al.  On Design and Analysis of Cyber-Physical Systems with Strategic Agents , 2017 .

[12]  Ashutosh Nayyar,et al.  Optimal Control Strategies in Delayed Sharing Information Structures , 2010, IEEE Transactions on Automatic Control.

[13]  Achilleas Anastasopoulos,et al.  Signaling equilibria for dynamic LQG games with asymmetric information , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[14]  Todd P. Coleman,et al.  An Optimizer's Approach to Stochastic Control Problems With Nonclassical Information Structures , 2013, IEEE Transactions on Automatic Control.

[15]  Hans S. Witsenhausen,et al.  Equivalent stochastic control problems , 1988, Math. Control. Signals Syst..

[16]  H. Witsenhausen.  Separation of estimation and control for discrete time systems , 1971 .

[17]  Robert J. Aumann,et al.  Repeated Games with Incomplete Information , 1995 .

[18]  Jeff S. Shamma,et al.  Security Strategies of Both Players in Asymmetric Information Zero-Sum Stochastic Games with an Informed Controller , 2017, ArXiv.

[19]  Abhinav Sinha,et al.  Structured perfect Bayesian equilibrium in infinite horizon dynamic games with asymmetric information , 2016, 2016 54th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[20]  G. Mailath,et al.  Repeated Games and Reputations , 2006 .

[21]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[22]  H. Witsenhausen.  A Counterexample in Stochastic Optimum Control , 1968 .

[23]  Aditya Mahajan,et al.  Decentralized stochastic control , 2013, Ann. Oper. Res..