Dynamic Information Design: A Simple Problem on Optimal Sequential Information Disclosure

We study a dynamic information design problem in a finite-horizon setting consisting of two strategic and long-term optimizing agents, namely a principal (he) and a detector (she). The principal observes the evolution of a Markov chain that has two states, one “good” and one “bad” absorbing state, and has to decide how to sequentially disclose information to the detector. The detector’s only information consists of the messages she receives from the principal. The detector’s objective is to detect as accurately as possible the time of the jump from the good to the bad state. The principal’s objective is to delay the detector as much as possible from detecting the jump to the bad state. For this setting, we determine the optimal strategies of the principal and the detector. The detector’s optimal strategy is described by time-varying thresholds on her posterior belief of the good state. We prove that it is optimal for the principal to give no information to the detector before a time threshold, run a mixed strategy to confuse the detector at the threshold time, and reveal the true state afterward. We present an algorithm that determines both the optimal time threshold and the optimal mixed strategy that could be employed by the principal. We show, through numerical experiments, that this optimal sequential mechanism outperforms any other information disclosure strategy presented in the literature. We also show that our results can be extended to the infinite-horizon problem, to the problem where the matrix of transition probabilities of the Markov chain is time-varying, and to the case where the Markov chain has more than two states and one of the states is absorbing.

[1]  Tamer Basar,et al.  Strategic control of a tracking system , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[2]  Shmuel Zamir,et al.  Repeated games of incomplete information: Zero-sum , 1992 .

[3]  Eric Maskin,et al.  Chapter 5 Implementation theory , 2002 .

[4]  Itay Goldstein,et al.  Stress Tests and Information Disclosure , 2017, J. Econ. Theory.

[5]  Demosthenis Teneketzis,et al.  Static and Dynamic Informational Incentive Mechanisms for Security Enhancement , 2018, 2018 European Control Conference (ECC).

[6]  H. Witsenhausen On the structure of real-time source coders , 1979, The Bell System Technical Journal.

[7]  Boris Ginzburg Optimal Information Censorship , 2019 .

[8]  H. Stackelberg,et al.  Marktform und Gleichgewicht , 1935 .

[9]  Matthew Gentzkow,et al.  Bayesian persuasion with multiple senders and rich signal spaces , 2017, Games Econ. Behav..

[10]  D. Bergemann,et al.  Bayes Correlated Equilibrium and the Comparison of Information Structures in Games , 2013 .

[11]  Tamer Basar,et al.  Deception-As-Defense Framework for Cyber-Physical Systems , 2019, ArXiv.

[12]  Demosthenis Teneketzis,et al.  On the Structure of Optimal Real-Time Encoders and Decoders in Noisy Communication , 2006, IEEE Transactions on Information Theory.

[13]  Nathan Yoder,et al.  Designing Incentives for Heterogeneous Researchers , 2020, Journal of Political Economy.

[14]  Demosthenis Teneketzis,et al.  Optimal Design of Sequential Real-Time Communication Systems , 2009, IEEE Transactions on Information Theory.

[15]  Saurabh Amin,et al.  Information Design for Regulating Traffic Flows under Uncertain Network State , 2019, 2019 57th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[16]  Maxim Ivanov,et al.  Dynamic learning and strategic communication , 2016, Int. J. Game Theory.

[17]  Yishay Mansour,et al.  Implementing the “Wisdom of the Crowd” , 2014, Journal of Political Economy.

[18]  Jonas Hedlund,et al.  Bayesian persuasion by a privately informed sender , 2017, J. Econ. Theory.

[19]  Tamer Başar,et al.  Hierarchical multistage Gaussian signaling games in noncooperative communication and control systems , 2016, Autom..

[20]  Takakazu Honryo,et al.  Dynamic persuasion , 2018, J. Econ. Theory.

[21]  Benjamin A. Brooks,et al.  The Limits of Price Discrimination , 2013 .

[22]  Hamidreza Tavafoghi,et al.  Informational incentives for congestion games , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[23]  F. Forges Repeated games of incomplete information: Non-zero-sum , 1992 .

[24]  Pak Hung Au Dynamic information disclosure , 2015 .

[25]  Demosthenis Teneketzis,et al.  A Surrogate Optimization-Based Mechanism for Resource Allocation and Routing in Networks With Strategic Agents , 2019, IEEE Transactions on Automatic Control.

[26]  M. Spence Job Market Signaling , 1973 .

[27]  Ricardo Alonso,et al.  Bayesian Persuasion with Heterogeneous Priors , 2014, J. Econ. Theory.

[28]  Muhammed O. Sayin,et al.  On the Optimality of Linear Signaling to Deceive Kalman Filters over Finite/Infinite Horizons , 2019, GameSec.

[29]  I. Segal,et al.  Dynamic Mechanism Design: A Myersonian Approach , 2014 .

[30]  Ali Kakhbod,et al.  An Efficient Game Form for Multi-Rate Multicast Service Provisioning , 2012, IEEE J. Sel. Areas Commun..

[31]  Andriy Zapechelnyuk,et al.  Persuasion of a Privately Informed Receiver , 2016 .

[32]  Jonas Hedlund,et al.  Persuasion with communication costs , 2015, Games Econ. Behav..

[33]  Nicolas Vieille,et al.  Optimal dynamic information provision , 2014, Games Econ. Behav..

[34]  Shimon Y. Nof,et al.  Decentralized control of cooperative and autonomous agents for solving the distributed resource allocation problem , 2005 .

[35]  Farhad Farokhi,et al.  Estimation With Strategic Sensors , 2014, IEEE Transactions on Automatic Control.

[36]  Ashutosh Nayyar,et al.  On the Structure of Real-Time Encoding and Decoding Functions in a Multiterminal Communication System , 2011, IEEE Transactions on Information Theory.

[37]  Ivanov Maxim,et al.  Dynamic Information Revelation in Cheap Talk , 2015 .

[38]  Cheng Li,et al.  A Model of Bayesian Persuasion with Transfers , 2017 .

[39]  Stephen Morris,et al.  Information Design, Bayesian Persuasion and Bayes Correlated Equilibrium , 2016 .

[40]  W. Tamura A Theory of Multidimensional Information Disclosure , 2014 .

[41]  Nora Szech,et al.  Optimal Revelation of Life-Changing Information , 2016, Manag. Sci..

[42]  Jeffrey C. Ely,et al.  Sequential Information Design , 2020, Econometrica.

[43]  Emir Kamenica,et al.  Bayesian Persuasion and Information Design , 2019, Annual Review of Economics.

[44]  Ketan Savla,et al.  On the Stability of Optimal Bayesian Persuasion Strategy under a Mistrust Dynamics in Routing Games , 2018, 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[45]  Vikram Krishnamurthy,et al.  Bayesian Sequential Detection With Phase-Distributed Change Time and Nonlinear Penalty—A POMDP Lattice Programming Approach , 2011, IEEE Transactions on Information Theory.

[46]  Sinan Gezici,et al.  On multi-dimensional and noisy quadratic signaling games and affine equilibria , 2015, 2015 American Control Conference (ACC).

[47]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[48]  Robert J. Aumann,et al.  Repeated Games with Incomplete Information , 1995 .

[49]  Marco Battaglini,et al.  Multiple Referrals and Multidimensional Cheap Talk , 2002 .

[50]  Demosthenis Teneketzis,et al.  An Efficient Market Design for Electricity Networks With Strategic Users Possessing Local Information , 2019, IEEE Transactions on Control of Network Systems.

[51]  Adam Tauman Kalai,et al.  A commitment folk theorem , 2010, Games Econ. Behav..

[52]  Daniel Quigley,et al.  Persuasion for the Long Run , 2016 .

[53]  Raphael Boleslavsky,et al.  Grading Standards and Education Quality , 2014 .

[54]  Demosthenis Teneketzis,et al.  Electricity pooling markets with elastic demand: A mechanism design approach , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[55]  J. Sobel,et al.  STRATEGIC INFORMATION TRANSMISSION , 1982 .

[56]  Stephen Morris,et al.  Bayes correlated equilibrium and the comparison of information structures in games , 2016 .

[57]  Jeffrey C. Ely,et al.  Moving the Goalposts , 2020, Journal of Political Economy.

[58]  Andrzej Skrzypacz,et al.  Selling Information , 2016, Journal of Political Economy.

[59]  Krishnamurthy Iyer,et al.  Optimal Signaling Mechanisms in Unobservable Queues with Strategic Customers , 2017, EC.

[60]  Roger B. Myerson,et al.  Game theory - Analysis of Conflict , 1991 .

[61]  Jean C. Walrand,et al.  Optimal causal coding - decoding problems , 1983, IEEE Trans. Inf. Theory.

[62]  Asuman Ozdaglar,et al.  Optimal dynamic information provision in traffic routing , 2020, ArXiv.

[63]  A. Ambrus,et al.  Multi-sender cheap talk with restricted state spaces , 2008 .

[64]  Tamer Başar,et al.  Information-Theoretic Approach to Strategic Communication as a Hierarchical Game , 2015, Proceedings of the IEEE.

[65]  T. Schelling The Strategy of Conflict , 1963 .

[66]  Sanmay Das,et al.  Reducing congestion through information design , 2017, 2017 55th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[67]  Roee Teper,et al.  Information Design in Insurance Markets: Selling Peaches in a Market for Lemons , 2018, SSRN Electronic Journal.

[68]  Peter Norman,et al.  On Bayesian Persuasion with Multiple Senders , 2018, Economics Letters.

[69]  Demosthenis Teneketzis,et al.  Local Public Good Provisioning in Networks: A Nash Implementation Mechanism , 2012, IEEE Journal on Selected Areas in Communications.

[70]  Gustavo de Veciana,et al.  Resource Allocation in Multi-Service Networks via Pricing: Statistical Multiplexing , 1998, Comput. Networks.

[71]  A. Shiryaev On Optimum Methods in Quickest Detection Problems , 1963 .