Linear-quadratic-Gaussian mean field games under high rate quantization

This paper studies discrete time linear-quadratic-Gaussian mean field games (MFGs) with state measurement quantization. In this problem formulation each agent is coupled via both its individual linear stochastic dynamics and its individual quadratic discounted cost function to the average of all agents' states. In addition, each agent only observes a high rate quantized version of its own state's local noisy measurement. For this dynamic game problem, the MFG system consisting of a set of coupled deterministic equations is derived which approximates the stochastic system of agents as the population size goes to infinity. In a finite population system each agent only uses (i) the high rate quantization of its own local noisy measurement, and (ii) a function approximating the population effect which is computed offline from the MFG system. It is shown that the resulting set of high rate quantized MFG control strategies possesses an ε-Nash equilibrium property where ε goes to zero as the population size approaches infinity and the individual high rate quantization noise goes to zero.

[1]  Tao Li,et al.  Asymptotically Optimal Decentralized Control for Large Population Stochastic Multiagent Systems , 2008, IEEE Transactions on Automatic Control.

[2]  Peter E. Caines,et al.  Distributed Multi-Agent Decision-Making with Partial Observations: Asymtotic Nash Equilibria , 2006 .

[3]  R. Murray,et al.  On the effect of quantization on performance at high rates , 2006, 2006 American Control Conference.

[4]  P. Caines,et al.  Individual and mass behaviour in large population stochastic wireless power control problems: centralized and Nash equilibrium solutions , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[5]  P. Caines,et al.  A Solution to the Consensus Problem via Stochastic Mean Field Control , 2010 .

[6]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Vol. II , 1976 .

[7]  Peter E. Caines,et al.  Mean Field Analysis of Controlled Cucker-Smale Type Flocking: Linear Analysis and Perturbation Equations , 2011 .

[8]  Robin J. Evans,et al.  Feedback Control Under Data Rate Constraints: An Overview , 2007, Proceedings of the IEEE.

[9]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[10]  P. Lions,et al.  Mean field games , 2007 .

[11]  David L. Neuhoff,et al.  The validity of the additive noise model for uniform scalar quantizers , 2005, IEEE Transactions on Information Theory.

[12]  R. Gray Source Coding Theory , 1989 .

[13]  Peter E. Caines,et al.  Nash, Social and Centralized Solutions to Consensus Problems via Mean Field Control Theory , 2013, IEEE Transactions on Automatic Control.

[14]  Robin J. Evans,et al.  Stabilizability of Stochastic Linear Systems with Finite Feedback Data Rates , 2004, SIAM J. Control. Optim..

[15]  Minyue Fu,et al.  Lack of Separation Principle for Quantized Linear Quadratic Gaussian Control , 2012, IEEE Transactions on Automatic Control.

[16]  S. Meyn,et al.  Synchronization of coupled oscillators is a game , 2010, ACC 2010.

[17]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..