A class of interference induced games: Asymptotic Nash equilibria and parameterized cooperative solutions

We consider a multi-agent system with linear stochastic individual dynamics, and individual linear quadratic ergodic cost functions. The agents partially observe their own states. Their cost functions and initial statistics are a priori independent but they are coupled through an interference term (the mean of all agent states), entering each of their individual measurement equations. While in general for a finite number of agents, the resulting optimal control law may be a non linear function of the available observations, we establish that for certain classes of cost and dynamic parameters, optimal separated control laws obtained by ignoring the interference coupling, are asymptotically optimal when the number of agents goes to infinity, thus forming for finite N , an -Nash equilibrium. More generally though, optimal separated control laws may not be asymptotically optimal, and can in fact result in unstable overall behavior. Thus we consider a class of parameterized decentralized control laws whereby the separated Kalman gain is treated as the arbitrary gain of a Luenberger like observer. System stability regions are characterized and the nature of optimal cooperative control policies within the considered class is explored. Numerical results and an application example for wireless communications are reported.

[1]  Peter E. Caines,et al.  Computational investigations of decentralized cellular network optimization via mean field control , 2014, 53rd IEEE Conference on Decision and Control.

[2]  Peter E. Caines,et al.  Uplink power adjustment in wireless communication systems: a stochastic control analysis , 2004, IEEE Transactions on Automatic Control.

[3]  P. Lions,et al.  Mean field games , 2007 .

[4]  Peter E. Caines,et al.  Recursive estimation of common partially observed disturbances in MFG systems with application to large scale power markets , 2013, 52nd IEEE Conference on Decision and Control.

[5]  Marwan A. Simaan,et al.  Stochastic Discrete-Time Nash Games with Constrained State Estimators , 2002 .

[6]  Sylvie Perreau,et al.  A new method for centralised and decentralised robust power control in CDMA systems , 2006, Digit. Signal Process..

[7]  Jose B. Cruz,et al.  A multimodel approach to stochastic nash games , 1982, Autom..

[8]  Ji-Feng Zhang,et al.  Distributed output feedback control of Markov jump multi-agent systems , 2013, Autom..

[9]  Chee-Yee Chong,et al.  Sensor networks: evolution, opportunities, and challenges , 2003, Proc. IEEE.

[10]  David Tse,et al.  Linear Multiuser Receivers: Effective Interference, Effective Bandwidth and User Capacity , 1999, IEEE Trans. Inf. Theory.

[11]  Peter E. Caines,et al.  Social Optima in Mean Field LQG Control: Centralized and Decentralized Strategies , 2012, IEEE Transactions on Automatic Control.

[12]  Ji-Feng Zhang,et al.  Hierarchical Mean Field Games for Multiagent Systems With Tracking-Type Costs: Distributed $\varepsilon $-Stackelberg Equilibria , 2014, IEEE Transactions on Automatic Control.

[13]  Peter E. Caines,et al.  Distributed Multi-Agent Decision-Making with Partial Observations: Asymtotic Nash Equilibria , 2006 .

[14]  Aimé Lachapelle,et al.  Human Crowds and Groups Interactions: a Mean Field Games Approach , 2010 .

[15]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[16]  Nikos D. Hatziargyriou,et al.  A Multi-Agent System for Controlled Charging of a Large Population of Electric Vehicles , 2013, IEEE Transactions on Power Systems.

[17]  Ji-Feng Zhang,et al.  Mean Field Games for Large-Population Multiagent Systems with Markov Jump Parameters , 2012, SIAM J. Control. Optim..

[18]  Peter E. Caines,et al.  Nash, Social and Centralized Solutions to Consensus Problems via Mean Field Control Theory , 2013, IEEE Transactions on Automatic Control.

[19]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[20]  Roland P. Malhamé,et al.  Decentralized estimation in a class of measurements induced mean field control problems , 2013, 52nd IEEE Conference on Decision and Control.

[21]  Shlomo Shamai,et al.  Spectral Efficiency of CDMA with Random Spreading , 1999, IEEE Trans. Inf. Theory.

[22]  Peter E. Caines,et al.  Mean Field LQG Control in Leader-Follower Stochastic Multi-Agent Systems: Likelihood Ratio Based Adaptation , 2012, IEEE Transactions on Automatic Control.

[23]  Roland P. Malhamé,et al.  Distributed estimation and control for large population stochastic multi-agent systems with coupling in the measurements , 2013, 2013 European Control Conference (ECC).

[24]  P. Caines,et al.  Nash Equilibria for Large-Population Linear Stochastic Systems of Weakly Coupled Agents , 2005 .

[25]  D. Luenberger,et al.  Stochastic differential games with constrained state estimators , 1969 .

[26]  Tao Li,et al.  Asymptotically Optimal Decentralized Control for Large Population Stochastic Multiagent Systems , 2008, IEEE Transactions on Automatic Control.

[27]  D. Luenberger,et al.  Differential games with imperfect state information , 1969 .

[28]  J.H.F. Ritzerfeld,et al.  On stability tests for continuous and discrete-time linear systems , 2005 .

[29]  Kevin M. Passino,et al.  Biomimicry of bacterial foraging for distributed optimization and control , 2002 .

[30]  Sean P. Meyn,et al.  Synchronization of Coupled Oscillators is a Game , 2010, IEEE Transactions on Automatic Control.

[31]  Hongyan Wang,et al.  Social potential fields: A distributed behavioral control for autonomous robots , 1995, Robotics Auton. Syst..

[32]  A. Ōkubo,et al.  MODELLING SOCIAL ANIMAL AGGREGATIONS , 1994 .

[33]  Eitan Altman,et al.  A survey on networking games in telecommunications , 2006, Comput. Oper. Res..

[34]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[35]  Dirk Helbing,et al.  Simulating dynamical features of escape panic , 2000, Nature.

[36]  Katsuhiko Ogata,et al.  Discrete-time control systems , 1987 .

[37]  Andrea J. Goldsmith,et al.  Oblivious equilibrium for large-scale stochastic games with unbounded costs , 2008, 2008 47th IEEE Conference on Decision and Control.

[38]  Roland P. Malhamé,et al.  Distributed estimation of multi-agent systems with coupling in the measurements: Bulk algorithm and approximate Kalman-type filtering , 2014, 53rd IEEE Conference on Decision and Control.

[39]  Peter E. Caines,et al.  Mean Field Estimation for Partially Observed LQG Systems with Major and Minor Agents , 2014 .