Decentralized estimation in a class of measurements induced mean field control problems

We study a class of mean field control problems for a large population of linear Gaussian quadratic agents, coupled via their partial observations. The measurements interference model is assumed to depend only on the empirical mean of agents states. In addition, a structural assumption is made on the agents' controls which are constrained to be linear constant feedbacks on a locally based state estimate. We investigate the ability of such a constrained structure to stabilize individual agent systems as the number of agents increases to infinity. Previous work has shown that a naive approach, whereby the coupling interference term is considered deterministic in the limit as is usually assumed in mean field approaches, results in poor local estimation results and consequently severely limits the stabilization abilities of the closed loop structure. Instead, the finite population optimal decentralized estimation problem is studied, and a non-recursive optimal estimation scheme is presented and tested numerically. This scheme can become a solid basis for deriving asymptotic local state estimate approximations.

[1]  Kevin M. Passino,et al.  Biomimicry of bacterial foraging for distributed optimization and control , 2002 .

[2]  Hongyan Wang,et al.  Social potential fields: A distributed behavioral control for autonomous robots , 1995, Robotics Auton. Syst..

[3]  Tao Li,et al.  Asymptotically Optimal Decentralized Control for Large Population Stochastic Multiagent Systems , 2008, IEEE Transactions on Automatic Control.

[4]  Nikos D. Hatziargyriou,et al.  A Multi-Agent System for Controlled Charging of a Large Population of Electric Vehicles , 2013, IEEE Transactions on Power Systems.

[5]  Chee-Yee Chong,et al.  Sensor networks: evolution, opportunities, and challenges , 2003, Proc. IEEE.

[6]  Ji-Feng Zhang,et al.  Mean Field Games for Large-Population Multiagent Systems with Markov Jump Parameters , 2012, SIAM J. Control. Optim..

[7]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[8]  Arunabha Bagchi Optimal Control of Stochastic Systems , 1993 .

[9]  Peter E. Caines,et al.  Social Optima in Mean Field LQG Control: Centralized and Decentralized Strategies , 2012, IEEE Transactions on Automatic Control.

[10]  A. Ōkubo,et al.  MODELLING SOCIAL ANIMAL AGGREGATIONS , 1994 .

[11]  Peter E. Caines,et al.  Distributed Multi-Agent Decision-Making with Partial Observations: Asymtotic Nash Equilibria , 2006 .

[12]  Aimé Lachapelle,et al.  Human Crowds and Groups Interactions: a Mean Field Games Approach , 2010 .

[13]  H. Witsenhausen A Counterexample in Stochastic Optimum Control , 1968 .

[14]  Roland P. Malhamé,et al.  Distributed estimation and control for large population stochastic multi-agent systems with coupling in the measurements , 2013, 2013 European Control Conference (ECC).

[15]  Sean P. Meyn,et al.  Feedback particle filter with mean-field coupling , 2011, IEEE Conference on Decision and Control and European Control Conference.

[16]  Eitan Altman,et al.  A survey on networking games in telecommunications , 2006, Comput. Oper. Res..

[17]  Dirk Helbing,et al.  Simulating dynamical features of escape panic , 2000, Nature.

[18]  S. Meyn,et al.  Synchronization of coupled oscillators is a game , 2010, ACC 2010.

[19]  Peter E. Caines,et al.  Mean Field LQG Control in Leader-Follower Stochastic Multi-Agent Systems: Likelihood Ratio Based Adaptation , 2012, IEEE Transactions on Automatic Control.

[20]  Andrea J. Goldsmith,et al.  Oblivious equilibrium for large-scale stochastic games with unbounded costs , 2008, 2008 47th IEEE Conference on Decision and Control.

[21]  Peter E. Caines,et al.  Uplink power adjustment in wireless communication systems: a stochastic control analysis , 2004, IEEE Transactions on Automatic Control.

[22]  P. Lions,et al.  Mean field games , 2007 .

[23]  Sean P. Meyn,et al.  A mean-field control-oriented approach to particle filtering , 2011, Proceedings of the 2011 American Control Conference.