Mean Field Estimation for Partially Observed LQG Systems with Major and Minor Agents

Abstract In the work of Huang (2010) and Nguyen and Huang (2012) the linear quadratic mean field systems and control problem is solved in the case where there is a major agent (i.e. non-asymptotically vanishing as the population size goes to infinity) together with a population of minor agents (i.e. individually asymptotically negligible). The new feature in this case is that the mean field becomes stochastic and by minor agent state extension Nguyen and Huang (2012) establish the existence of e-Nash equilibria together with the individual agents' control laws that yield the equilibria. This paper presents results initially announced in Caines and Kizilkale (2013); Caines (2013) where it is shown that if the major agent's state is partially observed by the minor agents, and if the major agent completely observes its own state, all agents can recursively generate estimates (in general individually distinct) of the major agent's state and the mean field, and thence generate feedback controls yielding ∈-Nash equilibria.

[1]  P. Caines,et al.  Individual and mass behaviour in large population stochastic wireless power control problems: centralized and Nash equilibrium solutions , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[2]  P. Lions,et al.  Jeux à champ moyen. II – Horizon fini et contrôle optimal , 2006 .

[3]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[4]  Shie Mannor,et al.  Large scale real-time bidding in the smart grid: A mean field framework , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[5]  Minyi Huang,et al.  Large-Population LQG Games Involving a Major Player: The Nash Certainty Equivalence Principle , 2009, SIAM J. Control. Optim..

[6]  Peter E. Caines,et al.  Recursive estimation of common partially observed disturbances in MFG systems with application to large scale power markets , 2013, 52nd IEEE Conference on Decision and Control.

[7]  Minyi Huang,et al.  Linear-Quadratic-Gaussian Mixed Games with Continuum-Parametrized Minor Players , 2012, SIAM J. Control. Optim..

[8]  P. Lions,et al.  Jeux à champ moyen. I – Le cas stationnaire , 2006 .

[9]  Peter E. Caines,et al.  Epsilon-Nash Mean Field Game Theory for Nonlinear Stochastic Dynamical Systems with Major and Minor Agents , 2012, SIAM J. Control. Optim..

[10]  Peter E. Caines,et al.  Large population stochastic dynamic games: closed-loop McKean-Vlasov systems and the Nash certainty equivalence principle , 2006, Commun. Inf. Syst..