Distributed control of multi-agent systems with major agents and Markov parameters

In this paper, we investigate distributed control of the multi-agent systems with a major agent and a large number of minor agents in Markovian environment, where agents are coupled by the quadratic tracking indices with random parameters. The major agent has salient impact on others. Each minor agent merely has tiny influence, while the average effect of all the minor agents is not negligible, which plays a significant role in the evolution and performance index of each agent. Besides the state of the major agent, each minor agent can only access to the information of its state and parameters. Based on the mean field theory, a set of distributed control laws is designed. By the probability limit theory, the uniform stability of the closed-loop systems and the upper bound of the corresponding index values are obtained.

[1]  Kai Lai Chung,et al.  A Course in Probability Theory , 1949 .

[2]  D. Sworder.  Feedback control of a class of linear systems with jump parameters , 1969 .

[3]  W. Wonham.  Random differential equations in control theory , 1970 .

[4]  H. Teicher,et al.  Probability theory: Independence, interchangeability, martingales , 1978 .

[5]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[6]  Craig W. Reynolds.  Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[7]  M. Mariton,et al.  Jump Linear Systems in Automatic Control , 1992 .

[8]  H. Chizeck,et al.  Controllability, stabilizability, and continuous-time Markovian jump linear quadratic control , 1990 .

[9]  D. Levine,et al.  When Are Agents Negligible , 1995 .

[10]  Vicsek,et al.  Novel type of phase transition in a system of self-driven particles. , 1995, Physical review letters.

[11]  D. Fudenberg,et al.  When Are Nonanonymous Players Negligible , 1998 .

[12]  P. Caines,et al.  Individual and mass behaviour in large population stochastic wireless power control problems: centralized and Nash equilibrium solutions , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[13]  Zahia Guessoum,et al.  Using adaptive multi-agent systems to simulate economic models , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[14]  Ron Sun,et al.  Simulating Organizational Decision-Making Using a Cognitively Realistic Agent Model , 2004, J. Artif. Soc. Soc. Simul..

[15]  Benjamin Van Roy,et al.  Oblivious Equilibrium: A Mean Field Approximation for Large-Scale Dynamic Games , 2005, NIPS.

[16]  John P. Lewis,et al.  The Future of Disaster Response: Humans Working with Multiagent Teams using DEFACTO , 2005, AAAI Spring Symposium: AI Technologies for Homeland Security.

[17]  Minyi Huang,et al.  Nash Certainty Equivalence in Large Population Stochastic Dynamic Games: Connections with the Physics of Interacting Particle Systems , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[18]  P. Lions,et al.  Jeux à champ moyen. I – Le cas stationnaire , 2006 .

[19]  R. P. Marques,et al.  Discrete-Time Markov Jump Linear Systems , 2004, IEEE Transactions on Automatic Control.

[20]  P. Lions,et al.  Jeux à champ moyen. II – Horizon fini et contrôle optimal , 2006 .

[21]  Minyi Huang,et al.  Large-Population Cost-Coupled LQG Problems With Nonuniform Agents: Individual-Mass Behavior and Decentralized $\varepsilon$-Nash Equilibria , 2007, IEEE Transactions on Automatic Control.

[22]  Tao Li,et al.  Asymptotically Optimal Decentralized Control for Large Population Stochastic Multiagent Systems , 2008, IEEE Transactions on Automatic Control.

[23]  Bingchang Wang,et al.  Mean field games for large population stochastic multi-agent systems with Markov jumps , 2010, Proceedings of the 29th Chinese Control Conference.

[24]  Minyi Huang,et al.  Large-Population LQG Games Involving a Major Player: The Nash Certainty Equivalence Principle , 2009, SIAM J. Control. Optim..

[25]  S. Meyn,et al.  Synchronization of coupled oscillators is a game , 2010, ACC 2010.