A game theoretic approach to distributed control of homogeneous multi-agent systems

A distributed multi-agent system consisting of homogeneous agents is considered in this paper. Distributed differential games and their solutions in terms of Nash equilibria are defined for such systems, both in a linear quadratic setting and in a general, nonlinear setting. As with standard differential games, obtaining exact solutions for nonlinear distributed differential games requires solving coupled partial differential equations, closed-form solutions for which are not readily available in general. A systematic method for constructing approximate solutions for a nonlinear distributed differential game with two players is provided. The method requires solving algebraic equations only and is illustrated on a numerical example.

[1]  T. Başar,et al.  Dynamic Noncooperative Game Theory , 1982 .

[2]  Alessandro Astolfi,et al.  Approximate finite-horizon optimal control without PDEs , 2011, Syst. Control. Lett..

[3]  Alessandro Astolfi,et al.  A Differential Game Approach to Multi-agent Collision Avoidance , 2017, IEEE Transactions on Automatic Control.

[4]  Y. Ho,et al.  Further properties of nonzero-sum differential games , 1969 .

[5]  Richard M. Murray,et al.  DISTRIBUTED COOPERATIVE CONTROL OF MULTIPLE VEHICLE FORMATIONS USING STRUCTURAL POTENTIAL FUNCTIONS , 2002 .

[6]  Lynne E. Parker,et al.  Editorial: Advances in Multi-Robot Systems , 2002 .

[7]  Anders Rantzer,et al.  Using Game Theory for Distributed Control Engineering , 2008 .

[8]  Wei Lin,et al.  Distributed UAV formation control using differential game approach , 2014 .

[9]  Jason R. Marden,et al.  Game Theory and Distributed Control , 2015 .

[10]  Reza Olfati-Saber,et al.  Flocking for multi-agent dynamic systems: algorithms and theory , 2006, IEEE Transactions on Automatic Control.

[11]  Geir E. Dullerud,et al.  Distributed control design for spatially interconnected systems , 2003, IEEE Trans. Autom. Control..

[12]  Alessandro Astolfi,et al.  A constructive differential game approach to collision avoidance in multi-agent systems , 2014, 2014 American Control Conference.

[13]  Alessandro Astolfi,et al.  Towards a systematic solution for differential games with limited communication , 2016, 2016 American Control Conference (ACC).

[14]  Wei Lin,et al.  A design of distributed nonzero-sum Nash strategies , 2010, 49th IEEE Conference on Decision and Control (CDC).

[15]  Alessandro Astolfi,et al.  Approximate optimal monitoring: Preliminary results , 2012, 2012 American Control Conference (ACC).

[16]  Alessandro Astolfi,et al.  Approximate finite-horizon optimal control for input-affine nonlinear systems with input constraints , 2014 .

[17]  Alessandro Astolfi,et al.  Control of microgrids using a differential game theoretic framework , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[18]  Y. Ho,et al.  Nonzero-sum differential games , 1969 .

[19]  Alessandro Astolfi,et al.  Constructive $\epsilon$-Nash Equilibria for Nonzero-Sum Differential Games , 2015, IEEE Transactions on Automatic Control.

[20]  A. Astolfi,et al.  Approximate optimal monitoring , 2014, 2014 European Control Conference (ECC).

[21]  Magnus Egerstedt,et al.  Distributed Coordination Control of Multiagent Systems While Preserving Connectedness , 2007, IEEE Transactions on Robotics.

[22]  Alessandro Astolfi,et al.  A differential game approach to formation control for a team of agents with one leader , 2015, 2015 American Control Conference (ACC).

[23]  Lubomír Bakule,et al.  Decentralized control: An overview , 2008, Annu. Rev. Control..

[24]  Alessandro Astolfi,et al.  Dynamic Approximate Solutions of the HJ Inequality and of the HJB Equation for Input-Affine Nonlinear Systems , 2012, IEEE Transactions on Automatic Control.

[25]  Magnus Egerstedt,et al.  Graph Theoretic Methods in Multiagent Networks , 2010, Princeton Series in Applied Mathematics.

[26]  Wei Lin,et al.  Distributed game strategy design with application to multi-agent formation control , 2014, 53rd IEEE Conference on Decision and Control.

[27]  Jacob Engwerda,et al.  LQ Dynamic Optimization and Differential Games , 2005 .