Fast generalized Nash equilibrium seeking under partial-decision information

We address the generalized Nash equilibrium (GNE) problem in a partial-decision information scenario, where each agent can only observe the actions of some neighbors, while its cost function possibly depends on the strategies of other agents. As main contribution, we design a fully-distributed, single-layer, fixed-step algorithm to seek a variational GNE, based on a proximal best-response augmented with consensus and constraint-violation penalization terms. Furthermore, we propose a variant of our method, specifically devised for aggregative games. We establish convergence, under strong monotonicity and Lipschitz continuity of the game mapping, by deriving our algorithms as proximal-point methods, opportunely preconditioned to distribute the computation among the agents. This operatortheoretic interpretation proves very powerful. First, it allows us to demonstrate convergence of our algorithms even if the proximal best-response is computed inexactly by the agents. Secondly, it favors the implementation of acceleration schemes that can improve the convergence speed. The potential of our algorithms is validated numerically, revealing much faster convergence with respect to known gradient-based methods.

[1]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.

[2]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[3]  Lacra Pavel,et al.  Single-Timescale Distributed GNE Seeking for Aggregative Games Over Networks via Forward–Backward Operator Splitting , 2019, IEEE Transactions on Automatic Control.

[4]  Bastian Goldlücke,et al.  Variational Analysis , 2014, Computer Vision, A Reference Guide.

[5]  Yiguang Hong,et al.  Distributed algorithm for ε-generalized Nash equilibria with uncertain coupled constraints , 2021, Autom..

[6]  Francisco Facchinei,et al.  Real and Complex Monotone Communication Games , 2012, IEEE Transactions on Information Theory.

[7]  Francisco Facchinei,et al.  Nash equilibria: the variational approach , 2010, Convex Optimization in Signal Processing and Communications.

[8]  Francisco Facchinei,et al.  Generalized Nash Equilibrium Problems , 2010, Ann. Oper. Res..

[9]  Sergio Grammatico Dynamic Control of Agents Playing Aggregative Games With Coupling Constraints , 2016, IEEE Transactions on Automatic Control.

[10]  Wei Shi,et al.  Geometric Convergence of Gradient Play Algorithms for Distributed Nash Equilibrium Seeking , 2018, IEEE Transactions on Automatic Control.

[11]  Lacra Pavel,et al.  Asynchronous Distributed Algorithms for Seeking Generalized Nash Equilibria Under Full and Partial-Decision Information , 2018, IEEE Transactions on Cybernetics.

[12]  Ankur A. Kulkarni,et al.  On the variational equilibrium as a refinement of the generalized Nash equilibrium , 2012, Autom..

[13]  Sergio Grammatico,et al.  Projected-gradient algorithms for Generalized Equilibrium seeking in Aggregative Games arepreconditioned Forward-Backward methods , 2018, 2018 European Control Conference (ECC).

[14]  Miroslav Krstic,et al.  Nash Equilibrium Seeking in Noncooperative Games , 2012, IEEE Transactions on Automatic Control.

[15]  W. Hager,et al.  and s , 2019, Shallow Water Hydraulics.

[16]  K. Brown,et al.  Graduate Texts in Mathematics , 1982 .

[18]  Julien M. Hendrickx,et al.  A generic online acceleration scheme for optimization algorithms via relaxation and inertia , 2016, Optim. Methods Softw..

[19]  Maojiao Ye,et al.  Distributed Nash Equilibrium Seeking by a Consensus Based Approach , 2016, IEEE Transactions on Automatic Control.

[20]  Sergio Grammatico,et al.  Semi-Decentralized Generalized Nash Equilibrium Seeking in Monotone Aggregative Games , 2018, IEEE Transactions on Automatic Control.

[21]  Sergio Grammatico,et al.  Distributed averaging integral Nash equilibrium seeking on networks , 2018, Autom..

[22]  Lacra Pavel,et al.  A Passivity-Based Approach to Nash Equilibrium Seeking Over Networks , 2017, IEEE Transactions on Automatic Control.

[23]  N. EL FAROUQ Pseudomonotone Variational Inequalities: Convergence of Proximal Methods , 2001 .

[24]  Sergio Grammatico,et al.  A Douglas-Rachford Splitting for Semi-decentralized Equilibrium Seeking in Generalized Aggregative Games , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[25]  Gordon F. Royle,et al.  Algebraic Graph Theory , 2001, Graduate texts in mathematics.

[26]  Gebräuchliche Fertigarzneimittel,et al.  V , 1893, Therapielexikon Neurologie.

[27]  Vladimir Braverman,et al.  Communication-efficient distributed SGD with Sketching , 2019, NeurIPS.

[28]  Sergio Grammatico,et al.  Distributed Generalized Nash Equilibrium Seeking in Aggregative Games on Time-Varying Networks , 2019, IEEE Transactions on Automatic Control.

[29]  Wei Shi,et al.  Distributed Nash equilibrium seeking under partial-decision information via the alternating direction method of multipliers , 2017, Autom..

[30]  Sergio Grammatico,et al.  A continuous-time distributed generalized Nash equilibrium seeking algorithm over networks for double-integrator agents , 2019, 2020 European Control Conference (ECC).

[31]  Sergio Grammatico,et al.  Fully Distributed Nash Equilibrium Seeking Over Time-Varying Communication Networks With Linear Convergence Rate , 2020, IEEE Control Systems Letters.

[32]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .

[33]  Lacra Pavel,et al.  Distributed GNE Seeking Under Partial-Decision Information Over Networks via a Doubly-Augmented Operator Splitting Approach , 2018, IEEE Transactions on Automatic Control.

[34]  M. Cojocaru,et al.  Continuity of solutions for parametric variational inequalities in Banach space , 2009 .

[35]  Lacra Pavel,et al.  An operator splitting approach for distributed generalized Nash equilibria computation , 2019, Autom..

[36]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[37]  Lacra Pavel,et al.  Distributed Generalized Nash Equilibria Computation of Monotone Games via Double-Layer Preconditioned Proximal-Point Algorithms , 2019, IEEE Transactions on Control of Network Systems.

[38]  Angelia Nedic,et al.  Distributed Algorithms for Aggregative Games on Graphs , 2016, Oper. Res..

[39]  Sergio Grammatico,et al.  A fully-distributed proximal-point algorithm for Nash equilibrium seeking with linear convergence rate , 2019, 2020 59th IEEE Conference on Decision and Control (CDC).

[40]  Basilio Gentile,et al.  A Distributed Algorithm For Almost-Nash Equilibria of Average Aggregative Games With Coupling Constraints , 2020, IEEE Transactions on Control of Network Systems.

[41]  Mihaela van der Schaar,et al.  Distributed Learning for Stochastic Generalized Nash Equilibrium Problems , 2016, IEEE Transactions on Signal Processing.

[42]  Wei Shi,et al.  Accelerated Gradient Play Algorithm for Distributed Nash Equilibrium Seeking , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[43]  Wei Shi,et al.  LANA: An ADMM-like Nash equilibrium seeking algorithm in decentralized environment , 2017, 2017 American Control Conference (ACC).

[44]  Radu Ioan Bot,et al.  Inertial Douglas-Rachford splitting for monotone inclusion problems , 2014, Appl. Math. Comput..

[45]  Guoqiang Hu,et al.  Distributed Nash Equilibrium Seeking With Limited Cost Function Knowledge via a Consensus-Based Gradient-Free Method , 2020, IEEE Transactions on Automatic Control.

[46]  Walid Saad,et al.  Game-Theoretic Methods for the Smart Grid: An Overview of Microgrid Systems, Demand-Side Management, and Smart Grid Communications , 2012, IEEE Signal Processing Magazine.

[47]  Soummya Kar,et al.  Empirical Centroid Fictitious Play: An Approach for Distributed Learning in Multi-Agent Games , 2013, IEEE Transactions on Signal Processing.

[48]  Sergio Grammatico,et al.  Semi-Decentralized Nash Equilibrium Seeking in Aggregative Games With Separable Coupling Constraints and Non-Differentiable Cost Functions , 2017, IEEE Control Systems Letters.

[49]  Uday V. Shanbhag,et al.  Linearly Convergent Variable Sample-Size Schemes for Stochastic Nash Games: Best-Response Schemes and Distributed Gradient-Response Schemes , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[50]  Munther A. Dahleh,et al.  Demand Response Using Linear Supply Function Bidding , 2015, IEEE Transactions on Smart Grid.

[51]  P. L. Combettes,et al.  Quasi-Fejérian Analysis of Some Optimization Algorithms , 2001 .

[52]  Farzad Salehisadaghiani,et al.  Distributed Nash equilibrium seeking: A gossip-based algorithm , 2016, Autom..