Asynchronous and Time-Varying Proximal Type Dynamics in Multiagent Network Games

In this paper, we study proximal type dynamics in the context of noncooperative multi-agent network games. These dynamics arise in different applications, since they describe distributed decision making in multi-agent networks, e.g., in opinion dynamics, distributed model fitting and network information fusion, where the goal of each agent is to seek an equilibrium using local information only. We analyse several conjugations of this class of games, providing convergence results, or designing equilibrium seeking algorithms when the original dynamics fail to converge. For the games subject only to local constraints we look into both synchronous/asynchronous dynamics and time-varying communication networks. For games subject in addition to coupling constraints, we design an equilibrium seeking algorithm converging to a special class of game equilibria. Finally, we validate the theoretical results via numerical simulations on opinion dynamics and distributed model fitting.

[1]  R. Srikant,et al.  Opinion dynamics in social networks with stubborn agents: Equilibrium and convergence rate , 2014, Autom..

[2]  Sergio Grammatico,et al.  Time-varying constrained proximal type dynamics in multi-agent network games , 2020, 2020 European Control Conference (ECC).

[3]  F. Bullo,et al.  On Synchronous Robotic Networks—Part I: Models, Tasks, and Complexity , 2005, IEEE Transactions on Automatic Control.

[4]  Gonzalo Mateos,et al.  Distributed Sparse Linear Regression , 2010, IEEE Transactions on Signal Processing.

[5]  Heinz H. Bauschke,et al.  Convex Analysis and Monotone Operator Theory in Hilbert Spaces , 2011, CMS Books in Mathematics.

[6]  Daniel Liberzon,et al.  Switching in Systems and Control , 2003, Systems & Control: Foundations & Applications.

[7]  Ming Yan,et al.  ARock: an Algorithmic Framework for Asynchronous Parallel Coordinate Updates , 2015, SIAM J. Sci. Comput..

[8]  P. L. Combettes,et al.  Compositions and convex combinations of averaged nonexpansive operators , 2014, 1407.5100.

[9]  Sergio Grammatico,et al.  Opinion dynamics are proximal dynamics in multi-agent network games , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[10]  J. Goodman.  Note on Existence and Uniqueness of Equilibrium Points for Concave N-Person Games , 1965 .

[11]  Jorge Cortes,et al.  Distributed Control of Robotic Networks: A Mathematical Approach to Motion Coordination Algorithms , 2009 .

[12]  Francisco Facchinei,et al.  Modern Optimization Modelling Techniques , 2012, Advanced courses in mathematics : CRM Barcelona.

[13]  R. Varga,et al.  Block diagonally dominant matrices and generalizations of the Gerschgorin circle theorem , 1962 .

[14]  Francesca Parise,et al.  Decentralized Convergence to Nash Equilibria in Constrained Deterministic Mean Field Control , 2014, IEEE Transactions on Automatic Control.

[15]  Roberto Tempo,et al.  Novel Multidimensional Models of Opinion Dynamics in Social Networks , 2015, IEEE Transactions on Automatic Control.

[16]  Angelia Nedic,et al.  Distributed Algorithms for Aggregative Games on Graphs , 2016, Oper. Res..

[17]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[18]  Damek Davis,et al.  Forward-Backward-Half Forward Algorithm for Solving Monotone Inclusions , 2017, SIAM J. Optim..

[19]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[20]  J.N. Tsitsiklis,et al.  Convergence in Multiagent Coordination, Consensus, and Flocking , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[21]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[22]  Sergio Grammatico,et al.  On the Convergence of Discrete-Time Linear Systems: A Linear Time-Varying Mann Iteration Converges IFF Its Operator Is Strictly Pseudocontractive , 2018, IEEE Control Systems Letters.

[23]  H. Zou,et al.  Addendum: Regularization and variable selection via the elastic net , 2005 .

[24]  Francesca Parise,et al.  Network aggregative games: Distributed convergence to Nash equilibria , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[25]  Angelia Nedic,et al.  Distributed Random Projection Algorithm for Convex Optimization , 2012, IEEE Journal of Selected Topics in Signal Processing.

[26]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[27]  Sergio Grammatico,et al.  Proximal Dynamics in Multiagent Network Games , 2018, IEEE Transactions on Control of Network Systems.

[28]  Lacra Pavel,et al.  A distributed primal-dual algorithm for computation of generalized Nash equilibria via operator splitting methods , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[29]  Geert Leus,et al.  Distributed Maximum Likelihood Sensor Network Localization , 2013, IEEE Transactions on Signal Processing.

[30]  Tamer Basar,et al.  Game-Theoretic Analysis of the Hegselmann-Krause Model for Opinion Dynamics in Finite Dimensions , 2014, IEEE Transactions on Automatic Control.

[31]  Patrick L. Combettes,et al.  Stochastic Quasi-Fejér Block-Coordinate Fixed Point Iterations with Random Sweeping , 2014 .

[32]  M. Degroot.  Reaching a Consensus , 1974 .

[33]  Lacra Pavel,et al.  Asynchronous Distributed Algorithms for Seeking Generalized Nash Equilibria Under Full and Partial-Decision Information , 2018, IEEE Transactions on Cybernetics.

[34]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[35]  Francesco Bullo,et al.  Breaking the Hierarchy: Distributed Control and Economic Optimality in Microgrids , 2014, IEEE Transactions on Control of Network Systems.

[36]  Wenwu Yu,et al.  An Overview of Recent Progress in the Study of Distributed Multi-Agent Coordination , 2012, IEEE Transactions on Industrial Informatics.

[37]  Sergio Grammatico,et al.  Semi-Decentralized Nash Equilibrium Seeking in Aggregative Games With Separable Coupling Constraints and Non-Differentiable Cost Functions , 2017, IEEE Control Systems Letters.

[38]  Angelia Nedic,et al.  Asynchronous Broadcast-Based Convex Optimization Over a Network , 2011, IEEE Transactions on Automatic Control.

[39]  Farzad Salehisadaghiani,et al.  Distributed Nash equilibrium seeking: A gossip-based algorithm , 2016, Autom..

[40]  Jean C. Walrand,et al.  An efficient Nash-implementation mechanism for network resource allocation , 2010, Autom..

[41]  Emilio Frazzoli,et al.  On synchronous robotic networks Part I: Models, tasks and complexity notions , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[42]  Claudio Altafini,et al.  Consensus Problems on Networks With Antagonistic Interactions , 2013, IEEE Transactions on Automatic Control.

[43]  Sergio Grammatico,et al.  Towards Time-Varying Proximal Dynamics in Multi-Agent Network Games , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[44]  Sergio Grammatico,et al.  An asynchronous, forward-backward, distributed generalized Nash equilibrium seeking algorithm , 2019, 2019 18th European Control Conference (ECC).

[45]  A. Stephen Morse,et al.  A Distributed Algorithm for Computing a Common Fixed Point of a Finite Family of Paracontractions , 2017, IEEE Transactions on Automatic Control.

[46]  Asuman E. Ozdaglar,et al.  Constrained Consensus and Optimization in Multi-Agent Networks , 2008, IEEE Transactions on Automatic Control.