Distributed resource allocation through utility design - Part I: optimizing the performance certificates via the price of anarchy

Game theory has emerged as a novel approach for the coordination of multiagent systems. A fundamental component of this approach is the design of a local utility function for each agent so that their selfish maximization achieves the global objective. In this paper we propose a novel framework to characterize and optimize the worst case performance (price of anarchy) of any resulting equilibrium as a function of the chosen utilities, thus providing a performance certificate for a large class of algorithms. More specifically, we consider a class of resource allocation problems, where each agent selects a subset of the resources with the goal of maximizing a welfare function. First, we show that any smoothness argument is inconclusive for the design problems considered. Motivated by this, we introduce a new approach providing a tight expression for the price of anarchy (PoA) as a function of the chosen utility functions. Leveraging this result, we show how to design the utilities so as to maximize the PoA through a tractable linear program. In Part II we specialize the results to submodular and supermodular welfare functions, discuss complexity issues and provide two applications.

[1]  A. Borodin,et al.  Oblivious and Non-oblivious Local Search for Combinatorial Optimization , 2012 .

[2]  Martin Gairing,et al.  Covering Games: Approximation through Non-cooperation , 2009, WINE.

[3]  Yang Song,et al.  Optimal gateway selection in multi-domain wireless networks: a potential game perspective , 2011, MobiCom.

[4]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[5]  Jason R. Marden,et al.  Wind plant power optimization through yaw control using a parametric model for wake effects—a CFD simulation study , 2016 .

[6]  Jason R. Marden,et al.  Cooperative Control and Potential Games , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[7]  Archie C. Chapman,et al.  A unifying framework for iterative approximate best-response algorithms for distributed constraint optimization problems1 , 2011, The Knowledge Engineering Review.

[8]  John Lygeros,et al.  On aggregative and mean field games with applications to electricity markets , 2016, 2016 European Control Conference (ECC).

[9]  Jason R. Marden,et al.  Game-Theoretic Learning in Distributed Control , 2017 .

[10]  Jason R. Marden,et al.  The Impact of Local Information on the Performance of Multiagent Systems , 2017, ArXiv.

[11]  Lacra Pavel,et al.  A distributed primal-dual algorithm for computation of generalized Nash equilibria via operator splitting methods , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[12]  Toyoki Kozai,et al.  Plant Factory: An Indoor Vertical Farming System for Efficient Quality Food Production , 2015 .

[13]  Robert Murphey,et al.  Target-Based Weapon Target Assignment Problems , 2000 .

[14]  Kirk Pruhs,et al.  The Price of Stochastic Anarchy , 2008, SAGT.

[15]  Nguyen Kim Thang,et al.  Game Efficiency through Linear Programming Duality , 2017, ITCS.

[16]  Jason R. Marden,et al.  Designing games for distributed optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[17]  Marina Thottan,et al.  Market sharing games applied to content distribution in ad hoc networks , 2004, IEEE Journal on Selected Areas in Communications.

[18]  Jason R. Marden,et al.  Optimizing the price of anarchy in concave cost sharing games , 2017, 2017 American Control Conference (ACC).

[19]  Tim Roughgarden,et al.  Local smoothness and the price of anarchy in splittable congestion games , 2015, J. Econ. Theory.

[20]  R. Aumann Correlated Equilibrium as an Expression of Bayesian Rationality Author ( s ) , 1987 .

[21]  Andreas S. Schulz,et al.  On the performance of user equilibria in traffic networks , 2003, SODA '03.

[22]  Tim Roughgarden,et al.  The Price of Anarchy in Auctions , 2016, J. Artif. Intell. Res..

[23]  F. Ramsey A Contribution to the Theory of Taxation , 1927 .

[24]  Christos H. Papadimitriou,et al.  Worst-case Equilibria , 1999, STACS.

[25]  Jason R. Marden,et al.  The Price of Selfishness in Network Coding , 2009, IEEE Transactions on Information Theory.

[26]  Marios M. Polycarpou,et al.  Cooperative Control of Distributed Multi-Agent Systems , 2001 .

[27]  H. Moulin,et al.  Strategyproof sharing of submodular costs:budget balance versus efficiency , 2001 .

[28]  Jason R. Marden,et al.  Multiagent Coverage Problems : The Trade-off Between Anarchy and Stability , 2018 .

[29]  L. Blume The Statistical Mechanics of Strategic Interaction , 1993 .

[30]  Tim Roughgarden,et al.  Selfish routing and the price of anarchy , 2005 .

[31]  Umang Bhaskar,et al.  Routing games , 2012 .

[32]  Christos H. Papadimitriou,et al.  The complexity of pure Nash equilibria , 2004, STOC '04.

[33]  Tim Roughgarden,et al.  The Limits of Smoothness: A Primal-Dual Framework for Price of Anarchy Bounds , 2010, WINE.

[34]  Kazushi Ishiyama,et al.  Magnetic micromachines for medical applications , 2002 .

[35]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[36]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Vahab S. Mirrokni,et al.  Robust Price of Anarchy Bounds via LP and Fenchel Duality , 2015, SODA.

[38]  Adam Wierman,et al.  Distributed Welfare Games , 2013, Oper. Res..

[39]  Tim Roughgarden,et al.  Generalized Efficiency Bounds in Distributed Resource Allocation , 2010, IEEE Transactions on Automatic Control.

[40]  L. Shapley,et al.  Potential Games , 1994 .

[41]  Hiroaki Kitano,et al.  RoboCup Rescue: search and rescue in large-scale disasters as a domain for autonomous agents research , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[42]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[43]  F. Qiu,et al.  Controlled In Vivo Swimming of a Swarm of Bacteria‐Like Microrobotic Flagella , 2015, Advanced materials.

[44]  Bryce L. Ferguson,et al.  Computing optimal taxes in atomic congestion games , 2019, NetEcon@SIGMETRICS.

[45]  Siddharth Barman,et al.  Tight approximation bounds for maximum multi-coverage , 2019, Mathematical Programming.

[46]  R. Rosenthal A class of games possessing pure-strategy Nash equilibria , 1973 .

[47]  Vittorio Bilò,et al.  A Unifying Tool for Bounding the Quality of Non-Cooperative Solutions in Weighted Congestion Games , 2011, Theory of Computing Systems.

[48]  Amit K. Roy-Chowdhury,et al.  Distributed multi-target tracking in a self-configuring camera network , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  B. Staehle,et al.  SENEKA - sensor network with mobile robots for disaster management , 2012, 2012 IEEE Conference on Technologies for Homeland Security (HST).

[50]  Jason R. Marden,et al.  Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[51]  Francesca Parise,et al.  Nash and Wardrop Equilibria in Aggregative Games With Coupling Constraints , 2017, IEEE Transactions on Automatic Control.

[52]  Nikhil R. Devanur,et al.  Online matching with concave returns , 2012, STOC '12.

[53]  Francesca Parise,et al.  Distributed computation of generalized Nash equilibria in quadratic aggregative games with affine coupling constraints , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[54]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[55]  Jason R. Marden,et al.  The importance of budget in efficient utility design , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[56]  Geir E. Dullerud,et al.  Distributed control design for spatially interconnected systems , 2003, IEEE Trans. Autom. Control..

[57]  Emilio Frazzoli,et al.  Toward a Systematic Approach to the Design and Evaluation of Automated Mobility-on-Demand Systems: A Case Study in Singapore , 2014 .

[58]  Jason R. Marden,et al.  Optimal Utility Design in Convex Distributed Welfare Games , 2018, 2018 Annual American Control Conference (ACC).

[59]  Jason R. Marden,et al.  Autonomous Vehicle-Target Assignment: A Game-Theoretical Formulation , 2007 .

[60]  Jason R. Marden,et al.  Design Tradeoffs in Concave Cost-Sharing Games , 2018, IEEE Transactions on Automatic Control.