Utility Design for Distributed Resource Allocation—Part I: Characterizing and Optimizing the Exact Price of Anarchy

Game theory has emerged as a fruitful paradigm for the design of networked multiagent systems. A fundamental component of this approach is the design of agents’ utility functions so that their self-interested maximization results in a desirable collective behavior. In this article, we focus on a well-studied class of distributed resource allocation problems, where each agent is requested to select a subset of resources with the goal of optimizing a given system-level objective. Our core contribution is the development of a novel framework to tightly characterize the worst-case performance of any resulting Nash equilibrium (price of anarchy) as a function of the chosen agents’ utility functions. Leveraging this result, we identify how to design such utilities so as to optimize the price of anarchy through a tractable linear program. This provides us with a priori performance certificates applicable to any existing learning algorithm capable of driving the system to an equilibrium. Part II of this article specializes these results to submodular and supermodular objectives, discusses the complexity of computing Nash equilibria, and provides multiple illustrations of the theoretical findings.

[1]  Siddharth Barman,et al.  Tight approximation bounds for maximum multi-coverage , 2019, Mathematical Programming.

[2]  B. Staehle,et al.  SENEKA - sensor network with mobile robots for disaster management , 2012, 2012 IEEE Conference on Technologies for Homeland Security (HST).

[3]  Nguyen Kim Thang,et al.  Game Efficiency through Linear Programming Duality , 2017, ITCS.

[4]  Jason R. Marden,et al.  Multiagent Maximum Coverage Problems: The Trade-off Between Anarchy and Stability , 2019, 2019 18th European Control Conference (ECC).

[5]  Jason R. Marden,et al.  Designing games for distributed optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[6]  Hiroaki Kitano,et al.  RoboCup Rescue: search and rescue in large-scale disasters as a domain for autonomous agents research , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[7]  D. Fudenberg,et al.  The Theory of Learning in Games , 1998 .

[8]  H. Moulin,et al.  Strategyproof sharing of submodular costs:budget balance versus efficiency , 2001 .

[9]  Tim Roughgarden,et al.  The Limits of Smoothness: A Primal-Dual Framework for Price of Anarchy Bounds , 2010, WINE.

[10]  Bryce L. Ferguson,et al.  Computing optimal taxes in atomic congestion games , 2019, NetEcon@SIGMETRICS.

[11]  Kazushi Ishiyama,et al.  Magnetic micromachines for medical applications , 2002 .

[12]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[13]  Francesca Parise,et al.  Distributed computation of generalized Nash equilibria in quadratic aggregative games with affine coupling constraints , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[14]  Kirk Pruhs,et al.  The Price of Stochastic Anarchy , 2008, SAGT.

[15]  Umang Bhaskar,et al.  Routing games , 2012 .

[16]  R. Aumann Correlated Equilibrium as an Expression of Bayesian Rationality Author ( s ) , 1987 .

[17]  Vahab S. Mirrokni,et al.  Robust Price of Anarchy Bounds via LP and Fenchel Duality , 2015, SODA.

[18]  Robert Murphey,et al.  Target-Based Weapon Target Assignment Problems , 2000 .

[19]  Andreas S. Schulz,et al.  On the Performance of User Equilibrium in Traffic Networks , 2015 .

[20]  F. Qiu,et al.  Controlled In Vivo Swimming of a Swarm of Bacteria‐Like Microrobotic Flagella , 2015, Advanced materials.

[21]  Martin Gairing,et al.  Covering Games: Approximation through Non-cooperation , 2009, WINE.

[22]  Asuman E. Ozdaglar,et al.  Distributed Subgradient Methods for Multi-Agent Optimization , 2009, IEEE Transactions on Automatic Control.

[23]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[24]  Jason R. Marden,et al.  Optimal Utility Design in Convex Distributed Welfare Games , 2018, 2018 Annual American Control Conference (ACC).

[25]  Sonia Martínez,et al.  Coverage control for mobile sensing networks , 2002, IEEE Transactions on Robotics and Automation.

[26]  Tim Roughgarden,et al.  Generalized Efficiency Bounds in Distributed Resource Allocation , 2010, IEEE Transactions on Automatic Control.

[27]  Jason R. Marden,et al.  Revisiting log-linear learning: Asynchrony, completeness and payoff-based implementation , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[28]  Francesca Parise,et al.  Nash and Wardrop Equilibria in Aggregative Games With Coupling Constraints , 2017, IEEE Transactions on Automatic Control.

[29]  Jason R. Marden,et al.  Design Tradeoffs in Concave Cost-Sharing Games , 2018, IEEE Transactions on Automatic Control.

[30]  Andreas S. Schulz,et al.  On the performance of user equilibria in traffic networks , 2003, SODA '03.

[31]  Marina Thottan,et al.  Market sharing games applied to content distribution in ad hoc networks , 2006, IEEE J. Sel. Areas Commun..

[32]  Christos H. Papadimitriou,et al.  The complexity of pure Nash equilibria , 2004, STOC '04.

[33]  Adam Wierman,et al.  Distributed Welfare Games , 2013, Oper. Res..

[34]  A. Borodin,et al.  Oblivious and Non-oblivious Local Search for Combinatorial Optimization , 2012 .

[35]  R. Rosenthal A class of games possessing pure-strategy Nash equilibria , 1973 .

[36]  Vittorio Bilò,et al.  A Unifying Tool for Bounding the Quality of Non-Cooperative Solutions in Weighted Congestion Games , 2011, Theory of Computing Systems.

[37]  L. Blume The Statistical Mechanics of Strategic Interaction , 1993 .

[38]  Geir E. Dullerud,et al.  Distributed control design for spatially interconnected systems , 2003, IEEE Trans. Autom. Control..

[39]  Emilio Frazzoli,et al.  Toward a Systematic Approach to the Design and Evaluation of Automated Mobility-on-Demand Systems: A Case Study in Singapore , 2014 .

[40]  Lacra Pavel,et al.  A distributed primal-dual algorithm for computation of generalized Nash equilibria via operator splitting methods , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[41]  Toyoki Kozai,et al.  Plant Factory: An Indoor Vertical Farming System for Efficient Quality Food Production , 2015 .

[42]  Christos H. Papadimitriou,et al.  Worst-case Equilibria , 1999, STACS.

[43]  Marios M. Polycarpou,et al.  Cooperative Control of Distributed Multi-Agent Systems , 2001 .

[44]  Tim Roughgarden,et al.  Algorithmic Game Theory , 2007 .