Game Theoretic Perspective of Optimal CSMA

Game-theoretic approaches have provided valuable insights into the design of robust local control rules for the individuals in multi-agent systems, e.g., Internet congestion control, road transportation networks, and so on. In this paper, we introduce a non-cooperative medium access control game for wireless networks and propose new fully distributed carrier sense multiple access (CSMA) algorithms that are provably optimal in the sense that their long-term throughputs converge to the optimal solution of a utility maximization problem over the maximum throughput region. The most significant part of our approach lies in introducing novel price functions in agents’ utilities so that the proposed game admits an ordinal potential function with no price-of-anarchy. The game formulation naturally leads to game-based dynamics finding a Nash equilibrium, but they often require global information. Toward our goal of designing fully distributed operations, we propose new game-inspired dynamics by utilizing a certain property of CSMA that enables links to estimate their temporary throughputs without message passing. They can be thought of as stochastic approximations to the standard dynamics, which is a new feature in our work, not prevalent in other traditional game-theoretic approaches. We show that they converge to a Nash equilibrium, and numerically evaluate their performance to support our theoretical findings.

[1]  Leandros Tassiulas,et al.  Stability properties of constrained queueing systems and scheduling policies for maximum throughput in multihop radio networks , 1992 .

[2]  L. Shapley,et al.  Potential Games , 1994 .

[3]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[4]  Leandros Tassiulas,et al.  Linear complexity algorithms for maximum throughput in radio networks and input queued switches , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[5]  Jean C. Walrand,et al.  Fair end-to-end window-based congestion control , 2000, TNET.

[6]  Zoubin Ghahramani,et al.  Graphical models: parameter learning , 2002 .

[7]  Sjur Didrik Flåm,et al.  Equilibrium, Evolutionary stability and Gradient Dynamics , 2002, IGTR.

[8]  George Kesidis,et al.  Equilibria of a noncooperative game for heterogeneous users of an ALOHA network , 2002, IEEE Communications Letters.

[9]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[10]  J. Hofbauer,et al.  Uncoupled Dynamics Do Not Lead to Nash Equilibrium , 2003 .

[11]  Stephen B. Wicker,et al.  Stability of multipacket slotted Aloha with selfish users and perfect information , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[12]  Saurabh Ganeriwal,et al.  On Cheating in CSMA/CA Ad Hoc Networks , 2004 .

[13]  Eitan Altman,et al.  Slotted Aloha as a game with partial information , 2004, Comput. Networks.

[14]  Ness B. Shroff,et al.  The impact of imperfect scheduling on cross-layer rate control in wireless networks , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[15]  Koushik Kar,et al.  Throughput modelling and fairness issues in CSMA/CA based ad-hoc networks , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[16]  R. Srikant,et al.  Scheduling Efficiency of Distributed Greedy Scheduling Algorithms in Wireless Networks , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[17]  Eytan Modiano,et al.  Maximizing throughput in wireless networks via gossiping , 2006, SIGMETRICS '06/Performance '06.

[18]  A. Robert Calderbank,et al.  Utility-Optimal Medium Access Control: Reverse and Forward Engineering , 2006, Proceedings IEEE INFOCOM 2006. 25TH IEEE International Conference on Computer Communications.

[19]  Xiaojun Lin,et al.  Constant-Time Distributed Scheduling Policies for Ad Hoc Wireless Networks , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[20]  Eytan Modiano,et al.  Polynomial Complexity Algorithms for Full Utilization of Multi-Hop Wireless Networks , 2007, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[21]  Ishai Menache,et al.  Fixed-Rate Equilibrium in Wireless Collision Channels , 2007, NET-COOP.

[22]  Lijun Chen,et al.  A Game-Theoretic Model for Medium Access Control , 2007 .

[23]  Roger Wattenhofer,et al.  Complexity in geometric SINR , 2007, MobiHoc '07.

[24]  George Kesidis,et al.  Distributed Contention Window Control for Selfish Users in IEEE 802.11 Wireless LANs , 2007, IEEE Journal on Selected Areas in Communications.

[25]  A. Robert Calderbank,et al.  Reverse-Engineering MAC: A Non-Cooperative Game Model , 2007, IEEE Journal on Selected Areas in Communications.

[26]  Ness B. Shroff,et al.  Performance of Random Access Scheduling Schemes in Multi-Hop Wireless Networks , 2006, IEEE INFOCOM 2007 - 26th IEEE International Conference on Computer Communications.

[27]  Lijun Chen,et al.  A Game-Theoretic Framework for Medium Access Control , 2008, IEEE Journal on Selected Areas in Communications.

[28]  Mung Chiang,et al.  Stochastic network utility maximisation - a tribute to Kelly's paper published in this journal a decade ago , 2008, Eur. Trans. Telecommun..

[29]  Prasanna Chaporkar,et al.  Throughput Guarantees Through Maximal Scheduling in Wireless Networks , 2008 .

[30]  V. Borkar Stochastic Approximation: A Dynamical Systems Viewpoint , 2008 .

[31]  Vincent W. S. Wong,et al.  Utility-optimal random access: Reduced complexity, fast convergence, and robust performance , 2009, IEEE Transactions on Wireless Communications.

[32]  Vincent W. S. Wong,et al.  Utility-optimal random access without message passing , 2009, IEEE Transactions on Wireless Communications.

[33]  Soung Chang Liew,et al.  Back-of-the-Envelope Computation of Throughput Distributions in CSMA Wireless Networks , 2007, 2009 IEEE International Conference on Communications.

[34]  H. Peyton Young,et al.  Learning by trial and error , 2009, Games Econ. Behav..

[35]  Devavrat Shah,et al.  Network adiabatic theorem: an efficient randomized protocol for contention resolution , 2009, SIGMETRICS '09.

[36]  R. Srikant,et al.  Distributed Link Scheduling With Constant Overhead , 2006, IEEE/ACM Transactions on Networking.

[37]  Eitan Altman,et al.  Stable Nash equilibria of ALOHA medium access games under symmetric, socially altruistic behavior , 2010, 49th IEEE Conference on Decision and Control (CDC).

[38]  Back-of-the-Envelope Computation of Throughput Distributions in CSMA Wireless Networks , 2010, IEEE Trans. Mob. Comput..

[39]  Alexandre Proutière,et al.  Resource Allocation over Network Dynamics without Timescale Separation , 2010, 2010 Proceedings IEEE INFOCOM.

[40]  Jiaping Liu,et al.  Towards utility-optimal random access without message passing , 2010, CMC 2010.

[41]  Jean C. Walrand,et al.  Distributed Random Access Algorithm: Scheduling and Congestion Control , 2009, IEEE Transactions on Information Theory.

[42]  Jean C. Walrand,et al.  Scheduling and Congestion Control for Wireless and Processing Networks , 2010, Synthesis Lectures on Communication Networks.

[43]  Jiang Libin,et al.  Scheduling and Congestion Control for Wireless and Processing Networks , 2010 .

[44]  Jean C. Walrand,et al.  A Distributed CSMA Algorithm for Throughput and Utility Maximization in Wireless Networks , 2010, IEEE/ACM Transactions on Networking.

[45]  Lijun Chen,et al.  Random Access Game and Medium Access Control Design , 2010, IEEE/ACM Transactions on Networking.

[46]  Jean C. Walrand,et al.  Approaching Throughput-Optimality in Distributed CSMA Scheduling Algorithms With Collisions , 2010, IEEE/ACM Transactions on Networking.

[47]  George Kesidis,et al.  A Channel Aware MAC Protocol in an ALOHA Network with Selfish Users , 2012, IEEE Journal on Selected Areas in Communications.

[48]  Jian Ni,et al.  Q-CSMA: Queue-Length-Based CSMA/CA Algorithms for Achieving Maximum Throughput and Low Delay in Wireless Networks , 2009, IEEE/ACM Transactions on Networking.

[49]  Jinwoo Shin,et al.  Optimal CSMA: A survey , 2012, 2012 IEEE International Conference on Communication Systems (ICCS).

[50]  Alexandre Proutière,et al.  Simulation-based optimization algorithms with applications to dynamic spectrum access , 2012, 2012 46th Annual Conference on Information Sciences and Systems (CISS).

[51]  Jason R. Marden,et al.  Designing games for distributed optimization , 2011, IEEE Conference on Decision and Control and European Control Conference.

[52]  Ness B. Shroff,et al.  Distributed CSMA Algorithms for Link Scheduling in Multihop MIMO Networks Under SINR Model , 2013, IEEE/ACM Transactions on Networking.

[53]  Jian Ni,et al.  Throughput-Optimal CSMA With Imperfect Carrier Sensing , 2013, IEEE/ACM Transactions on Networking.

[54]  Kamal Jamshidi,et al.  Game Theory Applications in CSMA Methods , 2013, IEEE Communications Surveys & Tutorials.

[55]  Jinwoo Shin,et al.  Distributed learning for utility maximization over CSMA-based wireless multihop networks , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[56]  Jinsung Lee,et al.  Making 802.11 DCF Near-Optimal: Design, Implementation, and Evaluation , 2016, IEEE/ACM Transactions on Networking.