Spatial spectrum access game: nash equilibria and distributed learning

A key feature of wireless communications is the spatial reuse. However, the spatial aspect is not yet well understood for the purpose of designing efficient spectrum sharing mechanisms. In this paper, we propose a framework of spatial spectrum access games on directed interference graphs, which can model quite general interference relationship with spatial reuse in wireless networks. We show that a pure strategy equilibrium exists for the two classes of games: (1) any spatial spectrum access games on directed acyclic graphs, and (2) any games satisfying the congestion property on directed trees and directed forests. Under mild technical conditions, the spatial spectrum access games with random backoff and Aloha channel contention mechanisms on undirected graphs also have a pure Nash equilibrium. We then propose a distributed learning algorithm, which only utilizes users' local observations to adaptively adjust the spectrum access strategies. We show that the distributed learning algorithm can converge to an approximate mixed-strategy Nash equilibrium for any spatial spectrum access games. Numerical results demonstrate that the distributed learning algorithm achieves up to 100% performance improvement over a random access algorithm.

[1]  E. Melo CONGESTION PRICING AND LEARNING IN TRAFFIC NETWORK GAMES , 2011 .

[2]  Jianwei Huang,et al.  Convergence Dynamics of Resource-Homogeneous Congestion Games , 2011, GAMENETS.

[3]  Dusit Niyato,et al.  Competitive spectrum sharing in cognitive radio networks: a dynamic game approach , 2008, IEEE Transactions on Wireless Communications.

[4]  Ao Tang,et al.  Opportunistic Spectrum Access with Multiple Users: Learning under Competition , 2010, 2010 Proceedings IEEE INFOCOM.

[5]  Devavrat Shah,et al.  Dynamics in congestion games , 2010, SIGMETRICS '10.

[6]  K. J. Ray Liu,et al.  Game theory for cognitive radio networks: An overview , 2010, Comput. Networks.

[7]  L. Shapley,et al.  Potential Games , 1994 .

[8]  Xu Chen,et al.  Evolutionarily Stable Open Spectrum Access in a Many-Users Regime , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[9]  H. Kushner,et al.  Stochastic Approximation and Recursive Algorithms and Applications , 2003 .

[10]  J. Nash Equilibrium Points in N-Person Games. , 1950, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Jean-Pierre Hubaux,et al.  Efficient MAC in cognitive radio systems: A game-theoretic approach , 2009, IEEE Transactions on Wireless Communications.

[12]  Frank Harary,et al.  Graph Theory , 2016 .

[13]  Vittorio Bilò,et al.  Graphical congestion games with linear latencies , 2008, SPAA '08.

[14]  Ian F. Akyildiz,et al.  NeXt generation/dynamic spectrum access/cognitive radio wireless networks: A survey , 2006, Comput. Networks.

[15]  Robert Wilson,et al.  A global Newton method to compute Nash equilibria , 2003, J. Econ. Theory.

[16]  Aranyak Mehta,et al.  A note on approximate Nash equilibria , 2006, Theor. Comput. Sci..

[17]  Xu Chen,et al.  Imitative spectrum access , 2012, 2012 10th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks (WiOpt).

[18]  Qing Zhao,et al.  Decentralized multi-armed bandit with multiple distributed players , 2010, 2010 Information Theory and Applications Workshop (ITA).

[19]  Zhu Han,et al.  Distributive Opportunistic Spectrum Access for Cognitive Radio using Correlated Equilibrium and No-Regret Learning , 2007, 2007 IEEE Wireless Communications and Networking Conference.

[20]  Cristina Comaniciu,et al.  Adaptive Channel Allocation Spectrum Etiquette for Cognitive Radio Networks , 2005, First IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks, 2005. DySPAN 2005..

[21]  I. Milchtaich,et al.  Congestion Games with Player-Specific Payoff Functions , 1996 .

[22]  Martin B. H. Weiss,et al.  Dynamic Geospatial Spectrum Modelling: Taxonomy, Options and Consequences , 2010 .

[23]  Mingyan Liu,et al.  Atomic Congestion Games on Graphs and Their Applications in Networking , 2012, IEEE/ACM Transactions on Networking.