Conjectural Equilibrium in Multiuser Power Control Games

This paper considers a noncooperative game in which competing users sharing a frequency-selective interference channel selfishly optimize their power allocation in order to improve their achievable rates. Previously, it was shown that a user having the knowledge of its opponents' channel state information can make foresighted decisions and substantially improve its performance compared with the case in which it deploys the conventional iterative water-filling algorithm, which does not exploit such knowledge. This paper discusses how a foresighted user can acquire this knowledge by modeling its experienced interference as a function of its own power allocation. To characterize the outcome of the multiuser interaction, the conjectural equilibrium is introduced, and the existence of this equilibrium for the investigated water-filling game is proven. Importantly, we show that both the Nash equilibrium and the Stackelberg equilibrium are special cases of the conjectural equilibrium. We also develop practical algorithms to form accurate beliefs and select desirable power allocation strategies. Numerical simulations indicate that a foresighted user without any a priori knowledge of its competitors' private information can effectively learn how the other users will respond to its actions, and induce the entire system to an operating point that improves both its own achievable rate as well as the rates of the other participants in the water-filling game.

[1]  Eitan Altman,et al.  A survey on networking games in telecommunications , 2006, Comput. Oper. Res..

[2]  Erik G. Larsson,et al.  Competition Versus Cooperation on the MISO Interference Channel , 2008, IEEE Journal on Selected Areas in Communications.

[3]  Michael L. Honig,et al.  Distributed interference compensation for wireless networks , 2006, IEEE Journal on Selected Areas in Communications.

[4]  Mihaela van der Schaar,et al.  A New Look at Multi-User Power Control Games , 2008, 2008 IEEE International Conference on Communications.

[5]  Zhu Han,et al.  WLC41-4: Stackelberg Game for Distributed Resource Allocation over Multiuser Cooperative Communication Networks , 2006, IEEE Globecom 2006.

[6]  Marc Moonen,et al.  Autonomous Spectrum Balancing for Digital Subscriber Lines , 2007, IEEE Transactions on Signal Processing.

[7]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[8]  Simon Haykin,et al.  Cognitive radio: brain-empowered wireless communications , 2005, IEEE Journal on Selected Areas in Communications.

[9]  Kenneth W. Shum,et al.  Convergence of Iterative Waterfilling Algorithm for Gaussian Interference Channels , 2007, IEEE Journal on Selected Areas in Communications.

[10]  Eitan Altman,et al.  S-modular games and power control in wireless networks , 2003, IEEE Trans. Autom. Control..

[11]  H. Vincent Poor,et al.  Energy-Efficient Resource Allocation in Wireless Networks , 2007, IEEE Signal Processing Magazine.

[12]  Sergio Barbarossa,et al.  Competitive Design of Multiuser MIMO Systems Based on Game Theory: A Unified View , 2008, IEEE Journal on Selected Areas in Communications.

[13]  R. Chandramouli,et al.  Stochastic Learning Solution for Distributed Discrete Power Control Game in Wireless Data Networks , 2008, IEEE/ACM Transactions on Networking.

[14]  Michael P. Wellman,et al.  Conjectural Equilibrium in Multiagent Learning , 1998, Machine Learning.

[15]  Eitan Altman,et al.  Closed Form Solutions for Symmetric Water Filling Games , 2007, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[16]  Dusit Niyato,et al.  Competitive Pricing for Spectrum Sharing in Cognitive Radio Networks: Dynamic Game, Inefficiency of Nash Equilibrium, and Collusion , 2008, IEEE Journal on Selected Areas in Communications.

[17]  Abhay Parekh,et al.  Spectrum sharing for unlicensed bands , 2005, IEEE Journal on Selected Areas in Communications.

[18]  Wei Yu,et al.  Dual methods for nonconvex spectrum optimization of multicarrier systems , 2006, IEEE Transactions on Communications.

[19]  Otilia Popescu,et al.  Simultaneous Water Filling in Mutually Interfering Systems , 2007, IEEE Transactions on Wireless Communications.

[20]  Zhi-Quan Luo,et al.  Analysis of Iterative Waterfilling Algorithm for Multiuser Power Control in Digital Subscriber Lines , 2006, EURASIP J. Adv. Signal Process..

[21]  Michael Bloem,et al.  A stackelberg game for power control and channel allocation in cognitive radio networks , 2007, VALUETOOLS.

[22]  Wei Yu,et al.  Distributed multiuser power control for digital subscriber lines , 2002, IEEE J. Sel. Areas Commun..

[23]  Bo Li,et al.  Non-cooperative power control for wireless ad hoc networks with repeated games , 2007, IEEE Journal on Selected Areas in Communications.

[24]  Vikram Krishnamurthy,et al.  ${Q}$-Learning Algorithms for Constrained Markov Decision Processes With Randomized Monotone Policies: Application to MIMO Transmission Control , 2007, IEEE Transactions on Signal Processing.

[25]  Ariel Orda,et al.  Architecting noncooperative networks , 1995, Eighteenth Convention of Electrical and Electronics Engineers in Israel.

[26]  K. J. Ray Liu,et al.  Near-optimal reinforcement learning framework for energy-aware sensor communications , 2005, IEEE Journal on Selected Areas in Communications.

[27]  Cristina Comaniciu,et al.  Adaptive Channel Allocation Spectrum Etiquette for Cognitive Radio Networks , 2005, First IEEE International Symposium on New Frontiers in Dynamic Spectrum Access Networks, 2005. DySPAN 2005..

[28]  K. Jittorntrum An implicit function theorem , 1978 .

[29]  Frank Hahn,et al.  EXERCISES IN CONJECTURAL EQUILIBRIA , 1977 .

[30]  Wei Yu,et al.  Optimal multiuser spectrum balancing for digital subscriber lines , 2006, IEEE Transactions on Communications.

[31]  Sachin Agarwal,et al.  A stackelberg game for pricing uplink power in wide-band cognitive radio networks , 2008, 2008 47th IEEE Conference on Decision and Control.

[32]  S. Kumagai An implicit function theorem: Comment , 1980 .

[33]  K. J. Ray Liu,et al.  Repeated open spectrum sharing game with cheat-proof strategies , 2009, IEEE Transactions on Wireless Communications.

[34]  Mung Chiang,et al.  Power Control in Wireless Cellular Networks , 2008, Found. Trends Netw..