Learning Equilibrium Play for Stochastic Parallel Gaussian Interference Channels

Distributed power control for parallel Gaussian interference channels recently draws great interests. However, all existing works only studied this problem under deterministic communication channels and required certain perfect information to carry out their proposed algorithms. In this paper, we study this problem for stochastic parallel Gaussian interference channels. In particular, we take into account the randomness of the communication environment and the estimation errors of the desired information, and thus formulate a stochastic noncooperative power control game. We then propose a stochastic distributed learning algorithm SDLA-I to help communication pairs learn the Nash equilibrium. A careful convergence analysis on SDLA-I is provided based on stochastic approximation theory and projected dynamic systems approach. We further propose another learning algorithm SDLA-II by including a simple iterate averaging idea into SDLA-I to improve algorithmic convergence performance. Numerical results are also presented to demonstrate the performance of our algorithms and theoretical results.

[1]  H. Kushner,et al.  Stochastic Approximation and Recursive Algorithms and Applications , 2003 .

[2]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[3]  H. Robbins A Stochastic Approximation Method , 1951 .

[4]  Sergio Barbarossa,et al.  Optimal Linear Precoding Strategies for Wideband Noncooperative Systems Based on Game Theory—Part I: Nash Equilibria , 2007, IEEE Transactions on Signal Processing.

[5]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[6]  S. Barbarossa,et al.  Asynchronous Iterative Waterfilling for Gaussian Frequency-Selective Interference Channels: A Unified Framework , 2007, 2007 Information Theory and Applications Workshop.

[7]  Mahesh K. Varanasi,et al.  Fast stochastic power control algorithms for nonlinear multiuser receivers , 2002, IEEE Trans. Commun..

[8]  Alfredo N. Iusem,et al.  On the projected subgradient method for nonsmooth convex optimization in a Hilbert space , 1998, Math. Program..

[9]  J. Massey,et al.  Communications and Cryptography: Two Sides of One Tapestry , 1994 .

[10]  Roy D. Yates,et al.  Stochastic power control for cellular radio systems , 1998, IEEE Trans. Commun..

[11]  Sergio Barbarossa,et al.  Optimal Linear Precoding Strategies for Wideband Non-Cooperative Systems Based on Game Theory—Part II: Algorithms , 2007, IEEE Transactions on Signal Processing.

[12]  Zhi-Quan Luo,et al.  Dynamic Spectrum Management: Complexity and Duality , 2008, IEEE Journal of Selected Topics in Signal Processing.

[13]  Sjur Didrik Flåm,et al.  Learning Equilibrium Play: A Myopic Approach , 1999, Comput. Optim. Appl..

[14]  Peter E. Caines,et al.  A Stochastic Approximation Approach to the Power-Control Problem , 2007, IEEE Transactions on Communications.

[15]  Wei Yu,et al.  Distributed multiuser power control for digital subscriber lines , 2002, IEEE J. Sel. Areas Commun..

[16]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[17]  Mihaela van der Schaar,et al.  Online Reinforcement Learning for Dynamic Multimedia Systems , 2009, IEEE Transactions on Image Processing.

[18]  J. G. Andrews,et al.  Interference cancellation for cellular systems: a contemporary overview , 2005, IEEE Wireless Communications.

[19]  Edward C. van der Meulen,et al.  Some Reflections On The Interference Channel , 1994 .

[20]  Kenneth W. Shum,et al.  Convergence of Iterative Waterfilling Algorithm for Gaussian Interference Channels , 2007, IEEE Journal on Selected Areas in Communications.

[21]  Vincent K. N. Lau,et al.  Distributive Power Control Algorithm for Multicarrier Interference Network Over Time-Varying Fading Channels—Tracking Performance Analysis and Optimization , 2010, IEEE Transactions on Signal Processing.

[22]  Simon Haykin,et al.  Robust Transmit Power Control for Cognitive Radio , 2009, Proceedings of the IEEE.

[23]  R. Rockafellar,et al.  On the interchange of subdifferentiation and conditional expectation for convex functionals , 1982 .

[24]  Zhi-Quan Luo,et al.  Analysis of Iterative Waterfilling Algorithm for Multiuser Power Control in Digital Subscriber Lines , 2006, EURASIP J. Adv. Signal Process..

[25]  A. Nagurney,et al.  Projected Dynamical Systems and Variational Inequalities with Applications , 1995 .

[26]  Boris Polyak,et al.  Acceleration of stochastic approximation by averaging , 1992 .

[27]  H. Kushner,et al.  Stochastic approximation with averaging and feedback: rapidly convergent "on-line" algorithms , 1995, IEEE Trans. Autom. Control..

[28]  Francisco Facchinei,et al.  Design of Cognitive Radio Systems Under Temperature-Interference Constraints: A Variational Inequality Approach , 2010, IEEE Transactions on Signal Processing.

[29]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[30]  F. Facchinei,et al.  Finite-Dimensional Variational Inequalities and Complementarity Problems , 2003 .