Distributed Resource Allocation for Femtocell Networks: Regret Learning with Proportional Self-belief

Femtocell networks promise improvement in network quality and performance for dense wireless networks, but will suffer from inter-cell interference if resource management is not properly employed. This paper presents distributed joint resource allocation (sub-channel and power) to address co- and cross-tier interference issues in two-tier heterogeneous femtocell networks. Due to uncoordinated nature of femtocell base stations (HeNB) deployment, the interactions among self-interested HeNBs are formulated using game-theoretical tools. Then, we designed individual utility function for every HeNB in order to enforce cooperative behaviour among HeNBs as well as to avoid cross-tier interference towards macrocell user equipments within HeNB coverage. Based on the designed utility function, we propose a fully distributed adaptive learning algorithm with a proportional self-belief concept that can lead to correlated equilibrium with fast and decisive convergence. Finally, performance analysis on the proposed algorithm done in simulated environment showed positive results indicating improvements in terms of co- and cross-tier interference mitigation as compared to generic regret-based learning scheme and utility functions.

[1]  S. Hart,et al.  A simple adaptive procedure leading to correlated equilibrium , 2000 .

[2]  R. Aumann.  Correlated Equilibrium as an Expression of Bayesian Rationality Author ( s ) , 1987 .

[3]  Mihaela van der Schaar,et al.  On the Correlated Equilibrium Selection for Two-User Channel Access Games , 2009, IEEE Signal Processing Letters.

[4]  Jeffrey G. Andrews,et al.  Femtocell networks: a survey , 2008, IEEE Communications Magazine.

[5]  Hidekazu Murata,et al.  Potential Game Approach for Self-Organized Interference Management in Closed Access Femtocell Networks , 2011, 2011 IEEE 73rd Vehicular Technology Conference (VTC Spring).

[6]  Sergiu Hart,et al.  Existence of Correlated Equilibria , 1989, Math. Oper. Res..

[7]  Dong-Ho Cho,et al.  Cooperative Resource Allocation for Guaranteeing Intercell Fairness in Femtocell Networks , 2011, IEEE Communications Letters.

[8]  Vikram Krishnamurthy,et al.  Cognitive Base Stations in LTE/3GPP Femtocells: A Correlated Equilibrium Game-Theoretic Approach , 2011, IEEE Transactions on Communications.

[9]  Zhu Han,et al.  Game Theory in Wireless and Communication Networks , 2008 .

[10]  Richard S. Sutton,et al.  Introduction to Reinforcement Learning , 1998 .

[11]  Yueming Cai,et al.  Subcarrier allocation based on correlated equilibrium in multi-cell OFDMA systems , 2012, EURASIP Journal on Wireless Communications and Networking.

[12]  Ta-Sung Lee,et al.  Game theoretic distributed dynamic resource allocation with interference avoidance in cognitive femtocell networks , 2013, 2013 IEEE Wireless Communications and Networking Conference (WCNC).

[13]  Christian Ibars,et al.  Distributed interference control in OFDMA-based femtocells , 2010, 21st Annual IEEE International Symposium on Personal, Indoor and Mobile Radio Communications.

[14]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[15]  S. Lasaulce,et al.  Methodologies for analyzing equilibria in wireless games , 2009, IEEE Signal Process. Mag..

[16]  Zhu Han,et al.  Distributive Opportunistic Spectrum Access for Cognitive Radio using Correlated Equilibrium and No-Regret Learning , 2007, 2007 IEEE Wireless Communications and Networking Conference.

[17]  Mérouane Debbah,et al.  On the Nash Equilibria in Decentralized Parallel Interference Channels , 2011, 2011 IEEE International Conference on Communications Workshops (ICC).

[18]  Zhu Han,et al.  Game Theory in Wireless and Communication Networks: Theory, Models, and Applications , 2011 .

[19]  Richard S. Sutton,et al.  Reinforcement Learning , 1992, Handbook of Machine Learning.

[20]  R. Aumann.  Subjectivity and Correlation in Randomized Strategies , 1974 .

[21]  Mérouane Debbah,et al.  The Waterfilling Game-Theoretical Framework for Distributed Wireless Network Information Flow , 2010, EURASIP J. Wirel. Commun. Netw..

[22]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[23]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[24]  Zhongming Zheng,et al.  Cooperative Strategies for Energy-Aware Ad Hoc Networks: A Correlated-Equilibrium Game-Theoretical Approach , 2013, IEEE Transactions on Vehicular Technology.

[25]  Mehdi Bennis,et al.  Learning coarse correlated equilibria in two-tier wireless networks , 2012, 2012 IEEE International Conference on Communications (ICC).