Network selection in heterogeneous wireless networks using learning automata

A main target of the next generation wireless networks is to integrate multiple wireless access technologies to provide seamless mobility to mobile users with high-speed wireless connectivity. Network selection is one of the most significant challenges for load balancing to avoid network congestion and performance degradation because of the heterogeneous wireless access environment in next-generation wireless heterogenous networks. In this paper, we present an efficient network selection mechanism to guarantee mobile users selecting a most appropriate wireless network to connect from the heterogenous wireless networks using the theory of games. We prove the network selection game is a potential game, and the solution to the sum rate maximization problem constitutes a feasible pure strategy Nash equilibrium (NE) of the formulated game. Furthermore, a distributed algorithm to learn the NE of the proposed game with limited feedback is presented based on the concept of learning automata. Simulations show that this algorithm which outperforms random selection algorithm in a highly efficient manner can converge to the NE with our designed utility function and achieve near optimal or optimal sum rate performance.

[1]  Alagan Anpalagan,et al.  Opportunistic Spectrum Access in Cognitive Radio Networks: Global Optimization Using Local Interaction Games , 2012, IEEE Journal of Selected Topics in Signal Processing.

[2]  王家恒,et al.  Energy Efficient Discrete Spectrum Sharing Strategy Selection in Cognitive MIMO Interference Channels , 2013 .

[3]  Chung-Ju Chang,et al.  Utility and Game-Theory Based Network Selection Scheme in Heterogeneous Wireless Networks , 2009, 2009 IEEE Wireless Communications and Networking Conference.

[4]  Meixia Tao,et al.  Game Theoretic Multimode Precoding Strategy Selection for MIMO Multiple Access Channels , 2010, IEEE Signal Processing Letters.

[5]  Huaglory Tianfield,et al.  Game-Theoretic Opportunistic Spectrum Sharing Strategy Selection for Cognitive MIMO Multiple Access Channels , 2011, IEEE Transactions on Signal Processing.

[6]  Ian F. Akyildiz,et al.  A ubiquitous mobile communication architecture for next-generation heterogeneous wireless systems , 2005, IEEE Communications Magazine.

[7]  Dusit Niyato,et al.  Dynamics of Network Selection in Heterogeneous Wireless Networks: An Evolutionary Game Approach , 2009, IEEE Transactions on Vehicular Technology.

[8]  L. Shapley,et al.  Potential Games , 1994 .

[9]  Rittwik Jana,et al.  Network selection for secondary users in cognitive radio systems , 2011, 2011 Proceedings IEEE INFOCOM.

[10]  Meixia Tao,et al.  Precoding Strategy Selection for Cognitive MIMO Multiple Access Channels Using Learning Automata , 2010, 2010 IEEE International Conference on Communications.

[11]  L. Shapley,et al.  REGULAR ARTICLEPotential Games , 1996 .

[12]  Roger B. Myerson,et al.  Game theory - Analysis of Conflict , 1991 .

[13]  Victor C. M. Leung,et al.  A Distributed Network Selection Scheme in Next Generation Heterogeneous Wireless Networks , 2009, 2009 IEEE Wireless Communications and Networking Conference.

[14]  Dusit Niyato,et al.  Optimal Bandwidth Allocation with Dynamic Service Selection in Heterogeneous Wireless Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[15]  Dusit Niyato,et al.  A Noncooperative Game-Theoretic Framework for Radio Resource Management in 4G Heterogeneous Wireless Access Networks , 2008, IEEE Transactions on Mobile Computing.

[16]  V. V. Phansalkar,et al.  Decentralized Learning of Nash Equilibria in Multi-Person Stochastic Games With Incomplete Information , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[17]  Vincent W. S. Wong,et al.  An MDP-Based Vertical Handoff Decision Algorithm for Heterogeneous Wireless Networks , 2008, IEEE Transactions on Vehicular Technology.