A separate-SMDP approximation technique for RRM in heterogeneous wireless networks

This paper proposes the separate-SMDP approximation technique to solve the dimensionality problem of the semi-Markov decision process (SMDP) model for radio resource management (RRM). The proposed separate-SMDP model approximates the original complex SMDP linear programming (LP) problem by building a series of simple SMDP LP problems. The estimated policy results are obtained by solving these LP problems in a distributed manner. Related algorithms are proposed to support the model in actual HWN RRM process. This technique not only greatly decreases the computational complexity of SMDP and solves its dimensionality problem, but also adapts well to actual RRM and provides a new horizon for utilizing SMDP.

[1]  Markus Dillinger,et al.  Investigation of radio resource scheduling in WLANs coupled with 3G cellular network , 2003, IEEE Commun. Mag..

[2]  S. Haykin,et al.  A Q-learning-based dynamic channel assignment technique for mobile communication systems , 1999 .

[3]  Vincent W. S. Wong,et al.  Connection Admission Control for Multiservice Integrated Cellular/WLAN System , 2008, IEEE Transactions on Vehicular Technology.

[4]  Caro Lucas,et al.  A Dynamic Fuzzy-Based Crossover Method for Genetic Algorithms , 2007 .

[5]  F. Richard Yu,et al.  Optimal Joint Session Admission Control in Integrated WLAN and CDMA Cellular Networks with Vertical Handoff , 2007, IEEE Transactions on Mobile Computing.

[6]  Marceau Coupechoux,et al.  Network Controlled Joint Radio Resource Management for Heterogeneous Networks , 2008, VTC Spring 2008 - IEEE Vehicular Technology Conference.

[7]  TaeChoong Chung,et al.  Natural Gradient Policy for Average Cost SMDP Problem , 2007, 19th IEEE International Conference on Tools with Artificial Intelligence(ICTAI 2007).

[8]  Mansoor Alam,et al.  Optimal CAC Policy in Multimedia Wireless Networks with Reservation Channel Schemes , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[9]  Yuanyuan Yang,et al.  A Flexible Platform for Hardware-Aware Network Experiments and a Case Study on Wireless Network Coding , 2010, INFOCOM.

[10]  Berna Sayraç,et al.  Statistical Learning for Automated RRM: Application to eUTRAN Mobility , 2009, 2009 IEEE International Conference on Communications.

[11]  Yan Shi,et al.  An SMDP-Based Optimal Admission Control Scheme in Cognitive Radio Networks , 2010, 2010 6th International Conference on Wireless Communications Networking and Mobile Computing (WiCOM).