Adaptive channel allocation for wireless multimedia services using a Semi-Markov Decision Process

This paper considers adaptive resource allocation for elastic wireless multimedia services in service-oriented networks. To capture the dynamics of user arrivals and departures, the resource allocation problem for wireless multimedia services is formulated as a Semi-Markov Decision Process (SMDP). An optimal decision is made to maximize the overall system reward and the Quality of Service (QoS) of elastic wireless multimedia services based on the available network resources considering the balance between network income and resource costs. Results are presented which demonstrate that the proposed adaptive channel allocation technique for multimedia services can achieve higher system rewards and lower service blocking probabilities compared to the commonly employed greedy resource allocation algorithm.

[1]  Xuemin Shen,et al.  Rex: A randomized EXclusive region based scheduling scheme for mmWave WPANs with directional antenna , 2010, IEEE Transactions on Wireless Communications.

[2]  Ness B. Shroff,et al.  Optimal resource allocation in multi-class networks with user-specified utility functions , 2002, Comput. Networks.

[3]  Jun Cai,et al.  Adaptive Transmission of Multi-Layered Video over Wireless Fading Channels , 2007, IEEE Transactions on Wireless Communications.

[4]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[5]  J. A. Bather.  Markovian Decision Processes , 1971 .

[6]  Weihua Zhuang,et al.  Resource allocation with service differentiation for wireless video transmission , 2006, IEEE Transactions on Wireless Communications.

[7]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[8]  Xuemin Shen,et al.  Supporting voice and video applications over IEEE 802.11n WLANs , 2009, Wirel. Networks.

[9]  Catherine Rosenberg,et al.  A game theoretic framework for bandwidth allocation and pricing in broadband networks , 2000, TNET.

[10]  Pin-Han Ho,et al.  A cooperative multicast scheduling scheme for multimedia services in IEEE 802.16 networks , 2009, IEEE Transactions on Wireless Communications.

[11]  Daiyuan Peng,et al.  Adaptive resource allocation for media services based on semi-Markov decision process , 2010, 2010 International Conference on Information and Communication Technology Convergence (ICTC).