MDP-based resource allocation for triple-play transmission on xDSL systems

Many broadband services are based on multimedia applications, such as voice over internet protocol (VoIP), video conferencing, video on demand (VoD), and internet protocol television (IPTV). The combination "triple-play" is often used with IPTV. It simply means offering voice, video and data. IPTV and others services uses digital broadband networks such as ADSL2+ (Asymmetric Digital Subscriber Line) and VDSL (Very High Rate DSL) to transmit the data. We have formulated a MDP (Markov Decision Process) for a triple-play transmission on DSL environment. In this paper, we establish the relationship between DSL transmission characteristics and its finite-state Markov model for a triple-play transmission system. This relationship can be used for a resource management for multimedia applications delivered through a broadband infrastructure. The solution to our optimization problem can be found using dynamic programming (DP) techniques, such as value iteration and its variants. Our study results in a transmission strategy that chooses the optimal resource allocation according the triple-play traffic requirements, defined in technical report TR-126 (Triple-Play Services Quality of Experience Requirements) from DSL Forum, minimizing quality of service (QoS) violations with respect to bandwidth. Three traffic classes (video, audio, and best effort internet data) are defined and analyzed. Our simulation results show parameters like as blocking probability for each class, link utilization and optimal control policies. The MDP-based approach provides a satisfactory way of resource management for a DSL system.

[1]  John M. Cioffi,et al.  Understanding Digital Subscriber Line Technology , 1999 .

[2]  H. Tijms A First Course in Stochastic Models , 2003 .

[3]  J.-M. Bonnin,et al.  QoS issues in Wi-Fi-WMM based triple play home networks , 2006, CCNC 2006. 2006 3rd IEEE Consumer Communications and Networking Conference, 2006..

[4]  Victor C. M. Leung,et al.  A new QoS provisioning method for adaptive multimedia in cellular wireless networks , 2004, IEEE INFOCOM 2004.

[5]  Chen-Khong Tham,et al.  Self-Optimizing Architecture for QoS Provisioning in Differentiated Services , 2005, Second International Conference on Autonomic Computing (ICAC'05).

[6]  I.S. Venieris,et al.  Triple Play Service Simulation and Packet Scheduling Performance Evaluation , 2006, International Conference on Digital Telecommunications (ICDT'06).

[7]  K. J. Ray Liu,et al.  A near-optimal reinforcement learning scheme for energy efficient point-to-point wireless communications , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[8]  Chen-Khong Tham,et al.  Adaptive QoS provisioning in wireless ad hoc networks: a semi-MDP approach , 2005, IEEE Wireless Communications and Networking Conference, 2005.

[9]  Ness B. Shroff,et al.  Admission control schemes to provide class-level QoS in multiservice networks , 2001, Comput. Networks.

[10]  Jalal Almhana,et al.  Online optimal data transmission strategy under Markov channel , 2005, ICPS '05. Proceedings. International Conference on Pervasive Services, 2005..

[11]  Ren-Hung Hwang,et al.  Hierarchical QoS routing in ATM networks based on MDP cost function , 2000, Proceedings IEEE International Conference on Networks 2000 (ICON 2000). Networking Trends and Challenges in the New Millennium.