LearnQoS: A Learning Approach for Optimizing QoS Over Multimedia-Based SDNs

As video-based services become an integral part of the end-users' lives, there is an imminent need for increase in the backhaul capacity and resource management efficiency to enable a highly enhanced multimedia experience to the end-users. The next-generation networking paradigm offers wide advantages over the traditional networks through simplifying the management layer, especially with the adoption of Software Defined Networks (SDN). However, enabling Quality of Service (QoS) provisioning still remains a challenge that needs to be optimized especially for multimedia-based applications. In this paper, we propose LearnQoS, an intelligent QoS management framework for multimedia-based SDNs. LearnQoS employs a policy-based network management (PBNM) to ensure the compliance of QoS requirements and optimizes the operation of PBNM through Reinforcement Learning (RL). The proposed LearnQoS framework is implemented and evaluated under an experimental setup environment and compared with the default SDN operation in terms of PSNR, MOS, throughput and packet loss.

[1]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[2]  Orhan Gemikonakli,et al.  BaProbSDN: A probabilistic-based QoS routing mechanism for Software Defined Networks , 2015, Proceedings of the 2015 1st IEEE Conference on Network Softwarization (NetSoft).

[3]  Ramona Trestian,et al.  QoS-based routing over software defined networks , 2017, 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[4]  Narciso García,et al.  Design, optimization and evaluation of a q-learning HTTP adaptive streaming client , 2016, IEEE Transactions on Consumer Electronics.

[5]  Jaime Lloret,et al.  Including artificial intelligence in a routing protocol using Software Defined Networks , 2017, 2017 IEEE International Conference on Communications Workshops (ICC Workshops).

[6]  Majd Latah,et al.  Application of Artificial Intelligence to Software Defined Networking A Survey , 2016 .

[7]  Vladimir Deart,et al.  HTTP Traffic Measurements on Access Networks, Analysis of Results and Simulation , 2009, NEW2AN.

[8]  Ian F. Akyildiz,et al.  QoS-Aware Adaptive Routing in Multi-layer Hierarchical Software Defined Networks: A Reinforcement Learning Approach , 2016, 2016 IEEE International Conference on Services Computing (SCC).

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[10]  Phuoc Tran-Gia,et al.  Towards QoE Management for Scalable Video Streaming , 2011 .

[11]  Müge Sayit,et al.  Learning-based approach for layered adaptive video streaming over SDN , 2015, Comput. Networks.

[12]  Ramona Trestian,et al.  Seamless Multimedia Delivery Within a Heterogeneous Wireless Networks Environment: Are We There Yet? , 2018, IEEE Communications Surveys & Tutorials.

[13]  Orhan Gemikonakli,et al.  Compression-based technique for SDN using sparse-representation dictionary , 2016, NOMS 2016 - 2016 IEEE/IFIP Network Operations and Management Symposium.

[14]  Dimitri Ktenas,et al.  QoS-Driven Scheduling in 5G Radio Access Networks - A Reinforcement Learning Approach , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.