Steward: smart edge based joint QoE optimization for adaptive video streaming

With the increase of HTTP-based adaptive video streaming over the Internet, multiple clients may compete for a shared bottleneck bandwidth, which brings some damage to the fairness and stability of Quality of Experience (QoE). This paper presents Steward, a system that enforces multi-client joint QoE optimization for bottleneck bandwidth sharing. Joint QoE optimization refers to improving QoE fairness among clients with various video devices and providing differentiated service for clients with different priorities. Steward deploys the adaptive bitrate (ABR) algorithm based on neural networks (NN) and reinforcement learning at the network edge. The ABR agent trains the NN model through experience and makes appropriate bitrate guidance for video chunks to be requested by clients sharing the same bottleneck bandwidth. We compare Steward with state-of-the-art algorithms under different network conditions. Compared with all considered algorithms and conditions, Steward reduces 30%~85% QoE unfairness under the premise of differentiated service.

[1]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[2]  Phuoc Tran-Gia,et al.  Design and Performance Evaluation of Network-assisted Control Strategies for HTTP Adaptive Streaming , 2017, ACM Trans. Multim. Comput. Commun. Appl..

[3]  Mark Handley,et al.  TCP Congestion Window Validation , 2000, RFC.

[4]  Vyas Sekar,et al.  Improving fairness, efficiency, and stability in HTTP-based adaptive video streaming with FESTIVE , 2012, CoNEXT '12.

[5]  Alex Graves,et al.  Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[6]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[7]  Ali C. Begen,et al.  SDNDASH: Improving QoE of HTTP Adaptive Streaming Using Software Defined Networking , 2016, ACM Multimedia.

[8]  Manish Jain,et al.  End-to-end available bandwidth: measurement methodology, dynamics, and relation with TCP throughput , 2003, TNET.

[9]  Ali C. Begen,et al.  What happens when HTTP adaptive streaming players compete for bandwidth? , 2012, NOSSDAV '12.

[10]  Tarik Taleb,et al.  Online Server-Side Optimization Approach for Improving QoE of DASH Clients , 2017, GLOBECOM 2017 - 2017 IEEE Global Communications Conference.

[11]  Zdenek Becvar,et al.  Mobile Edge Computing: A Survey on Architecture and Computation Offloading , 2017, IEEE Communications Surveys & Tutorials.

[12]  Ali C. Begen,et al.  Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale , 2013, IEEE Journal on Selected Areas in Communications.

[13]  Karl Tuyls,et al.  Artificial agents learning human fairness , 2008, AAMAS.

[14]  Phuoc Tran-Gia,et al.  Design and experimental evaluation of network-assisted strategies for HTTP adaptive streaming , 2016, MMSys.

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Panagiotis Georgopoulos,et al.  Towards network-wide QoE fairness using openflow-assisted adaptive video streaming , 2013, FhMN@SIGCOMM.

[17]  Ali C. Begen,et al.  Server-based traffic shaping for stabilizing oscillating adaptive streaming players , 2013, NOSSDAV '13.

[18]  Nick McKeown,et al.  A network in a laptop: rapid prototyping for software-defined networks , 2010, Hotnets-IX.

[19]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[20]  Jia Wang,et al.  Locating internet bottlenecks: algorithms, measurements, and implications , 2004, SIGCOMM '04.