Vabis: Video Adaptation Bitrate System for Time-Critical Live Streaming

With the rise of time-critical and interactive scenarios, ultra-low latency has become the most urgent requirement. Adaptive bitrate (ABR) schemes have been widely used in reducing latency for live streaming services. However, the traditional solutions suffer from a key limitation: they only utilize coarse-grained chunk to solve the I-frame misalignment problem in different bitrate switching process at the cost of increasing latency. As a result, existing schemes are difficult to guarantee the timeliness and granularity of control in essence. In this paper, we use a frame-based approach to solve the I-frame misalignment problem and propose a video adaptation bitrate system (Vabis) in units of the frame for time-critical live streaming to obtain the optimal quality of experience (QoE). On the server-side, a Few-Wait ABR algorithm based on Reinforcement Learning (RL) is designed to adaptively select the bitrate of future frames by state information that can be observed, which can subtly solve the problem of I-frame misalignment. A rule-based ABR algorithm is designed to optimize the Vabis system for the weak network. On the client-side, three delay control mechanisms are designed to achieve frame-based fine-grained control. We construct a trace-driven simulator and the real live platform to evaluate the comprehensive live streaming performance. The results show that Vabis is significantly better than the existing methods with decreases in an average delay of 32%–77% and improvements in average QoE of 28–67%.

[1]  Zongpeng Li,et al.  A Geometric Approach to Server Selection for Interactive Video Streaming , 2016, IEEE Transactions on Multimedia.

[2]  Mohamed Ibrahim,et al.  Realization and Evaluation of an End-to-End Low Latency Live DASH System , 2018, 2018 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[3]  Alec Radford,et al.  Proximal Policy Optimization Algorithms , 2017, ArXiv.

[4]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM.

[5]  Christian Timmerer,et al.  Bandwidth prediction in low-latency chunked streaming , 2019, NOSSDAV.

[6]  Nick McKeown,et al.  Confused, timid, and unstable: picking a video streaming rate is hard , 2012, Internet Measurement Conference.

[7]  Bo Li,et al.  Coping With Heterogeneous Video Contributors and Viewers in Crowdsourced Live Streaming: A Cloud-Based Approach , 2016, IEEE Transactions on Multimedia.

[8]  Luca De Cicco,et al.  Feedback control for adaptive live video streaming , 2011, MMSys.

[9]  Filip De Turck,et al.  HTTP/2-Based Adaptive Streaming of HEVC Video Over 4G/LTE Networks , 2016, IEEE Communications Letters.

[10]  Yoonjung Park,et al.  ChildAR-bot: Educational Playing Projection-based AR Robot for Children , 2018, ACM Multimedia.

[11]  Ramesh K. Sitaraman,et al.  From theory to practice: improving bitrate adaptation in the DASH reference player , 2018, MMSys.

[12]  Matti Siekkinen,et al.  CloudVR: Cloud Accelerated Interactive Mobile Virtual Reality , 2018, ACM Multimedia.

[13]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[14]  Hari Balakrishnan,et al.  Mahimahi: Accurate Record-and-Replay for HTTP , 2015, USENIX Annual Technical Conference.

[15]  Jianfei Cai,et al.  Optimizing Quality of Experience for Adaptive Bitrate Streaming via Viewer Interest Inference , 2018, IEEE Transactions on Multimedia.

[16]  Peter Lambert,et al.  Video Encoder Architecture for Low-Delay Live-Streaming Events , 2017, IEEE Transactions on Multimedia.

[17]  Filip De Turck,et al.  An HTTP/2 Push-Based Approach for Low-Latency Live Streaming with Super-Short Segments , 2017, Journal of Network and Systems Management.

[18]  Haitian Pang,et al.  Optimizing Personalized Interaction Experience in Crowd-Interactive Livecast: A Cloud-Edge Approach , 2018, ACM Multimedia.

[19]  Jun Sun,et al.  Adaptive Video Streaming With Optimized Bitstream Extraction and PID-Based Quality Control , 2016, IEEE Transactions on Multimedia.

[20]  Ke Liu,et al.  Achieving high throughput and low delay in mobile data networks by accurately predicting queue lengths , 2015, Conf. Computing Frontiers.

[21]  Cisco Visual Networking Index: Forecast and Methodology 2016-2021.(2017) http://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual- networking-index-vni/complete-white-paper-c11-481360.html. High Efficiency Video Coding (HEVC) Algorithms and Architectures https://jvet.hhi.fraunhofer. , 2017 .

[22]  Bo Li,et al.  An Empirical Study of Flash Crowd Dynamics in a P2P-Based Live Video Streaming System , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[23]  Ali C. Begen,et al.  Server-based traffic shaping for stabilizing oscillating adaptive streaming players , 2013, NOSSDAV '13.

[24]  Bo Li,et al.  Flash Crowd in P2P Live Streaming Systems: Fundamental Characteristics and Design Implications , 2012, IEEE Transactions on Parallel and Distributed Systems.

[25]  Guihai Chen,et al.  Mobile Live Video Streaming Optimization via Crowdsourcing Brokerage , 2017, IEEE Transactions on Multimedia.

[26]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[27]  Ramesh K. Sitaraman,et al.  BOLA: Near-Optimal Bitrate Adaptation for Online Videos , 2016, IEEE/ACM Transactions on Networking.

[28]  Carsten Griwodz,et al.  Commute path bandwidth traces from 3G networks: analysis and applications , 2013, MMSys.

[29]  Ali C. Begen,et al.  An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP , 2011, MMSys.

[30]  Vyas Sekar,et al.  Improving fairness, efficiency, and stability in HTTP-based adaptive video streaming with FESTIVE , 2012, CoNEXT '12.

[31]  Alex Graves,et al.  Asynchronous Methods for Deep Reinforcement Learning , 2016, ICML.

[32]  Bo Han,et al.  Jaguar: Low Latency Mobile Augmented Reality with Flexible Tracking , 2018, ACM Multimedia.

[33]  Lifeng Sun,et al.  QARC: Video Quality Aware Rate Control for Real-Time Video Streaming based on Deep Reinforcement Learning , 2018, ACM Multimedia.

[34]  Ryan Shea,et al.  Live Broadcast With Community Interactions: Bottlenecks and Optimizations , 2017, IEEE Transactions on Multimedia.

[35]  Jordi Mongay Batalla,et al.  ABMA+: lightweight and efficient algorithm for HTTP adaptive streaming , 2016, MMSys.

[36]  Luca De Cicco,et al.  ELASTIC: A Client-Side Controller for Dynamic Adaptive Streaming over HTTP (DASH) , 2013, 2013 20th International Packet Video Workshop.

[37]  Takanori Hayashi,et al.  Parametric Quality-Estimation Model for Adaptive-Bitrate-Streaming Services , 2017, IEEE Transactions on Multimedia.

[38]  Sergey Levine,et al.  Trust Region Policy Optimization , 2015, ICML.

[39]  Pradipta De,et al.  HotDASH: Hotspot Aware Adaptive Video Streaming Using Deep Reinforcement Learning , 2018, 2018 IEEE 26th International Conference on Network Protocols (ICNP).

[40]  Ali C. Begen,et al.  Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale , 2013, IEEE Journal on Selected Areas in Communications.

[41]  Lakshminarayanan Subramanian,et al.  Adaptive Congestion Control for Unpredictable Cellular Networks , 2015, Comput. Commun. Rev..

[42]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[43]  Ramesh K. Sitaraman,et al.  Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs , 2012, IEEE/ACM Transactions on Networking.

[44]  Yi Sun,et al.  CS2P: Improving Video Bitrate Selection and Adaptation with Data-Driven Throughput Prediction , 2016, SIGCOMM.

[45]  Elman Mansimov,et al.  Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation , 2017, NIPS.

[46]  Jun Zhu,et al.  Video-to-Video Translation with Global Temporal Consistency , 2018, ACM Multimedia.

[47]  Te-Yuan Huang,et al.  A buffer-based approach to rate adaptation: evidence from a large video streaming service , 2015, SIGCOMM 2015.