Favor: fine-grained video rate adaptation

Video rate adaptation has large impact on quality of experience (QoE). However, existing video rate adaptation is rather limited due to a small number of rate choices, which results in (i) under-selection, (ii) rate fluctuation, and (iii) frequent rebuffering. Moreover, selecting a single video rate for a 360° video can be even more limiting, since not all portions of a video frame are equally important. To address these limitations, we identify new dimensions to adapt user QoE - dropping video frames, slowing down video play rate, and adapting different portions in 360° videos. These new dimensions along with rate adaptation give us a more fine-grained adaptation and significantly improve user QoE. We further develop a simple yet effective learning strategy to automatically adapt the buffer reservation to avoid performance degradation beyond optimization horizon. We implement our approach Favor in VLC, a well known open source media player, and demonstrate that Favor on average out-performs Model Predictive Control (MPC), rate-based, and buffer-based adaptation for regular videos by 24%, 36%, and 41%, respectively, and 2X for 360° videos.

[1]  Hermann Hellwagner,et al.  An evaluation of TCP-based rate-control algorithms for adaptive internet streaming of H.264/SVC , 2010, MMSys '10.

[2]  Wei Tsang Ooi,et al.  On tile assignment for region-of-interest video streaming in a wireless LAN , 2012, NOSSDAV '12.

[3]  Pamela C. Cosman,et al.  A Versatile Model for Packet Loss Visibility and its Application to Packet Prioritization , 2010, IEEE Transactions on Image Processing.

[4]  T. Nishimura,et al.  Traffic prediction for mobile network using Holt-Winter’s exponential smoothing , 2007, 2007 15th International Conference on Software, Telecommunications and Computer Networks.

[5]  Xinyu Zhang,et al.  POI360: Panoramic Mobile Video Telephony over LTE Cellular Networks , 2017, CoNEXT.

[6]  Yi-Hsuan Yang,et al.  Smooth Control of Adaptive Media Playout for Video Streaming , 2009, IEEE Transactions on Multimedia.

[7]  Hamed Ahmadi,et al.  Adaptive Multicast Streaming of Virtual Reality Content to Mobile Users , 2017, ACM Multimedia.

[8]  Ying Ju,et al.  QoE-based cross-layer design for video applications over LTE , 2013, Multimedia Tools and Applications.

[9]  Te-Yuan Huang,et al.  A buffer-based approach to rate adaptation: evidence from a large video streaming service , 2015, SIGCOMM 2015.

[10]  Pamela C. Cosman,et al.  Network-Based H.264/AVC Whole-Frame Loss Visibility Model and Frame Dropping Methods , 2012, IEEE Transactions on Image Processing.

[11]  Yong Liu,et al.  Towards agile and smooth video adaptation in dynamic HTTP streaming , 2012, CoNEXT '12.

[12]  Robert W. Heath,et al.  Loss Visibility Optimized Real-Time Video Transmission Over MIMO Systems , 2015, IEEE Transactions on Multimedia.

[13]  Adam Wolisz,et al.  EvalVid - A Framework for Video Transmission and Quality Evaluation , 2003, Computer Performance Evaluation / TOOLS.

[14]  Yanjiao Chen,et al.  From QoS to QoE: A Tutorial on Video Quality Assessment , 2015, IEEE Communications Surveys & Tutorials.

[15]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[16]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[17]  Shreesha Srinath,et al.  Design and Implementation of an “Approximate” Communication System for Wireless Media Applications , 2010, IEEE/ACM Transactions on Networking.

[18]  Mohammad Hosseini,et al.  Adaptive 360 VR Video Streaming: Divide and Conquer , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[19]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM.

[20]  Yan Zhou,et al.  Perceptual quality of video with frame rate variation: A subjective study , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[21]  Tihao Chiang,et al.  Content-Aware Adaptive Media Playout Controls for Wireless Video Streaming , 2007, IEEE Transactions on Multimedia.

[22]  Gwendal Simon,et al.  Viewport-adaptive navigable 360-degree video delivery , 2016, 2017 IEEE International Conference on Communications (ICC).

[23]  Feng Qian,et al.  Optimizing 360 video delivery over cellular networks , 2016, ATC@MobiCom.

[24]  Jean-François Macq,et al.  16K Cinematic VR Streaming , 2017, ACM Multimedia.

[25]  Ali C. Begen,et al.  An experimental evaluation of rate-adaptation algorithms in adaptive streaming over HTTP , 2011, MMSys.

[26]  Yao Wang,et al.  Modeling of transmission-loss-induced distortion in decoded video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Donald F. Towsley,et al.  Packet audio playout delay adjustment: performance bounds and algorithms , 1998, Multimedia Systems.

[28]  Bernd Girod,et al.  Adaptive media playout for low-delay video streaming over error-prone channels , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Frank E. Barmore Portraits of the Earth: A Mathematician Looks at Maps. Timothy G. Feeman , 2002 .

[30]  Timothy G. Feeman Portraits of the Earth , 1987 .

[31]  M. Ghanbari,et al.  IMPACT OF JITTER AND JERKINESS ON PERCEIVED VIDEO QUALITY , 2006 .

[32]  Vyas Sekar,et al.  Improving fairness, efficiency, and stability in HTTP-based adaptive video streaming with FESTIVE , 2012, CoNEXT '12.

[33]  Liam Murphy,et al.  Adaptive VoIP playout scheduling: assessing user satisfaction , 2005, IEEE Internet Computing.

[34]  Jianping Pan,et al.  Dynamic rate adaptation for adaptive video streaming in wireless networks , 2015, Signal Process. Image Commun..

[35]  Moncef Gabbouj,et al.  Rate adaptation for adaptive HTTP streaming , 2011, MMSys.

[36]  Qi He,et al.  On the predictability of large transfer TCP throughput , 2005, SIGCOMM '05.

[37]  Bernd Girod,et al.  Adaptive playout scheduling and loss concealment for voice communication over IP networks , 2003, IEEE Trans. Multim..

[38]  Yao Wang,et al.  Perceptual Quality of Video with Periodic Frame Rate and Quantization Variation-Subjective Studies and Analytical Modeling , 2014, ArXiv.

[39]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[40]  Victor C. M. Leung,et al.  Dynamic Quality Adaptation and Bandwidth Allocation for Adaptive Streaming Over Time-Varying Wireless Networks , 2017, IEEE Transactions on Wireless Communications.

[41]  Ali C. Begen,et al.  Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale , 2013, IEEE Journal on Selected Areas in Communications.

[42]  Krishna R. Pattipati,et al.  A control theoretic approach to ABR video streaming: A fresh look at PID-based rate adaptation , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[43]  Christian Timmerer,et al.  Towards Bandwidth Efficient Adaptive Streaming of Omnidirectional Video over HTTP: Design, Implementation, and Evaluation , 2017, MMSys.