QoE evaluation of dynamic adaptive streaming over HTTP (DASH) with promising transport layer protocols

Recently, dynamic adaptive streaming over HTTP (DASH) has become an increasingly popular way to view video over the Internet. In particular compared to other video streaming services these DASH approaches deliver superior QoE to viewers. This is due to improved video segment selection. Generally, Transmission Control Protocol (TCP) CUBIC is the defacto transport layer protocol use by DASH. To improve the robustness of the transport layer to network congestion many other TCP variants were implemented such as Compound TCP and BBR. Nevertheless some were made to work specifically in LAN environments for example Agile-SD. However, recently another transport layer protocol User Datagram Protocol (UDP) has been used in Google’s QUIC implementation. To date no work has be found giving the performance of these transport layer protocols with DASH. In this paper we test the performance of Agile-SD, CUBIC, Compound TCP, BBR and QUIC using the BBA, MPC, Pensieve and Oboe DASH approaches. Experiments simulate congested bottleneck link conditions common at household routers where families view multiple videos at the same time. We observe Oboe and Agile-SD is the most promising combination with CUBIC and Pensieve next. However, even though QUIC was touted to have superior transport layer performance by Google it was the worst performing.

[1]  Christos Politis,et al.  An Adaptive QoS Routing Solution for MANET Based Multimedia Communications in Emergency Cases , 2009, MOBILIGHT.

[2]  Ali C. Begen,et al.  Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale , 2013, IEEE Journal on Selected Areas in Communications.

[3]  Bogdan M. Wilamowski,et al.  The Transmission Control Protocol , 2005, The Industrial Information Technology Handbook.

[4]  Colin Perkins,et al.  Explicit Congestion Notification (ECN) for RTP over UDP , 2012, RFC.

[5]  Luigi Rizzo,et al.  Dummynet: a simple approach to the evaluation of network protocols , 1997, CCRV.

[6]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[7]  Srinivasan Seshan,et al.  Developing a predictive model of quality of experience for internet video , 2013, SIGCOMM.

[8]  Wayne Goodridge,et al.  B-DASH: broadcast-based dynamic adaptive streaming over HTTP , 2019 .

[9]  Qian Zhang,et al.  Compound TCP: A scalable and TCP-friendly congestion control for high-speed networks , 2006 .

[10]  Ragnhild Eg,et al.  Flicker effects in adaptive video streaming to handheld devices , 2011, ACM Multimedia.

[11]  KyoungSoo Park,et al.  Why Is HTTP Adaptive Streaming So Hard? , 2015, APSys.

[12]  O. Oyman,et al.  Quality of experience for HTTP adaptive streaming services , 2012, IEEE Communications Magazine.

[13]  Ali C. Begen,et al.  What happens when HTTP adaptive streaming players compete for bandwidth? , 2012, NOSSDAV '12.

[14]  Tobias Hoßfeld,et al.  Internet Video Delivery in YouTube: From Traffic Measurements to Quality of Experience , 2013, Data Traffic Monitoring and Analysis.

[15]  Mun Choon Chan,et al.  Sync-TCP: A new approach to high speed congestion control , 2009, 2009 17th IEEE International Conference on Network Protocols.

[16]  Injong Rhee,et al.  CUBIC: a new TCP-friendly high-speed TCP variant , 2008, OPSR.

[17]  Raj Jain,et al.  Analysis of the Increase and Decrease Algorithms for Congestion Avoidance in Computer Networks , 1989, Comput. Networks.

[18]  Yaser Al Mtawa,et al.  Does Internet of Things Disrupt Residential Bandwidth Consumption? , 2018, 2018 IEEE 88th Vehicular Technology Conference (VTC-Fall).

[19]  Sebastian Möller,et al.  GamingVideoSET: A Dataset for Gaming Video Streaming Applications , 2018, 2018 16th Annual Workshop on Network and Systems Support for Games (NetGames).

[20]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[21]  Aaron Weinberg,et al.  Student learning and sense-making from video lectures , 2018 .

[22]  Rocky K. C. Chang,et al.  Measuring the quality of experience of HTTP video streaming , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[23]  Yining Qi,et al.  The Effect of Frame Freezing and Frame Skipping on Video Quality , 2006, 2006 International Conference on Intelligent Information Hiding and Multimedia.

[24]  Van Jacobson,et al.  BBR: Congestion-Based Congestion Control , 2016, ACM Queue.

[25]  Ramesh K. Sitaraman,et al.  BOLA: Near-Optimal Bitrate Adaptation for Online Videos , 2016, IEEE/ACM Transactions on Networking.

[26]  Paul Francis,et al.  The IP Network Address Translator (NAT) , 1994, RFC.

[27]  Tobias Hoßfeld,et al.  User Behavior and Engagement of a Mobile Video Streaming User from Crowdsourced Measurements , 2019, 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX).

[28]  Luca De Cicco,et al.  HTTP over UDP: an experimental investigation of QUIC , 2015, SAC.

[29]  Luca De Cicco,et al.  An Adaptive Video Streaming Control System: Modeling, Validation, and Performance Evaluation , 2014, IEEE/ACM Transactions on Networking.

[30]  Konstantina Papagiannaki,et al.  Is the Web HTTP/2 Yet? , 2016, PAM.

[31]  Hayder Al-Kashoash Optimization-Based Hybrid Congestion Alleviation , 2020 .

[32]  D. M. Allen Mean Square Error of Prediction as a Criterion for Selecting Variables , 1971 .

[33]  Godred Fairhurst,et al.  Unicast UDP Usage Guidelines for Application Designers , 2008, RFC.

[34]  Mark Handley,et al.  Experimenting with multipath TCP , 2010, SIGCOMM '10.

[35]  W. Richard Stevens,et al.  TCP Slow Start, Congestion Avoidance, Fast Retransmit, and Fast Recovery Algorithms , 1997, RFC.

[36]  Pablo César,et al.  Online video and interactive TV experiences , 2015, Interactions.

[37]  Scott Shenker,et al.  Congestion control for best-effort service: why we need a new paradigm , 1996, IEEE Netw..

[38]  Jan Rüth,et al.  How HTTP/2 pushes the web: An empirical study of HTTP/2 server push , 2017, 2017 IFIP Networking Conference (IFIP Networking) and Workshops.

[39]  Peter Brooks,et al.  User measures of quality of experience: why being objective and quantitative is important , 2010, IEEE Network.

[40]  Peng Wang,et al.  Implementation and Performance Evaluation of the QUIC Protocol in Linux Kernel , 2018, MSWiM.

[41]  Mike Bishop,et al.  Hypertext Transfer Protocol Version 3 (HTTP/3) , 2020 .

[42]  Christian Callegari,et al.  Behavior analysis of TCP Linux variants , 2010, Proceedings of the 2010 International Symposium on Performance Evaluation of Computer and Telecommunication Systems (SPECTS '10).

[43]  Yongqiang Xiong,et al.  Network Stack as a Service in the Cloud , 2017, HotNets.

[44]  SekarVyas,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015 .

[45]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[46]  Saverio Mascolo,et al.  TAPAS: A Tool for rApid Prototyping of Adaptive Streaming algorithms , 2014, VideoNext '14.

[47]  Wayne Goodridge,et al.  S-MDP: Streaming With Markov Decision Processes , 2019, IEEE Transactions on Multimedia.

[48]  Yang Liu,et al.  Adaptive backstepping H∞ tracking control with prescribed performance for internet congestion. , 2017, ISA transactions.

[49]  Raul Morales Salcedo,et al.  Effectiveness of using smart TVs for teaching engineering , 2019, International Journal on Interactive Design and Manufacturing (IJIDeM).

[50]  George Neville-Neil The Chess Player who Couldn’t Pass the Salt , 2016, ACM Queue.

[51]  Martina Zitterbart,et al.  Experimental evaluation of BBR congestion control , 2017, 2017 IEEE 25th International Conference on Network Protocols (ICNP).

[52]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[53]  Bruno Ribeiro,et al.  Oboe: auto-tuning video ABR algorithms to network conditions , 2018, SIGCOMM.

[54]  Wayne Goodridge,et al.  Energy Aware Ad Hoc On-Demand Multipath Distance Vector Routing , 2015 .

[55]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM 2011.

[56]  Akshay Girdhar,et al.  Real-Time Eye Detection Method for Driver Assistance System , 2018 .

[57]  Rik Van de Walle,et al.  Subjective Quality Assessment of Longer Duration Video Sequences Delivered Over HTTP Adaptive Streaming to Tablet Devices , 2014, IEEE Transactions on Broadcasting.

[58]  Klara Nahrstedt,et al.  Event-driven stitching for tile-based live 360 video streaming , 2019, MMSys.

[59]  Ingemar Johansson,et al.  Support for Reduced-Size Real-Time Transport Control Protocol (RTCP): Opportunities and Consequences , 2009, RFC.

[60]  Mohammed Ghanbari,et al.  Temporal Aspect of Perceived Quality in Mobile Video Broadcasting , 2008, IEEE Transactions on Broadcasting.

[61]  Jon Postel,et al.  User Datagram Protocol , 1980, RFC.

[62]  Phuoc Tran-Gia,et al.  Quantification of YouTube QoE via Crowdsourcing , 2011, 2011 IEEE International Symposium on Multimedia.

[63]  Leonard Kleinrock,et al.  Packet Switching in a Multiaccess Broadcast Channel: Performance Evaluation , 1975, IEEE Trans. Commun..

[64]  Te-Yuan Huang,et al.  A buffer-based approach to rate adaptation: evidence from a large video streaming service , 2015, SIGCOMM 2015.

[65]  Kay Connelly,et al.  Toward total quality of experience: A QoE model in a communication ecosystem , 2012, IEEE Communications Magazine.

[66]  Vincent Barriac,et al.  Standardization activities in the ITU for a QoE assessment of IPTV , 2008, IEEE Communications Magazine.

[67]  Leonard Kleinrock,et al.  Internet congestion control using the power metric: Keep the pipe just full, but no fuller , 2018, Ad Hoc Networks.

[68]  Wei Cai,et al.  Toward Multiplayer Cooperative Cloud Gaming , 2018, IEEE Cloud Computing.

[69]  Hayder Ahmed Abdulmohsin Al-Kashoash Congestion Control for 6LoWPAN Wireless Sensor Networks: Toward the Internet of Things , 2020 .

[70]  Mohamed Othman,et al.  Agile-SD: A Linux-based TCP congestion control algorithm for supporting high-speed and short-distance networks , 2015, J. Netw. Comput. Appl..