Understanding the impact of video quality on user engagement

As the distribution of the video over the Internet becomes mainstream and its consumption moves from the computer to the TV screen, user expectation for high quality is constantly increasing. In this context, it is crucial for content providers to understand if and how video quality affects user engagement and how to best invest their resources to optimize video quality. This paper is a first step towards addressing these questions. We use a unique dataset that spans different content types, including short video on demand (VoD), long VoD, and live content from popular video content providers. Using client-side instrumentation, we measure quality metrics such as the join time, buffering ratio, average bitrate, rendering quality, and rate of buffering events. We quantify user engagement both at a per-video (or view) level and a per-user (or viewer) level. In particular, we find that the percentage of time spent in buffering (buffering ratio) has the largest impact on the user engagement across all types of content. However, the magnitude of this impact depends on the content type, with live content being the most impacted. For example, a 1% increase in buffering ratio can reduce user engagement by more than three minutes for a 90-minute live video event. We also see that the average bitrate plays a significantly more important role in the case of live content than VoD content.

[1]  Mark Claypool,et al.  The effects of jitter on the peceptual quality of video , 1999, MULTIMEDIA '99.

[2]  Bruce M. Maggs,et al.  The feasibility of supporting large-scale live streaming applications with dynamic application end-points , 2004, SIGCOMM.

[3]  Keith W. Ross,et al.  A Measurement Study of a Large-Scale P2P IPTV System , 2007, IEEE Transactions on Multimedia.

[4]  Ítalo S. Cunha,et al.  Analyzing client interactivity in streaming media , 2004, WWW '04.

[5]  Pablo Rodriguez,et al.  I tube, you tube, everybody tubes: analyzing the world's largest user generated content video system , 2007, IMC '07.

[6]  Hiroshi Esaki,et al.  The impact and implications of the growth in residential user-to-user traffic , 2006, SIGCOMM.

[7]  Chuan Wu,et al.  Diagnosing Network-Wide P2P Live Streaming Inefficiencies , 2009, IEEE INFOCOM 2009.

[8]  Qi Zhao,et al.  Towards automated performance diagnosis in a large IPTV network , 2009, SIGCOMM '09.

[9]  Stephen R. Gulliver,et al.  Defining user perception of distributed multimedia quality , 2006, TOMCCAP.

[10]  Dennis F. Galletta,et al.  Web Site Delays: How Tolerant are Users? , 2004, J. Assoc. Inf. Syst..

[11]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[12]  Krishna P. Gummadi,et al.  An analysis of Internet content delivery systems , 2002, OPSR.

[13]  Bruce M. Maggs,et al.  An analysis of live streaming workloads on the internet , 2004, IMC '04.

[14]  Cheng Huang,et al.  Challenges, design and analysis of a large-scale p2p-vod system , 2008, SIGCOMM '08.

[15]  Wenjie Wang,et al.  Live streaming performance of the Zattoo network , 2009, IMC '09.

[16]  Chun-Ying Huang,et al.  Quantifying Skype user satisfaction , 2006, SIGCOMM.

[17]  Hai Jin,et al.  A Measurement Study of a Peer-to-Peer Video-on-Demand System , 2007, IPTPS.

[18]  Zongpeng Li,et al.  Youtube traffic characterization: a view from the edge , 2007, IMC '07.

[19]  Ben Y. Zhao,et al.  Understanding user behavior in large-scale video-on-demand systems , 2006, EuroSys.

[20]  Khaled El-Maleh,et al.  Perceptual Temporal Quality Metric for Compressed Video , 2007, IEEE Transactions on Multimedia.

[21]  Ning Xia,et al.  Inside the bird's nest: measurements of large-scale live VoD from the 2008 olympics , 2009, IMC '09.

[22]  Hai Jin,et al.  Towards cinematic internet video-on-demand , 2008, Eurosys '08.

[23]  Allan Kuchinsky,et al.  Quality is in the eye of the beholder: meeting users' requirements for Internet quality of service , 2000, CHI.

[24]  Shahzad Ali,et al.  Measurement of Commercial Peer-To-Peer Live Video Streaming , 2006 .

[25]  Siddhartha Annapureddy,et al.  Is high-quality vod feasible using P2P swarming? , 2007, WWW '07.

[26]  Pablo Rodriguez,et al.  Watching television over an IP network , 2008, IMC '08.

[27]  Ben Shneiderman,et al.  Determining Causes and Severity of End-User Frustration , 2004, Int. J. Hum. Comput. Interact..