Measuring the quality of experience of HTTP video streaming

HTTP video streaming, such as Flash video, is widely deployed to deliver stored media. Owing to TCP's reliable service, the picture and sound quality would not be degraded by network impairments, such as high delay and packet loss. However, the network impairments can cause rebuffering events which would result in jerky playback and deform the video's temporal structure. These quality degradations could adversely affect users' quality of experience (QoE). In this paper, we investigate the relationship among three levels of quality of service (QoS) of HTTP video streaming: network QoS, application QoS, and user QoS (i.e., QoE). Our ultimate goal is to understand how the network QoS affects the QoE of HTTP video streaming. Our approach is to first characterize the correlation between the application and network QoS using analytical models and empirical evaluation. The second step is to perform subjective experiments to evaluate the relationship between application QoS and QoE. Our analysis reveals that the frequency of rebuffering is the main factor responsible for the variations in the QoE.

[1]  Jeffrey D. Case,et al.  Simple Network Management Protocol (SNMP) , 1989, RFC.

[2]  Jeffrey D. Case.  Management of high speed networks with the simple network management protocol (SNMP) , 1990, [1990] Proceedings. 15th Conference on Local Computer Networks.

[3]  Pascal Frossard,et al.  MPEG-2 Video Services over Packet Networks: Joint Effect of Encoding Rate and Data Loss on User-Oriented QoS , 1998 .

[4]  Eddie Kohler,et al.  The Click modular router , 1999, SOSP.

[5]  David Hands,et al.  A Study of the Impact of Network Loss and Burst Size on Video Streaming Quality and Acceptability , 1999, IDMS.

[6]  Donald F. Towsley,et al.  Modeling TCP Reno performance: a simple model and its empirical validation , 2000, TNET.

[7]  Mahesh Sooriyabandara,et al.  TCP Performance Implications of Network Path Asymmetry , 2002, RFC.

[8]  Yutaka Ishibashi,et al.  Mutually compensatory property of multimedia QoS , 2002, 2002 IEEE International Conference on Communications. Conference Proceedings. ICC 2002 (Cat. No.02CH37333).

[9]  Sujata Banerjee,et al.  Studying streaming video quality: from an application point of view , 2003, MULTIMEDIA '03.

[10]  Prashant J. Shenoy,et al.  Multimedia streaming via TCP: an analytic performance study , 2004, MULTIMEDIA '04.

[11]  Zhi-Li Zhang,et al.  Practical delay monitoring for ISPs , 2005, CoNEXT '05.

[12]  Piet Van Mieghem,et al.  Estimation of perceived quality of service for applications on IPv6 networks , 2006, PM2HW2N '06.

[13]  István Moldován,et al.  Correlating User Perception and Measurable Network Properties: Experimenting with QoE , 2006, IPOM.

[14]  Mostafa Ammar,et al.  Receiver buffer requirement for video streaming over TCP , 2006, Electronic Imaging.

[15]  Qian Zhang,et al.  Compound TCP: A scalable and TCP-friendly congestion control for high-speed networks , 2006 .

[16]  Shuji Tasaka,et al.  Real-Time Estimation of User-Level QoS in Audio-Video IP Transmission by Using Temporal and Spatial Quality , 2007, IEEE GLOBECOM 2007 - IEEE Global Telecommunications Conference.

[17]  Injong Rhee,et al.  CUBIC: a new TCP-friendly high-speed TCP variant , 2008, OPSR.

[18]  Mohammed Ghanbari,et al.  Temporal Aspect of Perceived Quality in Mobile Video Broadcasting , 2008, IEEE Transactions on Broadcasting.

[19]  Xiapu Luo,et al.  Design and Implementation of TCP Data Probes for Reliable and Metric-Rich Network Path Monitoring , 2009, USENIX Annual Technical Conference.

[20]  Mohammed Ghanbari,et al.  No-reference temporal quality metric for video impaired by frame freezing artefacts , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[21]  Klara Nahrstedt,et al.  Quality of experience in distributed interactive multimedia environments: toward a theoretical framework , 2009, ACM Multimedia.

[22]  Mark Claypool,et al.  Performance analysis of home streaming video using Orb , 2010, NOSSDAV '10.

[23]  Chin-Laung Lei,et al.  Radar chart: Scanning for high QoE in QoS dimensions , 2010, 2010 IEEE International Workshop Technical Committee on Communications Quality and Reliability (CQR 2010).

[24]  A. Karmouch,et al.  Performance analysis of modern TCP variants: A comparison of Cubic, Compound and New Reno , 2010, 2010 25th Biennial Symposium on Communications.

[25]  Chris Hare.  Simple Network Management Protocol (SNMP) , 2011, Encyclopedia of Information Assurance.

[26]  Antonio Pescapè,et al.  D-ITG: Distributed Internet Traffic Generator , 2013, Prax. Inf.verarb. Kommun..

[27]  METHODS FOR SUBJECTIVE DETERMINATION OF TRANSMISSION QUALITY Summary , 2022 .