Quality of experience and HTTP adaptive streaming: A review of subjective studies

HTTP adaptive streaming technology has become widely spread in multimedia services because of its ability to provide adaptation to characteristics of various viewing devices and dynamic network conditions. There are various studies targeting the optimization of adaptation strategy. However, in order to provide an optimal viewing experience to the end-user, it is crucial to get knowledge about the Quality of Experience (QoE) of different adaptation schemes. This paper overviews the state of the art concerning subjective evaluation of adaptive streaming QoE and highlights the challenges and open research questions related to QoE assessment.

[1]  Narciso García,et al.  Subjective Quality Study of Adaptive Streaming of Monoscopic and Stereoscopic Video , 2014, IEEE Journal on Selected Areas in Communications.

[2]  Daniele D. Giusto,et al.  QoE assessment of multimedia video consumption on tablet devices , 2012, 2012 IEEE Globecom Workshops.

[3]  Gustavo de Veciana,et al.  Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies , 2012, IEEE Journal of Selected Topics in Signal Processing.

[4]  Alexander Raake,et al.  Pippi Longstocking calculus for temporal stimuli pattern on YouTube QoE: 1+1=3 and 1·4≠4·1 , 2013, MoVid '13.

[5]  Liam Murphy,et al.  User perception of adapting video quality , 2006, Int. J. Hum. Comput. Stud..

[6]  Markus Fiedler,et al.  Initial delay vs. interruptions: Between the devil and the deep blue sea , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[7]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[8]  Kjell Brunnström,et al.  Estimating the impact of single and multiple freezes on video quality , 2011, Electronic Imaging.

[9]  Gustavo de Veciana,et al.  A dynamic system model of time-varying subjective quality of video streams over HTTP , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Kjell Brunnström,et al.  Subjective quality assessment of an adaptive video streaming model , 2014, Electronic Imaging.

[11]  Xiapu Luo,et al.  QDASH: a QoE-aware DASH system , 2012, MMSys '12.

[12]  Daniele D. Giusto,et al.  Quality perception when streaming video on tablet devices , 2014, J. Vis. Commun. Image Represent..

[13]  Ralf Steinmetz,et al.  Subjective impression of variations in layer encoded videos , 2003, IWQoS'03.

[14]  Peter Lambert,et al.  Assessing Quality of Experience of IPTV and Video on Demand Services in Real-Life Environments , 2010, IEEE Transactions on Broadcasting.

[15]  Jing Liu,et al.  A study on Quality of Experience for adaptive streaming service , 2013, ICC Workshops.

[16]  Rocky K. C. Chang,et al.  Measuring the quality of experience of HTTP video streaming , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[17]  Hocine Cherifi,et al.  Sporadic frame dropping impact on quality perception , 2004, IS&T/SPIE Electronic Imaging.

[18]  Ragnhild Eg,et al.  Flicker effects in adaptive video streaming to handheld devices , 2011, ACM Multimedia.

[19]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[20]  David C. Robinson,et al.  Subjective video quality assessment of HTTP adaptive streaming technologies , 2012, Bell Labs Technical Journal.

[21]  Abdul Rehman,et al.  Perceptual experience of time-varying video quality , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[22]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM.

[23]  Poul E. Heegaard,et al.  Investigating Quality of Experience in the context of adaptive video streaming : findings from an experimental user study , 2013 .

[24]  Tobias Hoßfeld,et al.  Internet Video Delivery in YouTube: From Traffic Measurements to Quality of Experience , 2013, Data Traffic Monitoring and Analysis.

[25]  Xiapu Luo,et al.  Inferring the QoE of HTTP video streaming from user-viewing activities , 2011, W-MUST '11.