Crowd-sourcing framework to assess QoE

The quality assessment of multimedia services as perceived by the end-user is a challenging task. In a controlled environment, it is easy to measure the user's Quality of Experience (QoE) against the influence of controlled network parameters. However, in an uncontrolled environment, it is difficult to measure the Quality of Service (QoS) perceived by end-users, due to the unpredictable behaviour of networks. Crowd-sourcing is an emerging technique that can be employed to measure the QoE at the end user, but in an uncontrolled environment. In this paper, we present a tool implementing a crowd-sourcing framework, that measures the QoE of online video streaming, as perceived by end-users. The tool also measures important QoS network parameters in real-time (packet loss, delay, jitter and throughput), retrieves system information (memory, processing power etc.), and other properties of the end-user's system. The proposed approach provides the opportunity to explore the user's quality perception in a wider domain.

[1]  M. Angela Sasse,et al.  Sharp or smooth?: comparing the effects of quantization vs. frame rate for streamed video , 2004, CHI '04.

[2]  Chin-Laung Lei,et al.  Quadrant of euphoria: a crowdsourcing platform for QoE assessment , 2010, IEEE Network.

[3]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[4]  Dilip Kumar Krishnappa,et al.  Planet YouTube: Global, measurement-based performance analysis of viewer;'s experience watching user generated videos , 2011, 2011 IEEE 36th Conference on Local Computer Networks.

[5]  Lucjan Janowski,et al.  QoE as a Function of Frame Rate and Resolution Changes , 2010, FMN.

[6]  Mainak Chatterjee,et al.  Inferring video QoE in real time , 2011, IEEE Network.

[7]  Tobias Hoßfeld,et al.  Microworkers vs. facebook: The impact of crowdsourcing platform choice on experimental results , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[8]  Seong Gon Choi,et al.  QoE assessment model for video streaming service using QoS parameters in wired-wireless network , 2012, 2012 14th International Conference on Advanced Communication Technology (ICACT).

[9]  Phuoc Tran-Gia,et al.  Quantification of YouTube QoE via Crowdsourcing , 2011, 2011 IEEE International Symposium on Multimedia.

[10]  Rocky K. C. Chang,et al.  Measuring the quality of experience of HTTP video streaming , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[11]  Sherali Zeadally,et al.  Recent advances in multimedia networking , 2011, Multimedia Tools and Applications.