Quantifying Subjective Quality Evaluations for Mobile Video Watching in a Semi-Living Lab Context

This paper discusses results from an exploratory study in which Quality of Experience aspects related to mobile video watching were investigated in a semi-living lab setting. More specifically, we zoom in on usage patterns in a natural research context and on the subjective evaluation of high and low-resolution movie trailers that are transferred to a mobile device using two transmission protocols for video (i.e., real-time transport protocol and progressive download using HTTP). User feedback was collected by means of short questionnaires on the mobile device, combined with traditional pen and paper diaries. The subjective evaluations regarding the general technical quality, perceived distortion, fluentness of the video, and loading speed are studied and the influence of the transmission protocol and video resolution on these evaluations is analyzed. Multinomial logistic regression results in a model to estimate the subjective evaluations regarding the perceived distortion and loading speed based on objectively-measured parameters of the video session.

[1]  Francois Le Faucheur,et al.  Preserving Video Quality in IPTV Networks , 2009, IEEE Transactions on Broadcasting.

[2]  Toon De Pessemier,et al.  Investigating the influence of QoS on personal evaluation behaviour in a mobile context , 2012, Multimedia Tools and Applications.

[3]  Luc Martens,et al.  Proposed Framework for Evaluating Quality of Experience in a Mobile, Testbed-oriented Living Lab Setting , 2010, Mob. Networks Appl..

[4]  Luc Martens,et al.  Linking an integrated framework with appropriate methods for measuring QoE , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[5]  Michael H. Kutner.  Applied Linear Statistical Models , 1974 .

[6]  Miska M. Hannuksela,et al.  Does context matter in quality evaluation of mobile television? , 2008, Mobile HCI.

[7]  Sasitharan Balasubramaniam,et al.  Creating a distributed mobile networking testbed environment-through the Living Labs approach , 2006, 2nd International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities, 2006. TRIDENTCOM 2006..

[8]  Satu H. Jumisko,et al.  Effect of TV content in subjective assessment of video quality on mobile devices , 2005, IS&T/SPIE Electronic Imaging.

[9]  Leslie Haddon.  Everyday innovators : researching the role of users in shaping ICT's , 2005 .

[10]  Lieven De Marez,et al.  The Challenge of User- and QoE-Centric Research and Product Development in Today's ICT-Environment , 1970 .

[11]  Philip J. Corriveau,et al.  Study of Rating Scales for Subjective Quality Assessment of High-Definition Video , 2011, IEEE Transactions on Broadcasting.

[12]  Philip T. Kortum,et al.  The Effect of Content Desirability on Subjective Video Quality Ratings , 2010, Hum. Factors.

[13]  Liu Li-yuan,et al.  The Research of Quality of Experience Evaluation Method in Pervasive Computing Environment , 2006, 2006 First International Symposium on Pervasive Computing and Applications.

[14]  Peter Reichl,et al.  From charging for Quality of Service to charging for Quality of Experience , 2010, Ann. des Télécommunications.

[15]  Klaus-Peter Engelbrecht,et al.  A taxonomy of quality of service and Quality of Experience of multimodal human-machine interaction , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[16]  Asbjørn Følstad,et al.  Living Labs for Innovation and Development of Information and Communication Technology: A Literature Review , 2008 .

[17]  Peter Lambert,et al.  Assessing Quality of Experience of IPTV and Video on Demand Services in Real-Life Environments , 2010, IEEE Transactions on Broadcasting.

[18]  Liam Murphy,et al.  An Evaluation of Parameterized Gradient Based Routing With QoE Monitoring for Multiple IPTV Providers , 2011, IEEE Transactions on Broadcasting.

[19]  Lieven De Marez,et al.  A living lab research approach for mobile TV , 2009, EuroITV '09.

[20]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[21]  T. Liao.  Interpreting Probability Models: Logit, Probit, and Other Generalized Linear Models , 1994 .

[22]  Marc Sullivan,et al.  Content is King: The Effect of Content on the Perception of Video Quality , 2004 .

[23]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.