QoE assessment of multimedia video consumption on tablet devices

In this paper we present a study aimed at assessing the Quality of Experience in video streaming when the user is employing a tablet devices. The study has been conducted on a database containing subjective assessment scores relative to 216 streaming sessions of video sequences encoded with H.264/AVC and corrupted by typical wireless channel transmission errors. Four 20sec-long video sequences at Common Intermediate Format (CIF) spatial resolution have been corrupted with 54 combinations of key parameters for the reference application: bitrate, packet loss rate, playout delay and transmission interruption. Subjective evaluations have been collected in compliance with ITU-T Recommendation P.910 through singlestimulus Absolute Category Rating (ACR) from 40 subjects. The videos were reproduced on two different tablet devices: on an Apple iPad 2 and on a Samsung Galaxy Tab GT-P1000. Subjective observations include the perceived quality considering all aspects of the fruition chain, from the coding to the environment and device specific issues. The evaluation results also provided several remarks that can be helpful in designing systems and applications for multimedia contents played back on tablets. The results show a good correlation between subjective observations and some impairments so that a simple QoE index is proposed. A correlation study between subjective assessment and objective metrics is also provided.

[1]  Selim Ickin,et al.  Factors influencing quality of experience of commonly used mobile applications , 2012, IEEE Communications Magazine.

[2]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[3]  Saverio Niccolini,et al.  A closer look at thin-client connections: statistical application identification for QoE detection , 2012, IEEE Communications Magazine.

[4]  Touradj Ebrahimi,et al.  Subjective quality assessment of scalable video coding: A survey , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[5]  Lingfen Sun,et al.  Impact of end devices on subjective video quality assessment for QCIF video sequences , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[6]  Noel Crespi Toward Total Quality of Experience : A QoE Model in a Communication Ecosystem , .

[7]  Jianfei Cai,et al.  Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos , 2008, IEEE Transactions on Multimedia.

[8]  Fan Zhang,et al.  Reduced-Reference Image Quality Assessment Using Reorganized DCT-Based Image Representation , 2011, IEEE Transactions on Multimedia.

[9]  S. Tubaro,et al.  Subjective assessment of H.264/AVC video sequences transmitted over a noisy channel , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[10]  Christian Timmerer,et al.  Challenges of QoE management for cloud applications , 2012, IEEE Communications Magazine.

[11]  O. Oyman,et al.  Quality of experience for HTTP adaptive streaming services , 2012, IEEE Communications Magazine.