User-centric QoE model of visual perception for mobile videos

AbstractIt is crucial for service providers to improve user’s quality of visual perception for mobile users. Quality of experience (QoE) is an important perceptual visual metric. In this paper, we propose a user-centric QoE assessment model by joint considering technological-aware and psychology-aware parameters in the QoE communication ecosystem. For technological parameters, video encoding features are extracted from the video stream, and video content feature is estimated by video analysis. Moreover, user interests are also quantitatively collected as psychology parameters. Then, QoE model is developed by using support vector machine (SVM). Subjective tests have been performed. The collected data from subjective tests are used for training and validation of the proposed model. The experiment results show that the proposed user-centric QoE assessment model performs better in terms of high Pearson correlation coefficient (PCC) and low root-mean-square error (RMSE) compared with the conventional models.

[1]  Alan C. Bovik,et al.  Motion-based perceptual quality assessment of video , 2009, Electronic Imaging.

[2]  Kay Connelly,et al.  Toward total quality of experience: A QoE model in a communication ecosystem , 2012, IEEE Communications Magazine.

[3]  Bernhard Schölkopf,et al.  New Support Vector Algorithms , 2000, Neural Computation.

[4]  Alexander Raake,et al.  Towards content-related features for parametric video quality prediction of IPTV services , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Hyun-Jong Kim,et al.  The QoE Evaluation Method through the QoS-QoE Correlation Model , 2008, 2008 Fourth International Conference on Networked Computing and Advanced Information Management.

[6]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  Xueming Qian,et al.  A Cost-Constrained Video Quality Satisfaction Study on Mobile Devices , 2018, IEEE Transactions on Multimedia.

[9]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[10]  Raimund Schatz,et al.  QoE evaluation of high-definition IPTV services , 2011, Proceedings of 21st International Conference Radioelektronika 2011.

[11]  Mohammed Ghanbari,et al.  A robust compressed domain feature vector for texture based IMAGE retrieval , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[12]  Cristina Hava Muntean,et al.  Consumer' risk attitude based personalisation for content delivery , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[13]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[14]  Kalevi Kilkki,et al.  Quality of Experience in Communications Ecosystem , 2008, J. Univers. Comput. Sci..

[15]  Zhou Wang,et al.  Foveation scalable video coding with automatic fixation selection , 2003, IEEE Trans. Image Process..

[16]  Ruo-Li Yang,et al.  Neural networks for exact solution of constrained optimal control problems , 1994, Proceedings of 1994 American Control Conference - ACC '94.

[17]  Farzad Zargari,et al.  Compressed Domain Texture Retrieval Based on I-Frame Coding in H.264 , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[18]  Harilaos Koumaras,et al.  Video Quality Prediction Models Based on Video Content Dynamics for H.264 Video over UMTS Networks , 2010, Int. J. Digit. Multim. Broadcast..

[19]  Kurt Debattista,et al.  Smoothness perception , 2012, The Visual Computer.

[20]  Seong Gon Choi,et al.  A study on a QoS/QoE correlation model for QoE evaluation on IPTV service , 2010, 2010 The 12th International Conference on Advanced Communication Technology (ICACT).

[21]  Debajyoti Pal,et al.  Extending the ITU-T G.1070 Opinion Model to Support Current Generation H.265/HEVC Video Codec , 2016, ICCSA.

[22]  Guangming Shi,et al.  Hybrid Distortion Ranking Tuned Bitstream-Layer Video Quality Assessment , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Ralph R. Martin,et al.  Internet visual media processing: a survey with graphics and vision applications , 2013, The Visual Computer.

[24]  Gustavo de Veciana,et al.  Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies , 2012, IEEE Journal of Selected Topics in Signal Processing.