Initial Perceived Quality Evaluation for Video Streaming Services

Initial perceived quality (IPQ) reflects users’ perception when waiting for videos to play, which directly determines the user’s willingness to go on watching videos. However, IPQ has never been carefully analyzed and evaluated. In this paper, two types of subjective test methods were elaborately designed, where the IPQ scores were obtained. The accuracy of IPQ scores was checked according to the consistency of the rating results. Then, an objective evaluation model was proposed accordingly to evaluate IPQ. Meanwhile, the relationship between IPQ and users’ unacceptability of initial loading delay was also investigated according to users’ abandonment behavior during the waiting period. A probability model was proposed to evaluate the unacceptability of users using logistic regression analysis. The experimental results show that the proposed models can accurately evaluate IPQ and users’ unacceptability of the initial loading delay. The proposed models can be used as guidelines for service providers to effectively improve the buffering strategy for video streaming services.

[1]  Markus Fiedler,et al.  Initial delay vs. interruptions: Between the devil and the deep blue sea , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[2]  Hongliang Li,et al.  Toward a Blind Quality Metric for Temporally Distorted Streaming Video , 2018, IEEE Transactions on Broadcasting.

[3]  Ramesh K. Sitaraman,et al.  Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs , 2012, IEEE/ACM Transactions on Networking.

[4]  Deep Medhi,et al.  Measurement of Quality of Experience of Video-on-Demand Services: A Survey , 2016, IEEE Communications Surveys & Tutorials.

[5]  Alan C. Bovik,et al.  Recurrent and Dynamic Models for Predicting Streaming Video Quality of Experience , 2018, IEEE Transactions on Image Processing.

[6]  Philip J. Corriveau,et al.  Study of Rating Scales for Subjective Quality Assessment of High-Definition Video , 2011, IEEE Transactions on Broadcasting.

[7]  Bin Jiang,et al.  No Reference Quality Assessment of Stereo Video Based on Saliency and Sparsity , 2018, IEEE Transactions on Broadcasting.

[8]  Graça Bressan,et al.  Video Quality Metric for Streaming Service Using DASH Standard , 2016, IEEE Transactions on Broadcasting.

[9]  Cristian Perra,et al.  A Review of Predictive Quality of Experience Management in Video Streaming Services , 2018, IEEE Transactions on Broadcasting.

[10]  Miska M. Hannuksela,et al.  Acceptance Threshold: A Bidimensional Research Method for User-Oriented Quality Evaluation Studies , 2008, Int. J. Digit. Multim. Broadcast..

[11]  Guo Wei,et al.  Network-Based Video Quality Assessment for Encrypted HTTP Adaptive Streaming , 2018, IEEE Access.

[12]  Giuseppe Caire,et al.  A Control-Theoretic Approach to Adaptive Video Streaming in Dense Wireless Networks , 2015, IEEE Transactions on Multimedia.

[13]  Joongheon Kim,et al.  Wireless Video Caching and Dynamic Streaming Under Differentiated Quality Requirements , 2018, IEEE Journal on Selected Areas in Communications.

[14]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[15]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[16]  Phuoc Tran-Gia,et al.  A Survey on Quality of Experience of HTTP Adaptive Streaming , 2015, IEEE Communications Surveys & Tutorials.

[17]  Sujit Dey,et al.  Deriving and Validating User Experience Model for DASH Video Streaming , 2015, IEEE Transactions on Broadcasting.

[18]  Rocky K. C. Chang,et al.  Measuring the quality of experience of HTTP video streaming , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[19]  Shuai Wan,et al.  Bitstream-based quality assessment for networked video: a review , 2012, IEEE Communications Magazine.

[20]  Toon De Pessemier,et al.  Quantifying the Influence of Rebuffering Interruptions on the User's Quality of Experience During Mobile Video Watching , 2013, IEEE Transactions on Broadcasting.

[21]  Alexander Raake,et al.  Quality impact due to initial loading, stalling, and video bitrate in progressive download video services , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[22]  Zhibo Chen,et al.  Blind Stereoscopic Video Quality Assessment: From Depth Perception to Overall Experience. , 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[23]  Yanjiao Chen,et al.  From QoS to QoE: A Tutorial on Video Quality Assessment , 2015, IEEE Communications Surveys & Tutorials.

[24]  Baihua Li,et al.  A Deep Evaluator for Image Retargeting Quality by Geometrical and Contextual Interaction , 2020, IEEE Transactions on Cybernetics.

[25]  Fuzheng Yang,et al.  Initial Perceived Quality Analysis for DASH Video Streaming , 2018, 2018 IEEE Visual Communications and Image Processing (VCIP).

[26]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .