Event-Based Perceptual Quality Assessment for HTTP-Based Video Streaming With Playback Interruption

The popularity of HTTP-based video streaming services has been increasing in recent years. The quality of HTTP-based video streaming services is measured by the user's quality of experience (QoE). Perceptual quality (PQ), a strong indicator of the QoE, has been widely studied in the literature. Specifically, previous studies primarily focused on modeling the overall perceptual quality at the end of the viewing process. The specific influence of each event during the viewing process was neglected. Since the PQ is a function of time, which models the human perception of audiovisual services, this contribution focuses on investigating the time-varying feature of human perception. In this paper, the viewing timeline of subjects is divided into rebuffering and playback. An event-based perceptual quality assessment (EPQ) framework is introduced, which can assess the PQ of interrupted HTTP-based video streaming at any point in time. To understand the human perception of video streams with playback interruptions, a subjective quality assessment experiment was designed to obtain the PQ at a series of points in time. A between-subjects design was adopted in which each subject can view video content without repetition. Based on the experimental results, a PQ assessment model was proposed to predict the change in PQ (i.e., $\Delta$ PQ) after each rebuffering and playback. The overall PQ at any point in time is calculated as the summation of the $\Delta$PQs of all the previous events. The experimental results demonstrated that the EPQ-based model outperforms the rebuffering components contained in the ITU-T Rec. P.1201.1, P.1201 Amd. 2 and P.1203.3 in our database.

[1]  Alan C. Bovik,et al.  Study of the effects of stalling events on the quality of experience of mobile streaming videos , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[2]  Konstantinos A. Meintanis,et al.  Recognizing user interest and document value from reading and organizing activities in document triage , 2006, IUI '06.

[3]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[4]  O. Oyman,et al.  Quality of experience for HTTP adaptive streaming services , 2012, IEEE Communications Magazine.

[5]  Zhang Lin,et al.  A new three-layer QoE modeling method for HTTP video streaming over wireless networks , 2014, 2014 4th IEEE International Conference on Network Infrastructure and Digital Content.

[6]  Colin Bailey,et al.  Model and Performance of a No-Reference Quality Assessment Metric for Video Streaming , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Alan C. Bovik,et al.  Temporal hysteresis model of time varying subjective video quality , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Shahid M. Satti,et al.  P.1203 evaluation of real OTT video services , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[9]  Markus Fiedler,et al.  Quality of Experience-related differential equations and provisioning-delivery hysteresis , 2010 .

[10]  Toon De Pessemier,et al.  Quantifying the Influence of Rebuffering Interruptions on the User's Quality of Experience During Mobile Video Watching , 2013, IEEE Transactions on Broadcasting.

[11]  Zhenzhong Chen,et al.  Video Quality Assessment Based on Measuring Perceptual Noise From Spatial and Temporal Perspectives , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Markus Fiedler,et al.  Controlled vs. Uncontrolled Degradations of QoE : The Provisioning-Delivery Hysteresis in Case of Video , 2010 .

[13]  Wei Zhang,et al.  The Application of Visual Saliency Models in Objective Image Quality Assessment: A Statistical Evaluation , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[14]  A. Greenwald Within-subjects designs: To use or not to use? , 1976 .

[15]  Maurice G. Kendall,et al.  The advanced theory of statistics , 1945 .

[16]  Mahbub Hassan,et al.  Empirical Evaluation of HTTP Adaptive Streaming under Vehicular Mobility , 2011, Networking.

[17]  Alan C. Bovik,et al.  Delivery quality score model for Internet video , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[18]  Wei Zhang,et al.  Study of Saliency in Objective Video Quality Assessment , 2017, IEEE Transactions on Image Processing.

[19]  Ramesh K. Sitaraman,et al.  Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs , 2012, IEEE/ACM Transactions on Networking.

[20]  Wei Zhang,et al.  Toward a Reliable Collection of Eye-Tracking Data for Image Quality Research: Challenges, Solutions, and Applications , 2017, IEEE Transactions on Image Processing.

[21]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[22]  Takanori Hayashi,et al.  Parametric Quality-Estimation Model for Adaptive-Bitrate-Streaming Services , 2017, IEEE Transactions on Multimedia.

[23]  Rocky K. C. Chang,et al.  Measuring the quality of experience of HTTP video streaming , 2011, 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011) and Workshops.

[24]  Yicong Zhou,et al.  QoE Evaluation of Multimedia Services Based on Audiovisual Quality and User Interest , 2016, IEEE Transactions on Multimedia.

[25]  Jörgen Gustafsson,et al.  Measuring multimedia quality in mobile networks with an objective parametric model , 2008, 2008 15th IEEE International Conference on Image Processing.

[26]  Phuoc Tran-Gia,et al.  Quantification of YouTube QoE via Crowdsourcing , 2011, 2011 IEEE International Symposium on Multimedia.

[27]  Alexander Raake,et al.  A modular HTTP adaptive streaming QoE model — Candidate for ITU-T P.1203 (“P.NATS”) , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[28]  Jorge Navarro-Ortiz,et al.  A Simple Model for Predicting the Number and Duration of Rebuffering Events for YouTube Flows , 2012, IEEE Communications Letters.

[29]  Kay Connelly,et al.  Toward total quality of experience: A QoE model in a communication ecosystem , 2012, IEEE Communications Magazine.

[30]  Markus Fiedler,et al.  Initial delay vs. interruptions: Between the devil and the deep blue sea , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[31]  Yonggang Wen,et al.  QoE-Driven Cache Management for HTTP Adaptive Bit Rate Streaming Over Wireless Networks , 2012, IEEE Transactions on Multimedia.

[32]  Hui Liu,et al.  Software Defined Networking for HTTP video quality optimization , 2013, 2013 15th IEEE International Conference on Communication Technology.

[33]  Alan C. Bovik,et al.  Wireless Video Quality Assessment: A Study of Subjective Scores and Objective Algorithms , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Christian Timmerer,et al.  Automated QoE evaluation of Dynamic Adaptive Streaming over HTTP , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[35]  Gustavo de Veciana,et al.  Modeling the Time—Varying Subjective Quality of HTTP Video Streams With Rate Adaptations , 2013, IEEE Transactions on Image Processing.

[36]  Yang Geng,et al.  Assessing the quality of experience of HTTP video streaming considering the effects of pause position , 2014, The 16th Asia-Pacific Network Operations and Management Symposium.

[37]  Alexander Raake,et al.  A bitstream-based, scalable video-quality model for HTTP adaptive streaming: ITU-T P.1203.1 , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[38]  Peter Reichl,et al.  The Logarithmic Nature of QoE and the Role of the Weber-Fechner Law in QoE Assessment , 2010, 2010 IEEE International Conference on Communications.

[39]  Phuoc Tran-Gia,et al.  A Survey on Quality of Experience of HTTP Adaptive Streaming , 2015, IEEE Communications Surveys & Tutorials.

[40]  Sujit Dey,et al.  Deriving and Validating User Experience Model for DASH Video Streaming , 2015, IEEE Transactions on Broadcasting.