Continuous Prediction for Quality of Experience in Wireless Video Streaming

Due to the rapid development of communication technologies, the requirement of mobile video streaming services is extremely increased in recent years. However, the bandwidth limitation of the wireless network often causes video impairments, such as compression artifacts and rebuffering event, when users are watching online videos. Hence, this problem often causes the reduction of quality of experience (QoE). Predicting the QoE can provide a reference to improve resource allocation strategies, accordingly providing users with a higher quality of video streaming services. In order to predict the impact of video impairment, continuous prediction for the QoE in wireless video streaming is proposed. The input of the predicted model consists of three vectors that characterize frame quality, the state of rebuffering events, and memory effect, respectively, while the output consists of continuous predicted the QoE. The predicted model uses a block-structured nonlinear Hammerstein-Wiener model. The experimental results confirm that our proposed model can effectively predict the continuous QoE for wireless video streaming.

[1]  W B Levy,et al.  Primacy versus recency in a quantitative model: activity is the critical distinction. , 2000, Learning & memory.

[2]  Alan C. Bovik,et al.  Continuous Prediction of Streaming Video QoE Using Dynamic Networks , 2017, IEEE Signal Processing Letters.

[3]  Alexander Raake,et al.  Quality of experience and HTTP adaptive streaming: A review of subjective studies , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[4]  Hong Ren Wu,et al.  No-Reference Quality Assessment for Networked Video via Primary Analysis of Bit Stream , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Alan C. Bovik,et al.  A Subjective and Objective Study of Stalling Events in Mobile Streaming Videos , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Gustavo de Veciana,et al.  Modeling the Time—Varying Subjective Quality of HTTP Video Streams With Rate Adaptations , 2013, IEEE Transactions on Image Processing.

[7]  Jianjun Lei,et al.  Adaptive Fractional-Pixel Motion Estimation Skipped Algorithm for Efficient HEVC Motion Estimation , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[8]  Christophe Charrier,et al.  Blind Prediction of Natural Video Quality , 2014, IEEE Transactions on Image Processing.

[9]  Alan C. Bovik,et al.  Temporal hysteresis model of time varying subjective video quality , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Rajiv Soundararajan,et al.  Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Donald J. Berndt,et al.  Using Dynamic Time Warping to Find Patterns in Time Series , 1994, KDD Workshop.

[12]  Long Xu,et al.  Early DIRECT mode decision based on all-zero block and rate distortion cost for multiview video coding , 2016, IET Image Process..

[13]  S. E. Avons,et al.  Recency and duration neglect in subjective assessment of television picture quality , 2001 .

[14]  Alan C. Bovik,et al.  A Completely Blind Video Integrity Oracle , 2016, IEEE Transactions on Image Processing.

[15]  Christian Viard-Gaudin,et al.  A Convolutional Neural Network Approach for Objective Video Quality Assessment , 2006, IEEE Transactions on Neural Networks.

[16]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[17]  Gustavo de Veciana,et al.  Video Quality Assessment on Mobile Devices: Subjective, Behavioral and Objective Studies , 2012, IEEE Journal of Selected Topics in Signal Processing.

[18]  Zhengfang Duanmu,et al.  A Quality-of-Experience Index for Streaming Video , 2017, IEEE Journal of Selected Topics in Signal Processing.

[19]  Touradj Ebrahimi,et al.  Attention Driven Foveated Video Quality Assessment , 2014, IEEE Transactions on Image Processing.

[20]  Alan Conrad Bovik,et al.  Study of Temporal Effects on Subjective Video Quality of Experience , 2017, IEEE Transactions on Image Processing.

[21]  Guangming Shi,et al.  Orientation selectivity based visual pattern for reduced-reference image quality assessment , 2016, Inf. Sci..

[22]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[23]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[24]  Narciso García,et al.  Perceptual Quality of HTTP Adaptive Streaming Strategies: Cross-Experimental Analysis of Multi-Laboratory and Crowdsourced Subjective Studies , 2016, IEEE Journal on Selected Areas in Communications.

[25]  Gangyi Jiang,et al.  Effective Data Driven Coding Unit Size Decision Approaches for HEVC INTRA Coding , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  King Ngi Ngan,et al.  Full-Reference Video Quality Assessment by Decoupling Detail Losses and Additive Impairments , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[28]  Alan C. Bovik,et al.  A time-varying subjective quality model for mobile streaming videos with stalling events , 2015, SPIE Optical Engineering + Applications.

[29]  Praful Gupta,et al.  SpEED-QA: Spatial Efficient Entropic Differencing for Image and Video Quality , 2017, IEEE Signal Processing Letters.

[30]  Alan C. Bovik,et al.  Recurrent and Dynamic Models for Predicting Streaming Video Quality of Experience , 2018, IEEE Transactions on Image Processing.