An Augmented Autoregressive Approach to HTTP Video Stream Quality Prediction

HTTP-based video streaming technologies allow for flexible rate selection strategies that account for time-varying network conditions. Such rate changes may adversely affect the user's Quality of Experience; hence online prediction of the time varying subjective quality can lead to perceptually optimised bitrate allocation policies. Recent studies have proposed to use dynamic network approaches for continuous-time prediction; yet they do not consider multiple video quality models as inputs nor consider forecasting ensembles. Here we address the problem of predicting continuous-time subjective quality using multiple inputs fed to a non-linear autoregressive network. By considering multiple network configurations and by applying simple averaging forecasting techniques, we are able to considerably improve prediction performance and decrease forecasting errors.

[1]  Phuoc Tran-Gia,et al.  Quantification of YouTube QoE via Crowdsourcing , 2011, 2011 IEEE International Symposium on Multimedia.

[2]  C.-C. Jay Kuo,et al.  Challenges in cloud based ingest and encoding for high quality streaming media , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[3]  Alan C. Bovik,et al.  Visual quality assessment algorithms: what does the future hold? , 2010, Multimedia Tools and Applications.

[4]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[5]  A. Bovik A VISUAL INFORMATION FIDELITY APPROACH TO VIDEO QUALITY ASSESSMENT , 2005 .

[6]  Gustavo de Veciana,et al.  Rate Adaptation and Admission Control for Video Transmission With Subjective Quality Constraints , 2013, IEEE Journal of Selected Topics in Signal Processing.

[7]  Alan C. Bovik,et al.  Automatic Prediction of Perceptual Image and Video Quality , 2013, Proceedings of the IEEE.

[8]  Victor L. Berardi,et al.  Time series forecasting with neural network ensembles: an application for exchange rate prediction , 2001, J. Oper. Res. Soc..

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[11]  Christophe Charrier,et al.  Blind Prediction of Natural Video Quality , 2014, IEEE Transactions on Image Processing.

[12]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[13]  Alan C. Bovik,et al.  Continuous Prediction of Streaming Video QoE Using Dynamic Networks , 2017, IEEE Signal Processing Letters.

[14]  Gustavo de Veciana,et al.  Modeling the Time—Varying Subjective Quality of HTTP Video Streams With Rate Adaptations , 2013, IEEE Transactions on Image Processing.

[15]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[16]  Nick van de Giesen,et al.  An information-theoretical perspective on weighted ensemble forecasts , 2013 .

[17]  Alan C. Bovik,et al.  A Completely Blind Video Integrity Oracle , 2016, IEEE Transactions on Image Processing.

[18]  Alan Conrad Bovik,et al.  Study of Temporal Effects on Subjective Video Quality of Experience , 2017, IEEE Transactions on Image Processing.

[19]  Rajiv Soundararajan,et al.  Video Quality Assessment by Reduced Reference Spatio-Temporal Entropic Differencing , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Guoqiang Peter Zhang,et al.  Time series forecasting using a hybrid ARIMA and neural network model , 2003, Neurocomputing.

[21]  Alan C. Bovik,et al.  Learning to Predict Streaming Video QoE: Distortions, Rebuffering and Memory , 2017, ArXiv.

[22]  Alan C. Bovik,et al.  A time-varying subjective quality model for mobile streaming videos with stalling events , 2015, SPIE Optical Engineering + Applications.

[23]  Graça Bressan,et al.  Quality metric to assess video streaming service over TCP considering temporal location of pauses , 2012, IEEE Transactions on Consumer Electronics.

[24]  Zhengfang Duanmu,et al.  A Quality-of-Experience Index for Streaming Video , 2017, IEEE Journal of Selected Topics in Signal Processing.

[25]  C.-C. Jay Kuo,et al.  A fusion-based video quality assessment (fvqa) index , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[26]  Peter Tiño,et al.  Learning long-term dependencies in NARX recurrent neural networks , 1996, IEEE Trans. Neural Networks.

[27]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[28]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.