QoE Multi-Stage Machine Learning for Dynamic Video Streaming

The rapid growth of video traffic in cellular networks is a crucial issue to be addressed by mobile operators. An emerging and promising trend in this regard is the development of solutions that aim at maximizing the quality of experience (QoE) of the end users. However, predicting the QoE perceived by the users in different conditions remains a major challenge. In this paper, we propose a machine learning approach to support QoE-based video admission control and resource management algorithms. More specifically, we develop a multi-stage learning system that combines the unsupervised learning of video features from the size of H.264-encoded video frames with a supervised classifier trained to automatically extract the quality-rate characteristics of unknown video sequences. This QoE characterization is then used to manage simultaneous video transmissions through a shared channel in order to guarantee a minimum quality level delivered to the final users. Simulation results show that the proposed video admission control and resource management algorithms, which are based on learning-based QoE classification of video sequences, outperform standard content-agnostic strategies.

[1]  Ali C. Begen,et al.  Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale , 2013, IEEE Journal on Selected Areas in Communications.

[2]  Geoffrey E. Hinton Training Products of Experts by Minimizing Contrastive Divergence , 2002, Neural Computation.

[3]  Thomas Stockhammer,et al.  Dynamic adaptive streaming over HTTP --: standards and design principles , 2011, MMSys.

[4]  Paul Smolensky,et al.  Information processing in dynamical systems: foundations of harmony theory , 1986 .

[5]  Filip De Turck,et al.  Joint In-network Video Rate Adaptation and Measurement-Based Admission Control: Algorithm Design and Evaluation , 2012, Journal of Network and Systems Management.

[6]  Yongmin Li,et al.  Video classification using spatial-temporal features and PCA , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[7]  Touradj Ebrahimi,et al.  Calculation of average coding efficiency based on subjective quality scores , 2014, Journal of Visual Communication and Image Representation.

[8]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[9]  Filip De Turck,et al.  Design and optimisation of a (FA)Q-learning-based HTTP adaptive streaming client , 2014, Connect. Sci..

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  Andrea Zanella,et al.  SSIM-based video admission control and resource allocation algorithms , 2014, 2014 12th International Symposium on Modeling and Optimization in Mobile, Ad Hoc, and Wireless Networks (WiOpt).

[12]  B. Schölkopf,et al.  Modeling Human Motion Using Binary Latent Variables , 2007 .

[13]  Pejman Goudarzi A no-reference low-complexity QoE measurement algorithm for H.264 video transmission systems , 2013, Sci. Iran..

[14]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[15]  Konstantina Papagiannaki,et al.  Measuring Video QoE from Encrypted Traffic , 2016, Internet Measurement Conference.

[16]  Te-Yuan Huang,et al.  A buffer-based approach to rate adaptation: evidence from a large video streaming service , 2015, SIGCOMM 2015.

[17]  Martin Slanina,et al.  Reference free SSIM estimation for full HD video content , 2011, Proceedings of 21st International Conference Radioelektronika 2011.

[18]  John M. Libert,et al.  Simulation of graded video impairment by weighted summation: validation of the methodology , 1999, Optics East.

[19]  Alan C. Bovik,et al.  Blind quality assessment of videos using a model of natural scene statistics and motion coherency , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[20]  Jonathan Kua,et al.  A Survey of Rate Adaptation Techniques for Dynamic Adaptive Streaming Over HTTP , 2017, IEEE Communications Surveys & Tutorials.

[21]  Mahbub Hassan,et al.  HTTP-Based Adaptive Streaming for Mobile Clients using Markov Decision Process , 2013, 2013 20th International Packet Video Workshop.

[22]  Tamer Shanableh,et al.  Prediction of Structural Similarity Index of Compressed Video at a Macroblock Level , 2011, IEEE Signal Processing Letters.

[23]  Filip De Turck,et al.  Design of a Q-learning-based client quality selection algorithm for HTTP adaptive video streaming , 2013, ALA 2013.

[24]  Andreas Rossholm,et al.  A new low complex reference free video quality predictor , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[25]  Andrea Zanella,et al.  A machine learning approach to QoE-based video admission control and resource allocation in wireless systems , 2014, 2014 13th Annual Mediterranean Ad Hoc Networking Workshop (MED-HOC-NET).

[26]  Filip De Turck,et al.  QoE-Driven Rate Adaptation Heuristic for Fair Adaptive Video Streaming , 2016, ACM Trans. Multim. Comput. Commun. Appl..

[27]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[28]  Lea Skorin-Kapov,et al.  A machine learning approach to classifying YouTube QoE based on encrypted network traffic , 2017, Multimedia Tools and Applications.

[29]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[30]  Ting-Lan Lin,et al.  NR-Bitstream video quality metrics for SSIM using encoding decisions in AVC and HEVC coded videos , 2015, J. Vis. Commun. Image Represent..

[31]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[32]  Andrea Zanella,et al.  Cognition-Based Networks: A New Perspective on Network Optimization Using Learning and Distributed Intelligence , 2015, IEEE Access.

[33]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[34]  Alexander A. Kist,et al.  Video-aware measurement-based admission control , 2013, 2013 Australasian Telecommunication Networks and Applications Conference (ATNAC).

[35]  Ramesh C. Jain,et al.  A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video , 2002, Pattern Recognit..

[36]  Alberto Testolin,et al.  Modeling language and cognition with deep unsupervised learning: a tutorial overview , 2013, Front. Psychol..

[37]  Chia-Wen Lin,et al.  mDASH: A Markov Decision-Based Rate Adaptation Approach for Dynamic HTTP Streaming , 2016, IEEE Transactions on Multimedia.

[38]  Geoffrey E. Hinton,et al.  A Learning Algorithm for Boltzmann Machines , 1985, Cogn. Sci..

[39]  Narciso García Santos,et al.  Q-Learning based control algorithm for HTTP adaptive streaming , 2015, VCIP 2015.

[40]  Martin Reisslein,et al.  Network performance evaluation using frame size and quality traces of single-layer and two-layer video: A tutorial , 2004, IEEE Communications Surveys & Tutorials.

[41]  Chia-Wen Lin,et al.  A Markov decision based rate adaption approach for dynamic HTTP streaming , 2015, 2015 Visual Communications and Image Processing (VCIP).

[42]  Mostafa H. Ammar,et al.  Client-Driven Network-level QoE fairness for Encrypted 'DASH-S' , 2016, Internet-QoE '16.

[43]  Vyas Sekar,et al.  Improving fairness, efficiency, and stability in HTTP-based adaptive video streaming with FESTIVE , 2012, CoNEXT '12.

[44]  Michele Zorzi,et al.  Performance analysis of dynamic adaptive video streaming over mobile content delivery networks , 2014, 2014 IEEE International Conference on Communications (ICC).

[45]  Leonardo Badia,et al.  Cognition-based networks: Applying cognitive science to multimedia wireless networking , 2014, Proceeding of IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks 2014.

[46]  Bo Fu,et al.  QoE-based transport optimization for video delivery over next generation cellular networks , 2011, 2011 IEEE Symposium on Computers and Communications (ISCC).

[47]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[48]  Federico Chiariotti,et al.  D-DASH: A Deep Q-Learning Framework for DASH Video Streaming , 2017, IEEE Transactions on Cognitive Communications and Networking.

[49]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.

[50]  Michele De Filippo De Grazia,et al.  Deep Unsupervised Learning on a Desktop PC: A Primer for Cognitive Scientists , 2013, Front. Psychol..

[51]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[52]  Wolfgang Effelsberg,et al.  QoE Analysis of DASH Cross-Layer Dependencies by Extensive Network Emulation , 2016, Internet-QoE '16.

[53]  Oliver Hohlfeld,et al.  Impact of frame rate and resolution on objective QoE metrics , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[54]  Tammam Tillo,et al.  QoE-Driven Dynamic Adaptive Video Streaming Strategy With Future Information , 2017, IEEE Transactions on Broadcasting.

[55]  Allen B. MacKenzie,et al.  A cross-layer controller for adaptive video streaming over IEEE 802.11 networks , 2015, 2015 IEEE International Conference on Communications (ICC).

[56]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[57]  Alessandro Sperduti,et al.  Learning Orthographic Structure With Sequential Generative Neural Networks , 2016, Cogn. Sci..

[58]  Stefano Tubaro,et al.  No-Reference Video Quality Monitoring for H.264/AVC Coded Video , 2009, IEEE Transactions on Multimedia.

[59]  Pedro Assuncao,et al.  Objective quality prediction model for lost frames in 3D video over TS , 2013, 2013 IEEE International Conference on Communications Workshops (ICC).