QoE-aware optimization of multimedia flow scheduling

This paper deals with the subjective quality maximization problem when scheduling multimedia traffic flows in a shared channel. In order to quantify such user satisfaction a utility function dependent on flow transfer delay is used. In this context, we formulate the Quality of Experience aware resource allocation optimization problem as a Markov Decision Process. This model is analytically unsolvable in general, and as an approximate solution we develop a simple and tractable index rule based on Gittins approach, originally aimed just at minimizing mean flow delay. As concluded from simulation results, when evaluating subjective quality performance this novel index rule proposal outperforms the most relevant existing scheduling disciplines.

[1]  Ramesh K. Sitaraman,et al.  Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs , 2012, IEEE/ACM Transactions on Networking.

[2]  Urtzi Ayesta,et al.  Optimal scheduling of jobs with a DHR tail in the M/G/1 queue , 2008, VALUETOOLS.

[3]  John N. Tsitsiklis,et al.  The Complexity of Markov Decision Processes , 1987, Math. Oper. Res..

[4]  Reginald D. Smith,et al.  The Dynamics of Internet Traffic: Self-Similarity, Self-Organization, and Complex Phenomena , 2008, Adv. Complex Syst..

[5]  M. Puterman.  Chapter 8 Markov decision processes , 1990 .

[6]  E. M. Wright,et al.  Adaptive Control Processes: A Guided Tour , 1961, The Mathematical Gazette.

[7]  Fernando Boavida,et al.  Quality of Experience management framework for real-time multimedia applications , 2009, Int. J. Internet Protoc. Technol..

[8]  R. Wilder,et al.  Wide-area Internet traffic patterns and characteristics , 1997, IEEE Netw..

[9]  Aref Meddeb,et al.  Internet QoS: Pieces of the puzzle , 2010, IEEE Communications Magazine.

[10]  Wolfgang Kellerer,et al.  QoE-based Cross-layer Optimization for Wireless Multiuser Systems , 2008 .

[11]  Stoyan Poryazov,et al.  OVERALL QOS REFERENCING IN TELECOMMUNICATION SYSTEMS - SOME CURRENT CONCEPTS AND OPEN ISSUES , 2011 .

[12]  Craig Boutilier,et al.  Exploiting Structure in Policy Construction , 1995, IJCAI.

[13]  Peter Reichl,et al.  Logarithmic laws in service quality perception: where microeconomics meets psychophysics and quality of experience , 2013, Telecommun. Syst..

[14]  J. Gittins.  Bandit processes and dynamic allocation indices , 1979 .

[15]  Urtzi Ayesta,et al.  PROPERTIES OF THE GITTINS INDEX WITH APPLICATION TO OPTIMAL SCHEDULING , 2011, Probability in the Engineering and Informational Sciences.

[16]  Ioannis Lambadaris,et al.  Optimal scheduling in multi-server queues with random connectivity and retransmissions , 2012, Comput. Commun..

[17]  Wei-Ho Chung,et al.  A reduced dimension MDP-based call admission control scheme for next generation telecommunications , 2012, 2012 8th International Wireless Communications and Mobile Computing Conference (IWCMC).

[18]  Raj Jain,et al.  A Quantitative Measure Of Fairness And Discrimination For Resource Allocation In Shared Computer Systems , 1998, ArXiv.

[19]  Zhi Zhang,et al.  Approximate stochastic dynamic programming for opportunistic fair scheduling in wireless networks , 2008, 2008 47th IEEE Conference on Decision and Control.

[20]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[21]  Peter Schelkens,et al.  Qualinet White Paper on Definitions of Quality of Experience , 2013 .

[22]  Andrzej Jajszczyk,et al.  A survey of QoE assurance in converged networks , 2011, Comput. Networks.

[23]  J. V. Mieghem.  Dynamic Scheduling with Convex Delay Costs: The Generalized CU Rule , 1995 .

[24]  Samuli Aalto,et al.  Impact of Size-Based Scheduling on Flow Level Performance in Wireless Downlink Data Channels , 2007, ITC.

[25]  Eva Ibarrola,et al.  Web QoE Evaluation in Multi-agent Networks: Validation of ITU-T G.1030 , 2009, 2009 Fifth International Conference on Autonomic and Autonomous Systems.

[26]  Konstantin Avrachenkov,et al.  Differentiation between short and long TCP flows: predictability of the response time , 2004, IEEE INFOCOM 2004.

[27]  Markus Fiedler,et al.  A generic quantitative relationship between quality of experience and quality of service , 2010, IEEE Network.

[28]  Wolfgang Kellerer,et al.  QoE-Driven Cross-Layer Optimization for High Speed Downlink Packet Access , 2009, J. Commun..

[29]  R. Weber.  On the Gittins Index for Multiarmed Bandits , 1992 .

[30]  Konstantin Avrachenkov,et al.  Optimal policy for multi-class scheduling in a single server queue , 2009, 2009 21st International Teletraffic Congress.

[31]  Preben E. Mogensen,et al.  QoE oriented cross-layer design of a resource allocation algorithm in beyond 3G systems , 2010, Comput. Commun..

[32]  Adam Wierman,et al.  Fairness and scheduling in single server queues , 2011 .

[33]  Markus Rupp,et al.  System Level Simulation of LTE Networks , 2010, 2010 IEEE 71st Vehicular Technology Conference.

[34]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[35]  Eva Ibarrola,et al.  Quality of service management for ISPs: A model and implementation methodology based on the ITU-T recommendation E.802 framework , 2010, IEEE Communications Magazine.