Optimal Decentralized Dynamic Policies for Video Streaming over Wireless Channels

The problem addressed is that of optimally controlling, in a decentralized fashion, the download of mobile video, which is expected to comprise 75 % of total mobile data traffic by 2020. The server can dynamically choose which packets to download to clients, from among several packets which encode their videos at different resolutions, as well as the power levels of their transmissions. This allows it to control packet delivery probabilities, and thereby, for example, avert imminent video outages at clients. It must however respect the access point's constraints on bandwidth and average transmission power. The goal is to maximize video "Quality of Experience" (QoE), which depends on several factors such as (i) outage duration when the video playback buffer is empty, (ii) number of outage periods, (iii) how many frames downloaded are of lower resolution, (iv) temporal variations in resolution, etc. It is shown that there exists an optimal decentralized solution where the AP announces the price of energy, and each client distributedly and dynamically maximizes its own QoE subject to the cost of energy. A distributed iterative algorithm to solve for optimal decentralized policy is also presented. Further, for the client-level QoE optimization, the optimal choice of video-resolution and power-level of packet transmissions has a simple monotonicity and threshold structure vis-a-vis video playback buffer level. When the number of orthogonal channels is less than the number of clients, there is an index policy for prioritizing packet transmissions. When the AP has to simply choose which clients' packets to transmit, the index policy is asymptotically optimal as the number of channels is scaled up with clients.

[1]  Guanfeng Liang,et al.  Effect of Delay and Buffering on Jitter-Free Streaming Over Random VBR Channels , 2008, IEEE Transactions on Multimedia.

[2]  Yong Liu,et al.  Towards agile and smooth video adaptation in dynamic HTTP streaming , 2012, CoNEXT '12.

[3]  Wayne Goodridge,et al.  Dynamic Adaptive Streaming over HTTP (DASH) within P2P systems: a survey , 2019, International Journal of Advanced Networking and Applications.

[4]  J. Bather,et al.  Multi‐Armed Bandit Allocation Indices , 1990 .

[5]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[6]  E. Altman.  Constrained Markov Decision Processes , 1999 .

[7]  Panganamala Ramana Kumar,et al.  Optimizing quality of experience of dynamic video streaming over fading wireless networks , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[8]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, CACM.

[9]  Michael Patriksson,et al.  Primal convergence from dual subgradient methods for convex optimization , 2014, Mathematical Programming.

[10]  Srinivasan Seshan,et al.  Developing a predictive model of quality of experience for internet video , 2013, SIGCOMM.

[11]  Martin L. Puterman,et al.  Markov Decision Processes: Discrete Stochastic Dynamic Programming , 1994 .

[12]  Laurence A. Wolsey,et al.  Two “well-known” properties of subgradient optimization , 2009, Math. Program..

[13]  D.A. Castanon,et al.  Rollout Algorithms for Stochastic Scheduling Problems , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[14]  Pravin Varaiya,et al.  Stochastic Systems: Estimation, Identification, and Adaptive Control , 1986 .

[15]  Y. Ho,et al.  Team decision theory and information structures in optimal control problems--Part II , 1972 .

[16]  Markus Fiedler,et al.  Initial delay vs. interruptions: Between the devil and the deep blue sea , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[17]  Asuman E. Ozdaglar,et al.  Avoiding Interruptions — A QoE Reliability Function for Streaming Media Applications , 2011, IEEE Journal on Selected Areas in Communications.

[18]  Lusheng Ji,et al.  Understanding the impact of network dynamics on mobile video user engagement , 2014, SIGMETRICS '14.

[19]  Phuoc Tran-Gia,et al.  A Survey on Quality of Experience of HTTP Adaptive Streaming , 2015, IEEE Communications Surveys & Tutorials.

[20]  Keith D. Kastella,et al.  Foundations and Applications of Sensor Management , 2010 .

[21]  Danny De Vleeschauwer,et al.  Model for estimating QoE of video delivered using HTTP adaptive streaming , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[22]  Peter Whittle,et al.  Optimal Control: Basics and Beyond , 1996 .

[23]  Eitan Altman,et al.  Analysis of Buffer Starvation With Application to Objective QoE Optimization of Streaming Services , 2011, IEEE Transactions on Multimedia.

[24]  Changhoon Yim,et al.  Evaluation of temporal variation of video quality in packet loss networks , 2011, Signal Process. Image Commun..

[25]  Rahul Singh,et al.  Throughput Optimal Decentralized Scheduling of Multihop Networks With End-to-End Deadline Constraints: Unreliable Links , 2016, IEEE Transactions on Automatic Control.

[26]  Chong Luo,et al.  Multimedia Cloud Computing , 2011, IEEE Signal Processing Magazine.

[27]  George Pallis,et al.  Insight and perspectives for content delivery networks , 2006, CACM.

[28]  коммуникации Медиа.  Open Source Media Framework , 2012 .

[29]  P. Whittle.  Restless bandits: activity allocation in a changing world , 1988, Journal of Applied Probability.

[30]  Eitan Altman,et al.  Impact of flow-level dynamics on QoE of video streaming in wireless networks , 2013, 2013 Proceedings IEEE INFOCOM.