Markov Decision Policies for Dynamic Video Delivery in Wireless Caching Networks

This paper proposes a video delivery strategy for dynamic streaming services which maximizes time-average streaming quality under a playback delay constraint in wireless caching networks. The network where popular videos encoded by scalable video coding are already stored in randomly distributed caching nodes is considered under adaptive video streaming concepts, and distance-based interference management is investigated in this paper. In this network model, a streaming user makes delay-constrained decisions depending on stochastic network states: 1) caching node for video delivery, 2) video quality, and 3) the quantity of video chunks to receive. Since wireless link activation for video delivery may introduce delays, different timescales for updating caching node association, video quality adaptation, and chunk amounts are considered. After associating with a caching node for video delivery, the streaming user chooses combinations of quality and chunk amounts in the small timescale. The dynamic decision making process for video quality and chunk amounts at each slot is modeled using Markov decision process, and the caching node decision is made based on the framework of Lyapunov optimization. Our intensive simulations verify that the proposed video delivery algorithm works reliably and also can control the tradeoff between video quality and playback latency.

[1]  Xiaoying Gan,et al.  Content Delivery in Cache-Enabled Wireless Evolving Social Networks , 2018, IEEE Transactions on Wireless Communications.

[2]  Deniz Gündüz,et al.  Wireless Content Caching for Small Cell and D2D Networks , 2016, IEEE Journal on Selected Areas in Communications.

[3]  Nihar Jindal,et al.  Transmission Capacity of Wireless Ad Hoc Networks: Successive Interference Cancellation vs. Joint Detection , 2009, 2009 IEEE International Conference on Communications.

[4]  Wenyi Zhang,et al.  Caching-Based Scalable Video Transmission Over Cellular Networks , 2016, IEEE Communications Letters.

[5]  Giuseppe Caire,et al.  Adaptive Video Streaming for Wireless Networks With Multiple Users and Helpers , 2013, IEEE Transactions on Communications.

[6]  Wan Choi,et al.  Caching Placement in Stochastic Wireless Caching Helper Networks: Channel Selection Diversity via Caching , 2016, IEEE Transactions on Wireless Communications.

[7]  Wan Choi,et al.  Mobility-Aware Content Placement for Device-to-Device Caching Systems , 2019, IEEE Transactions on Wireless Communications.

[8]  Cheng Zhan,et al.  Content Cache Placement for Scalable Video in Heterogeneous Wireless Network , 2017, IEEE Communications Letters.

[9]  Antonios Argyriou,et al.  Video delivery over heterogeneous cellular networks: Optimizing cost and performance , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[10]  Gang Feng,et al.  Optimal Cooperative Content Caching and Delivery Policy for Heterogeneous Cellular Networks , 2017, IEEE Transactions on Mobile Computing.

[11]  Konstantinos Poularakis,et al.  Approximation Algorithms for Mobile Data Caching in Small Cell Networks , 2014, IEEE Transactions on Communications.

[12]  Bin Xia,et al.  Analysis on Cache-Enabled Wireless Heterogeneous Networks , 2015, IEEE Transactions on Wireless Communications.

[13]  Xiaofei Wang,et al.  Cache in the air: exploiting content caching and delivery techniques for 5G systems , 2014, IEEE Communications Magazine.

[14]  Jiangchuan Liu,et al.  Understanding the Characteristics of Internet Short Video Sharing: A YouTube-Based Measurement Study , 2013, IEEE Transactions on Multimedia.

[15]  Shobha. D Jalikoppa.  AMES-Cloud : A Framework of Adaptive Mobile Video Streaming and Efficient Social Video Sharing in the Clouds , 2014 .

[16]  Tony Q. S. Quek,et al.  Cooperative Caching and Transmission Design in Cluster-Centric Small Cell Networks , 2016, IEEE Transactions on Wireless Communications.

[17]  Antonios Argyriou,et al.  Caching and operator cooperation policies for layered video content delivery , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[18]  Mehdi Bennis,et al.  Living on the edge: The role of proactive caching in 5G wireless networks , 2014, IEEE Communications Magazine.

[19]  W. Marsden.  I and J , 2012 .

[20]  Joongheon Kim,et al.  Adaptive Detector Selection for Queue-Stable Word Error Rate Minimization in Connected Vehicle Receiver Design , 2018, IEEE Transactions on Vehicular Technology.

[21]  Lajos Hanzo,et al.  Dynamic Resource Allocation and Layer Selection for Scalable Video Streaming in Femtocell Networks: A Twin-Time-Scale Approach , 2018, IEEE Transactions on Communications.

[22]  John B. Shoven,et al.  I , Edinburgh Medical and Surgical Journal.

[23]  Alexandros G. Dimakis,et al.  FemtoCaching: Wireless video content delivery through distributed caching helpers , 2011, 2012 Proceedings IEEE INFOCOM.

[24]  Thomas Stockhammer,et al.  Dynamic adaptive streaming over HTTP --: standards and design principles , 2011, MMSys.

[25]  Vikas Wasade,et al.  Mobility-Aware Caching in D2D Networks , 2018 .

[26]  Jaekyun Moon,et al.  Probabilistic Caching Policy for Categorized Contents and Consecutive User Demands , 2019, ICC 2019 - 2019 IEEE International Conference on Communications (ICC).

[27]  Ming Xiao,et al.  Efficient Scheduling and Power Allocation for D2D-Assisted Wireless Caching Networks , 2015, IEEE Transactions on Communications.

[28]  Joongheon Kim,et al.  REQUEST: Seamless Dynamic Adaptive Streaming over HTTP for Multi-Homed Smartphone under Resource Constraints , 2017, ACM Multimedia.

[29]  Joongheon Kim,et al.  Feasibility study of stochastic streaming with 4K UHD video traces , 2015, 2015 International Conference on Information and Communication Technology Convergence (ICTC).

[30]  Joongheon Kim,et al.  Quality-Aware Streaming and Scheduling for Device-to-Device Video Delivery , 2016, IEEE/ACM Transactions on Networking.

[31]  Dimitri P. Bertsekas,et al.  Data networks (2nd ed.) , 1992 .

[32]  Jeffrey G. Andrews,et al.  Optimizing Content Caching to Maximize the Density of Successful Receptions in Device-to-Device Networking , 2016, IEEE Transactions on Communications.

[33]  Bartlomiej Blaszczyszyn,et al.  Optimal geographic caching in cellular networks , 2014, 2015 IEEE International Conference on Communications (ICC).

[34]  Xuemin Shen,et al.  Proactive Caching for Mobile Video Streaming in Millimeter Wave 5G Networks , 2016, IEEE Transactions on Wireless Communications.

[35]  Mohamed-Slim Alouini,et al.  Optimal Caching in 5G Networks With Opportunistic Spectrum Access , 2018, IEEE Transactions on Wireless Communications.

[36]  Zheng Chen,et al.  Probabilistic Caching in Wireless D2D Networks: Cache Hit Optimal Versus Throughput Optimal , 2016, IEEE Communications Letters.

[37]  Jeongho Kwak,et al.  Two Time-Scale Edge Caching and BS Association for Power-Delay Tradeoff in Multi-Cell Networks , 2019, IEEE Transactions on Communications.

[38]  Abhay Parekh,et al.  Spectrum sharing for unlicensed bands , 2005, IEEE Journal on Selected Areas in Communications.

[39]  Dimitri P. Bertsekas,et al.  Data Networks , 1986 .

[40]  Sucha Supittayapornpong,et al.  Dynamic Markov Decision Policies for Delay Constrained Wireless Scheduling , 2013, IEEE Transactions on Automatic Control.

[41]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[42]  Joongheon Kim,et al.  Wireless Video Caching and Dynamic Streaming Under Differentiated Quality Requirements , 2018, IEEE Journal on Selected Areas in Communications.

[43]  Xiaofei Wang,et al.  AMES-Cloud: A Framework of Adaptive Mobile Video Streaming and Efficient Social Video Sharing in the Clouds , 2013, IEEE Transactions on Multimedia.