Livesmart: A QoS-Guaranteed Cost-Minimum Framework of Viewer Scheduling for Crowdsourced Live Streaming

Viewer scheduling among different CDN providers in crowdsourced live streaming (CLS) service is especially challenging due to the large-scale dynamic viewers as well as the time-variant performance of the content delivery network. A practical scheduling method should tackle the following challenges: 1) accurate modeling of viewer patterns and CDN performance; 2) intelligent workload offloading to save costs while guaranteeing the quality of service (QoS); 3) and ease of integration with practical CDN infrastructure in CLS platforms. In this paper, we propose Livesmart, a novel framework that facilitates a QoS-guaranteed cost-efficient approach for CLS services. Specifically, we address the first challenge by carefully designing deep neural networks which make Livestream capture the environment dynamics without any presumptions; we then tackle the second challenge by leveraging the Model Predictive Control (MPC) method which enables Livesmart to make decisions in a long-term way. For the last challenge, we propose a probability shift model based on the realistic CLS delivery structure, thus empowering Livesmart to be practically deployed. We collect real-world data in cooperation with Kuaishou, one of the largest CLS provider in China, and evaluate Livesmart with trace-driven experiments. In comparison with prevalent methods, Livesmart can significantly reduce the CDN bandwidth costs (24.97%-63.45%) and improve the average QoS (5.79%-7.63%).

[1]  Hua Peng,et al.  A Novel Distribution Service Policy for Crowdsourced Live Streaming in Cloud Platform , 2018, IEEE Transactions on Network and Service Management.

[2]  Taesang Choi,et al.  CDN interconnection service trial: implementation and analysis , 2016, IEEE Communications Magazine.

[3]  Jiming Chen,et al.  Mobility Modeling and Prediction in Bike-Sharing Systems , 2016, MobiSys.

[4]  ZhangHui,et al.  A case for a coordinated internet video control plane , 2012 .

[5]  Daniel Edwards,et al.  The Alpha-Beta Heuristic , 1963 .

[6]  Chris Dyer,et al.  Neural Arithmetic Logic Units , 2018, NeurIPS.

[7]  Rittwik Jana,et al.  LiveJack: Integrating CDNs and Edge Clouds for Live Content Broadcasting , 2017, ACM Multimedia.

[8]  Yonggang Wen,et al.  Toward Optimal Deployment of Cloud-Assisted Video Distribution Services , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Zoltán Ádám Mann,et al.  Allocation of Virtual Machines in Cloud Data Centers—A Survey of Problem Models and Optimization Algorithms , 2015, ACM Comput. Surv..

[10]  Fang Hao,et al.  A tale of three CDNs: An active measurement study of Hulu and its CDNs , 2012, 2012 Proceedings IEEE INFOCOM Workshops.

[11]  Chen Tian,et al.  Optimizing cost and performance for content multihoming , 2012, SIGCOMM '12.

[12]  Jun Zhang,et al.  Content multi-homing: An alternative approach , 2014, 2014 IEEE International Conference on Communications (ICC).

[13]  Haitian Pang,et al.  Optimizing Personalized Interaction Experience in Crowd-Interactive Livecast: A Cloud-Edge Approach , 2018, ACM Multimedia.

[14]  Steve Uhlig,et al.  Open Connect Everywhere: A Glimpse at the Internet Ecosystem through the Lens of the Netflix CDN , 2016, CCRV.

[15]  MannZoltán Ádám Allocation of Virtual Machines in Cloud Data CentersA Survey of Problem Models and Optimization Algorithms , 2015 .

[16]  Fang Hao,et al.  Unreeling netflix: Understanding and improving multi-CDN movie delivery , 2012, 2012 Proceedings IEEE INFOCOM.

[17]  Haitian Pang,et al.  First Mile in Crowdsourced Live Streaming: A Content Harvest Network Approach , 2017, ACM Multimedia.

[18]  Cong Zhang,et al.  When Cloud Meets Uncertain Crowd: An Auction Approach for Crowdsourced Livecast Transcoding , 2017, ACM Multimedia.

[19]  Vyas Sekar,et al.  CFA: A Practical Prediction System for Video QoE Optimization , 2016, NSDI.

[20]  Shijie Sun,et al.  Pytheas: Enabling Data-Driven Quality of Experience Optimization Using Group-Based Exploration-Exploitation , 2017, NSDI.

[21]  Lifeng Sun,et al.  Joint online transcoding and geo-distributed delivery for dynamic adaptive streaming , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[22]  Minghua Chen,et al.  Migration Towards Cloud-Assisted Live Media Streaming , 2016, IEEE/ACM Transactions on Networking.

[23]  Albert G. Greenberg,et al.  Optimizing Cost and Performance in Online Service Provider Networks , 2010, NSDI.

[24]  Yiping Chen,et al.  Content Delivery Networks as a Virtual Network Function: A Win-Win ISP-CDN Collaboration , 2016, 2016 IEEE Global Communications Conference (GLOBECOM).

[25]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, SIGCOMM.

[26]  Feng Wang,et al.  Crowdsourced live streaming over the cloud , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[27]  I. Stoica,et al.  A case for a coordinated internet video control plane , 2012, CCRV.