When Cloud Meets Uncertain Crowd: An Auction Approach for Crowdsourced Livecast Transcoding

In the emerging crowd sourced live cast services, numerous amateur broadcasters live stream their video contents to worldwide viewers and constantly interact with them through chat messages. Live video contents are transcoded into multiple quality versions to better service viewers with different network and device configurations. Cloud computing becomes a natural choice to handle these computational intensive tasks due to its elasticity and the "pay-as-you-go" billing model. However, given the significantly large number of concurrent channel numbers and the diverse viewer geo-distributions in this new crowd sourced live cast service, even the cloud becomes significantly expensive to cover the whole community and inadequate in fulfilling the latency requirement. In this paper, after observing the abundant computational resources residing in end viewers, we propose a Cloud-Crowd collaborative system, C2, which combines end viewers with cloud to perform video transcoding in a cost-efficient way. To quantify the heterogeneity and uncertainty of viewers and pass the asymmetric information barrier, we incorporate statistical descriptions into our bidding language and design truthful auctions to recruit stable viewers with appropriate incentives. We further tailor redundancy strategies for workloads with different Quality of Service requirements to improve the stability of our system. Desirable economic properties, like social efficiency, ex-post incentive compatibility, individual rationality, are proved to be guaranteed in our studied scenarios. Using traces captured from the popular Twitch platform, we show that C2 achieves up to 93% more cost saving than a pure cloud-based solution, and significantly outperforms other baseline approaches in both social welfare and system stability.

[1]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[2]  Noam Nisan,et al.  Computationally feasible VCG mechanisms , 2000, EC '00.

[3]  Lifeng Sun,et al.  Characterizing User Behaviors in Mobile Personal Livecast , 2017, NOSSDAV.

[4]  Cong Zhang,et al.  CrowdTranscoding: Online Video Transcoding With Massive Viewers , 2017, IEEE Transactions on Multimedia.

[5]  Nicholas R. Jennings,et al.  Algorithms and mechanisms for procuring services with uncertain durations using redundancy , 2011, Artif. Intell..

[6]  Hwansoo Han,et al.  Design analysis for real-time video transcoding on cloud systems , 2013, SAC '13.

[7]  Cong Zhang,et al.  On crowdsourced interactive live streaming: a Twitch.tv-based measurement study , 2015, NOSSDAV.

[8]  He Ma,et al.  Dynamic scheduling on video transcoding for MPEG DASH in the cloud environment , 2014, MMSys '14.

[9]  Gaogang Xie,et al.  User Behavior Characterization of a Large-scale Mobile Live Streaming System , 2015, WWW.

[10]  Teruo Higashino,et al.  Edge-centric Computing: Vision and Challenges , 2015, CCRV.

[11]  Yanjiao Chen,et al.  TAMES: A Truthful Auction Mechanism for heterogeneous spectrum allocation , 2013, 2013 Proceedings IEEE INFOCOM.

[12]  Feng Wang,et al.  Crowdsourced live streaming over the cloud , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[13]  Brighten Godfrey,et al.  Low latency via redundancy , 2013, CoNEXT.

[14]  Feng Wang,et al.  On Design and Performance of Cloud-Based Distributed Interactive Applications , 2014, 2014 IEEE 22nd International Conference on Network Protocols.

[15]  Ramesh K. Sitaraman,et al.  Optimizing the video transcoding workflow in content delivery networks , 2015, MMSys.

[16]  Gang Wang,et al.  Anatomy of a Personalized Livestreaming System , 2016, Internet Measurement Conference.

[17]  Jianfei Cai,et al.  Toward Transcoding as a Service in a Multimedia Cloud: Energy-Efficient Job-Dispatching Algorithm , 2014, IEEE Transactions on Vehicular Technology.

[18]  Lifeng Sun,et al.  Joint online transcoding and geo-distributed delivery for dynamic adaptive streaming , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[19]  Blaise Agüera y Arcas,et al.  Communication-Efficient Learning of Deep Networks from Decentralized Data , 2016, AISTATS.

[20]  Athanasios V. Vasilakos,et al.  TRAC: Truthful auction for location-aware collaborative sensing in mobile crowdsourcing , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[21]  Mor Harchol-Balter,et al.  Reducing Latency via Redundant Requests: Exact Analysis , 2015, SIGMETRICS 2015.

[22]  Homer H. Chen,et al.  A Collaborative Transcoding Strategy for Live Broadcasting Over Peer-to-Peer IPTV Networks , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Yonggang Wen,et al.  Resource Provisioning and Profit Maximization for Transcoding in Clouds: A Two-Timescale Approach , 2017, IEEE Transactions on Multimedia.

[24]  Ravindra K. Ahuja,et al.  Network Flows: Theory, Algorithms, and Applications , 1993 .

[25]  James B. Orlin A Faster Strongly Polynomial Minimum Cost Flow Algorithm , 1993, Oper. Res..

[26]  Alberto Blanc,et al.  Transcoding live adaptive video streams at a massive scale in the cloud , 2015, MMSys.

[27]  Yonggang Wen,et al.  Dynamic Resource Provisioning with QoS Guarantee for Video Transcoding in Online Video Sharing Service , 2016, ACM Multimedia.

[28]  Tim Roughgarden,et al.  Algorithmic Game Theory , 2007 .