When Crowd Meets Big Video Data: Cloud-Edge Collaborative Transcoding for Personal Livecast

Deep penetration of personal computing devices and high-speed Internet has enabled everyone to be a broadcaster. In this crowdsourced live streaming service, numerous amateur broadcasters lively stream their video contents to viewers around the world. Consequently, these broadcasters generate a massive amount of video data. The set of video sources and recipients are big as well, so are demand for the storage and computational resources. Transcoding becomes a must to better service these viewers with different network and device configurations. However, the massive amount of video data contributed by countless channels even makes cloud significantly expensive for providing transcoding services to the whole community. In this paper, inspired by the paradigm of Edge Computing, we propose a Cloud-edge collaborative system which combines the idle end-viewers’ resources with the cloud to transcode the massive amount of videos at scale. Specifically, we put forward tailored viewer selection algorithms after empirically analyses the viewer behavior data. In the meantime, we propose auction-based payment schemes to motivate these viewers participating in the transcoding. Large-scale trace-driven simulations demonstrate the superiority of our approach in cost reduction and service stability. We further implement a prototype in PlanetLab to prove the feasibility of our design.

[1]  Yaron Singer,et al.  Pricing mechanisms for crowdsourcing markets , 2013, WWW.

[2]  Ramesh K. Sitaraman,et al.  The Akamai network: a platform for high-performance internet applications , 2010, OPSR.

[3]  Feng Wang,et al.  On Design and Performance of Cloud-Based Distributed Interactive Applications , 2014, 2014 IEEE 22nd International Conference on Network Protocols.

[4]  Cong Zhang,et al.  When Cloud Meets Uncertain Crowd: An Auction Approach for Crowdsourced Livecast Transcoding , 2017, ACM Multimedia.

[5]  Raja Lavanya,et al.  Fog Computing and Its Role in the Internet of Things , 2019, Advances in Computer and Electrical Engineering.

[6]  Loïc Cerf,et al.  Watch me playing, i am a professional: a first study on video game live streaming , 2012, WWW.

[7]  Luis Rodero-Merino,et al.  Finding your Way in the Fog: Towards a Comprehensive Definition of Fog Computing , 2014, CCRV.

[8]  Fang Hao,et al.  Unreeling netflix: Understanding and improving multi-CDN movie delivery , 2012, 2012 Proceedings IEEE INFOCOM.

[9]  Alberto Blanc,et al.  Transcoding live adaptive video streams at a massive scale in the cloud , 2015, MMSys.

[10]  Gang Wang,et al.  Anatomy of a Personalized Livestreaming System , 2016, Internet Measurement Conference.

[11]  Loïc Cerf,et al.  Modeling and Analyzing the Video Game Live-Streaming Community , 2014, 2014 9th Latin American Web Congress.

[12]  Yan Zhang,et al.  Optimal Incentive Design for Cloud-Enabled Multimedia Crowdsourcing , 2016, IEEE Transactions on Multimedia.

[13]  Gwendal Simon,et al.  The brewing storm in cloud gaming: A measurement study on cloud to end-user latency , 2012, 2012 11th Annual Workshop on Network and Systems Support for Games (NetGames).

[14]  Cong Zhang,et al.  On crowdsourced interactive live streaming: a Twitch.tv-based measurement study , 2015, NOSSDAV.

[15]  Yang Guo,et al.  Peer-to-Peer Streaming of Layered Video: Efficiency, Fairness and Incentive , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Ramesh K. Sitaraman,et al.  Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs , 2012, IEEE/ACM Transactions on Networking.

[17]  Feng Wang,et al.  Crowdsourced live streaming over the cloud , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[18]  John C. Tang,et al.  Meerkat and Periscope: I Stream, You Stream, Apps Stream for Live Streams , 2016, CHI.

[19]  Andruid Kerne,et al.  Streaming on twitch: fostering participatory communities of play within live mixed media , 2014, CHI.

[20]  Wenwu Zhu,et al.  Two decades of internet video streaming: A retrospective view , 2013, TOMCCAP.

[21]  Cong Zhang,et al.  Utilizing Massive Viewers for Video Transcoding in Crowdsourced Live Streaming , 2016, 2016 IEEE 9th International Conference on Cloud Computing (CLOUD).

[22]  Gwendal Simon,et al.  DASH in Twitch: Adaptive Bitrate Streaming in Live Game Streaming Platforms , 2014, VideoNext '14.