QoE-aware distributed cloud-based live streaming of multisourced multiview videos

Abstract Video streaming is one of the most prevailing and bandwidth consuming Internet applications today. Advancements in technology and prevalence of video capturing devices result in massive multi-sourced (aka crowdsourced) live video broadcasting over the Internet. A single scene may be captured by multiple spectators from different angles (views), enabling an opportunity for interactive multiview video by integrating these individually captured views. Such multi-sourced multiview video offers more realistic and immersive experience of a scene. In this paper, we present a Quality of Experience (QoE) driven, cost effective Crowdsourced Multiview Live Streaming (CMLS) system. The CMLS aims to minimize the overall system cost by selecting optimal cloud site for video transcoding and the number of representations, based on the view popularity and viewer's available bandwidth. In addition, we present a QoE metric considering delay and received video quality. We formulate the selection of optimal cloud site and number of representations to meet the required QoE as a resource allocation problem using Integer Programming (IP). Moreover, we present a Greedy Minimal Cost (GMC) algorithm to perform resource allocation efficiently. We use real live video traces collected from three large-scale live video providers (Twitch.tv, YouTube Live, and YouNow) to evaluate our proposed strategy. We evaluate the GMC algorithm considering the overall cost, QoE, video quality, and average latency between viewers and transcoding location. We compare our results with the optimal solution and the state-of-the art policy used in a popular video steaming system. Our results demonstrate that the GMC achieves near optimal results and substantially outperforms the state-of-the art policy.

[1]  Kashif Bilal,et al.  Crowdsourced Multi-View Live Video Streaming using Cloud Computing , 2017, IEEE Access.

[2]  Vyas Sekar,et al.  A case for a coordinated internet video control plane , 2012, SIGCOMM '12.

[3]  Shigeyuki Sakazawa,et al.  Objective perceptual video quality measurement method based on hybrid no reference framework , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[4]  Antonio Ortega,et al.  Coding structure optimization for interactive multiview streaming in virtual world observation , 2008, 2008 IEEE 10th Workshop on Multimedia Signal Processing.

[5]  Ramesh K. Sitaraman,et al.  Video Stream Quality Impacts Viewer Behavior: Inferring Causality Using Quasi-Experimental Designs , 2013, IEEE/ACM Transactions on Networking.

[6]  Tao Li,et al.  An analysis of the YouNow live streaming platform , 2015, 2015 IEEE 40th Local Computer Networks Conference Workshops (LCN Workshops).

[7]  Chun-Ying Huang,et al.  Quantifying Skype user satisfaction , 2006, SIGCOMM 2006.

[8]  Xiapu Luo,et al.  Inferring the QoE of HTTP video streaming from user-viewing activities , 2011, W-MUST '11.

[9]  Antonio Pescapè,et al.  On the performance of the wide-area networks interconnecting public-cloud datacenters around the globe , 2017, Comput. Networks.

[10]  Jacob Chakareski Uplink Scheduling of Visual Sensors: When View Popularity Matters , 2015, IEEE Transactions on Communications.

[11]  Jacob Chakareski Transmission Policy Selection for Multi-View Content Delivery Over Bandwidth Constrained Channels , 2014, IEEE Transactions on Image Processing.

[12]  Lea Skorin-Kapov,et al.  Cross-layer QoE-driven admission control and resource allocation for adaptive multimedia services in LTE , 2014, J. Netw. Comput. Appl..

[13]  Antonio Ortega,et al.  On Dependent Bit Allocation for Multiview Image Coding With Depth-Image-Based Rendering , 2011, IEEE Transactions on Image Processing.

[14]  Alberto Blanc,et al.  Optimal set of video representations in adaptive streaming , 2014, MMSys '14.

[15]  Mohamed Hefeeda,et al.  Energy-efficient multicasting of multiview 3D videos to mobile devices , 2012, TOMCCAP.

[16]  Srinivasan Seshan,et al.  Practical, Real-time Centralized Control for CDN-based Live Video Delivery , 2015, SIGCOMM.

[17]  Dario Pompili,et al.  Collaborative multi-bitrate video caching and processing in Mobile-Edge Computing networks , 2016, 2017 13th Annual Conference on Wireless On-demand Network Systems and Services (WONS).

[18]  Bo Li,et al.  Coping With Heterogeneous Video Contributors and Viewers in Crowdsourced Live Streaming: A Cloud-Based Approach , 2016, IEEE Transactions on Multimedia.

[19]  Philip J. Corriveau,et al.  VQEG evaluation of objective methods of video quality assessment , 1999 .

[20]  Yusheng Ji,et al.  Multiple Description Coding and Recovery of Free Viewpoint Video for Wireless Multi-Path Streaming , 2015, IEEE Journal of Selected Topics in Signal Processing.

[21]  Mohamed M. Fouad,et al.  A Modified Multiview Video Streaming System Using 3-Tier Architecture , 2016 .

[22]  Shobha Venkataraman,et al.  Prometheus: toward quality-of-experience estimation for mobile apps from passive network measurements , 2014, HotMobile.

[23]  Stephen R. Gulliver,et al.  Defining user perception of distributed multimedia quality , 2006, TOMCCAP.

[24]  Srinivasan Seshan,et al.  Developing a predictive model of quality of experience for internet video , 2013, SIGCOMM.

[25]  Vyas Sekar,et al.  Understanding the impact of video quality on user engagement , 2011, CACM.

[26]  Imad Abdeljaouad,et al.  Monitoring IPTV quality of experience in overlay networks using utility functions , 2015, J. Netw. Comput. Appl..

[27]  Feng Wang,et al.  Crowdsourced live streaming over the cloud , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[28]  Bo Li,et al.  Airlift: Video conferencing as a cloud service using inter-datacenter networks , 2012, 2012 20th IEEE International Conference on Network Protocols (ICNP).

[29]  Lazaros F. Merakos,et al.  A survey on parametric QoE estimation for popular services , 2017, J. Netw. Comput. Appl..

[30]  Alberto Blanc,et al.  Optimal Selection of Adaptive Streaming Representations , 2014, ACM Trans. Multim. Comput. Commun. Appl..

[31]  Jacob Chakareski,et al.  Wireless Streaming of Interactive Multi-View Video via Network Compression and Path Diversity , 2014, IEEE Transactions on Communications.

[32]  Gwendal Simon,et al.  YouTube live and Twitch: a tour of user-generated live streaming systems , 2015, MMSys.

[33]  Jacob Chakareski,et al.  View-Popularity-Driven Joint Source and Channel Coding of View and Rate Scalable Multi-View Video , 2015, IEEE Journal of Selected Topics in Signal Processing.