Serverless Streaming for Emerging Media: Towards 5G Network-Driven Cost Optimization

Immersive 3D media is an emerging type of media that captures, encodes and reconstructs the 3D appearance of people and objects, with applications in tele-presence, teleconference, entertainment, gaming and other fields. In this paper, we discuss a novel concept of live 3D immersive media streaming in a serverless setting. In particular, we present a novel networkcentric adaptive streaming framework which deviates from a traditional client-based adaptive streaming used in 2D video. In our framework, the decisions for the production of the transcoding profiles are taken in a centralized manner, by considering consumer metrics vs provisioning costs and inferring an expected consumer quality of experience and behavior based on them. This work has been realized in the context of the 5G-MEDIA project (www.5gmedia.eu), which has received funding from the European Union’s Horizon 2020 research and innovation programme under grant agreement No. 761699. K. Konstantoudakis, A. Doumanoglou, N. Zioulis, K. Christaki, P. Drakoulis, E. Christakis, D. Zarpalas and P. Daras are with: Visual Computing Lab (VCL), Information Technologies Institute (ITI), Centre for Research and Technology Hellas (CERTH), Thessaloniki, Greece Tel.: +30-2310-464160 Fax: +30-2310-464164 E-mail: k.konstantoudakis@iti.gr; aldoum@iti.gr; nzioulis@iti.gr; kchristaki@iti.gr; petros.drakoulis@iti.gr; manchr@iti.gr; zarpalas@iti.gr; daras@iti.gr D. Breitgand and A. Weit are with: Hybrid Cloud, Cloud and Data Technologies, IBM Research, Haifa, Israel Tel.: +972-4-8296211 E-mail: davidbr@il.ibm.com; weit@il.ibm.com In addition, we demonstrate that a naive application of the serverless paradigm might be sub optimal under some common immersive 3D media scenarios.

[1]  Federico Alvarez,et al.  An Edge-to-Cloud Virtualized Multimedia Service Platform for 5G Networks , 2019, IEEE Transactions on Broadcasting.

[2]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[3]  Gwendal Simon,et al.  Viewport-Driven Rate-Distortion Optimized 360º Video Streaming , 2018, 2018 IEEE International Conference on Communications (ICC).

[4]  Petros Daras,et al.  Toward Real-Time and Efficient Compression of Human Time-Varying Meshes , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Sabarish V. Babu,et al.  Comparative Evaluation of User Perceived Quality Assessment of Design Strategies for HTTP-based Adaptive Streaming , 2019, ACM Trans. Appl. Percept..

[6]  Mohammad Hosseini,et al.  Adaptive 360 VR Video Streaming: Divide and Conquer , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[7]  Mohammad Hosseini,et al.  Adaptive Rate Allocation for View-Aware Point-Cloud Streaming , 2019, ArXiv.

[8]  Petros Daras,et al.  Augmented VR , 2018, 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).

[9]  Jiangchuan Liu,et al.  Video processing with serverless computing: a measurement study , 2019, NOSSDAV.

[10]  Christian Timmerer,et al.  Tile-based Streaming of 8K Omnidirectional Video: Subjective and Objective QoE Evaluation , 2019, 2019 Eleventh International Conference on Quality of Multimedia Experience (QoMEX).

[11]  Feng Li,et al.  Rubiks: Practical 360-Degree Streaming for Smartphones , 2018, MobiSys.

[12]  Geoffrey M. Voelker,et al.  Sprocket: A Serverless Video Processing Framework , 2018, SoCC.

[13]  Ali C. Begen,et al.  Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale , 2013, IEEE Journal on Selected Areas in Communications.

[14]  William May,et al.  HTTP Live Streaming , 2017, RFC.

[15]  M. Siekkinen,et al.  Edge Computing Assisted Adaptive Mobile Video Streaming , 2019, IEEE Transactions on Mobile Computing.

[16]  Miska M. Hannuksela,et al.  An Overview of the OMAF Standard for 360° Video , 2019, 2019 Data Compression Conference (DCC).

[17]  Iraj Sodagar,et al.  The MPEG-DASH Standard for Multimedia Streaming Over the Internet , 2011, IEEE MultiMedia.

[18]  Jenq-Neng Hwang,et al.  Volumetric Media Streaming for Augmented Reality , 2018, 2018 IEEE Global Communications Conference (GLOBECOM).

[19]  Yong Liu,et al.  Multi-path multi-tier 360-degree video streaming in 5G networks , 2018, MMSys.

[20]  Petros Daras,et al.  An Integrated Platform for Live 3D Human Reconstruction and Motion Capturing , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Pushmeet Kohli,et al.  Fusion4D , 2016, ACM Trans. Graph..

[22]  Krzysztof Wegner,et al.  Immersive visual media — MPEG-I: 360 video, virtual navigation and beyond , 2017, 2017 International Conference on Systems, Signals and Image Processing (IWSSIP).

[23]  Min Chen,et al.  Online Cloud Transcoding and Distribution for Crowdsourced Live Game Video Streaming , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Petros Daras,et al.  Dynamic adaptive mesh streaming for real-time 3D teleimmersion , 2015, Web3D.

[25]  Christian Timmerer,et al.  Towards subjective quality of experience assessment for omnidirectional video streaming , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[26]  Christian Timmerer,et al.  Towards Bandwidth Efficient Adaptive Streaming of Omnidirectional Video over HTTP: Design, Implementation, and Evaluation , 2017, MMSys.

[27]  Mathias Wien,et al.  Standardization Status of Immersive Video Coding , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[28]  Yun Tian,et al.  A new live video streaming approach based on Amazon S3 pricing model , 2018, 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC).

[29]  Maria G. Martini,et al.  QoE Modeling for HTTP Adaptive Video Streaming–A Survey and Open Challenges , 2019, IEEE Access.

[30]  Maja Krivokuca,et al.  A Volumetric Approach to Point Cloud Compression–Part II: Geometry Compression , 2019, IEEE Transactions on Image Processing.

[31]  Fan Zhang,et al.  QoE-Aware Dynamic Video Rate Adaptation , 2014, 2015 IEEE Global Communications Conference (GLOBECOM).

[32]  Alexander Raake,et al.  A modular HTTP adaptive streaming QoE model — Candidate for ITU-T P.1203 (“P.NATS”) , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[33]  Miguel Rio,et al.  Quality of Experience for 3-D Immersive Media Streaming , 2018, IEEE Transactions on Broadcasting.

[34]  Shuang Fu,et al.  User-centric QoE model of visual perception for mobile videos , 2018, The Visual Computer.

[35]  Phuoc Tran-Gia,et al.  Identifying QoE optimal adaptation of HTTP adaptive streaming based on subjective studies , 2015, Comput. Networks.

[36]  Michael M. Kazhdan,et al.  Reconstruction of solid models from oriented point sets , 2005, SGP '05.

[37]  Charles T. Loop,et al.  Holoportation: Virtual 3D Teleportation in Real-time , 2016, UIST.

[38]  Maja Krivokuca,et al.  A Volumetric Approach to Point Cloud Compression—Part I: Attribute Compression , 2020, IEEE Transactions on Image Processing.

[39]  Rufael Mekuria,et al.  Design, Implementation, and Evaluation of a Point Cloud Codec for Tele-Immersive Video , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[40]  Ramesh K. Sitaraman,et al.  BOLA: Near-Optimal Bitrate Adaptation for Online Videos , 2016, IEEE/ACM Transactions on Networking.

[41]  Sebastian Möller,et al.  Modeling Gaming QoE: Towards the Impact of Frame Rate and Bit Rate on Cloud Gaming , 2018, 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX).

[42]  Phuoc Tran-Gia,et al.  A Survey on Quality of Experience of HTTP Adaptive Streaming , 2015, IEEE Communications Surveys & Tutorials.

[43]  Tarik Taleb,et al.  On Improving Video Streaming Efficiency, Fairness, Stability, and Convergence Time Through Client–Server Cooperation , 2018, IEEE Transactions on Broadcasting.

[44]  Halima Elbiaze,et al.  ADS: Adaptive and dynamic scaling mechanism for multimedia conferencing services in the cloud , 2018, 2018 15th IEEE Annual Consumer Communications & Networking Conference (CCNC).

[45]  Guanghui Zhang,et al.  Ensemble Adaptive Streaming – A New Paradigm to Generate Streaming Algorithms via Specializations , 2020, IEEE Transactions on Mobile Computing.

[46]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[47]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[48]  Ashutosh Singla,et al.  Subjective quality evaluation of tile-based streaming for omnidirectional videos , 2019, MMSys.

[49]  Abbas Mehrabi,et al.  Joint optimization of QoE and fairness through network assisted adaptive mobile video streaming , 2017, 2017 IEEE 13th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob).

[50]  Christian Timmerer,et al.  A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTP , 2019, IEEE Communications Surveys & Tutorials.

[51]  Federica Battisti,et al.  Impact of video content and transmission impairments on quality of experience , 2016, Multimedia Tools and Applications.

[52]  Cornelius Hellge,et al.  Viewport-dependent 360 degree video streaming based on the emerging Omnidirectional Media Format (OMAF) standard , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[53]  Alvaro Collet,et al.  High-quality streamable free-viewpoint video , 2015, ACM Trans. Graph..

[54]  Minsu Choi,et al.  Immersive 360° VR tiled streaming system for esports service , 2018, MMSys.

[55]  Petros Daras,et al.  Service Development Kit for Media-Type Virtualized Network Services in 5G Networks , 2020, IEEE Communications Magazine.

[56]  Petros Daras,et al.  A Low-Cost, Flexible and Portable Volumetric Capturing System , 2018, 2018 14th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS).

[57]  Kiyoharu Aizawa,et al.  Patch-based compression for Time-Varying Meshes , 2010, 2010 IEEE International Conference on Image Processing.

[58]  Miguel Rio,et al.  A System Architecture for Live Immersive 3D-Media Transcoding Over 5G Networks , 2018, 2018 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[59]  Filip De Turck,et al.  Towards 6DoF HTTP Adaptive Streaming Through Point Cloud Compression , 2019, ACM Multimedia.

[60]  Johan Tordsson,et al.  Analysis and characterization of a video-on-demand service workload , 2015, MMSys.

[61]  FanChing-Ling,et al.  A Survey on 360 Video Streaming , 2019 .

[62]  Petros Daras,et al.  3D tele-immersion platform for interactive immersive experiences between remote users , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[63]  Azer Bestavros,et al.  GISMO: a Generator of Internet Streaming Media Objects and workloads , 2001, PERV.

[64]  Dimitrios Zarpalas,et al.  Optimizing QoE and Cost in a 3D Immersive Media Platform: A Reinforcement Learning Approach , 2020 .

[65]  Oliver Schreer,et al.  Capture and 3D Video Processing of Volumetric Video , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[66]  Minhua Zhou,et al.  An Overview of Tiles in HEVC , 2013, IEEE Journal of Selected Topics in Signal Processing.

[67]  Rufael Mekuria,et al.  Point-Cloud Compression: Moving Picture Experts Group's New Standard in 2020 , 2019, IEEE Consumer Electronics Magazine.

[68]  Minyi Guo,et al.  Towards QoS-Aware and Resource-Efficient GPU Microservices Based on Spatial Multitasking GPUs In Datacenters , 2020, ArXiv.

[69]  Kyriakos Kritikos,et al.  A Review of Serverless Frameworks , 2018, 2018 IEEE/ACM International Conference on Utility and Cloud Computing Companion (UCC Companion).

[70]  Petros Daras,et al.  Benchmarking Open-Source Static 3D Mesh Codecs for Immersive Media Interactive Live Streaming , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.