Dynamic VR live streaming over MMT

While virtual reality (VR) videos have attracted significant amount of attention and efforts, the development of VR is still quite challenging. Among the challenges, the need for enormous bandwidth in live streaming hasn't yet been addressed satisfactorily. To tackle this aspect, we propose a 360° VR live streaming system based on MPEG media transport (MMT) to guarantee the delivery of VR video as well as the user experience. Within the proposed scheme, we divide the integrated VR video into multiple partitioned videos, and encode and encapsulate the partitioned videos into different MMT Assets. An MMT signaling message is introduced to indicate the spatial relationship among the partitioned Assets. The server selectively delivers the partitioned Assets that cover the client's current viewport with high bitrate. Meanwhile, other Assets are also delivered with low bitrate to the client for covering the entire view. We compare the bandwidth used by the developed system in delivery and PSNR of the delivered Assets with benchmark approaches in VR streaming.

[1]  Jizheng Xu,et al.  An Introduction to High Efficiency Video Coding Range Extensions , 2019 .

[2]  Miska M. Hannuksela,et al.  HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications , 2016, ACM Multimedia.

[3]  Minhua Zhou,et al.  An Overview of Tiles in HEVC , 2013, IEEE Journal of Selected Topics in Signal Processing.

[4]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Shaowei Xie,et al.  DASH and MMT and Their Applications in ATSC 3 . 0 , 2016 .

[6]  Cyril Concolato,et al.  Tiled-based adaptive streaming using MPEG-DASH , 2016, MMSys.

[7]  Mohammad Hosseini,et al.  Adaptive 360 VR Video Streaming: Divide and Conquer , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[8]  Jin Young Lee,et al.  MMT: An Emerging MPEG Standard for Multimedia Delivery over the Internet , 2013, IEEE MultiMedia.