Scalable Video Coding for Backward-Compatible 360° Video Delivery Over Broadcast Networks

Recently, the coding and transmission of immersive 360° video has been intensely studied. The technologies provided by standards developing organizations mainly address requirements coming from over-the-top services. The terrestrial broadcast remains in many countries the mainstream medium to deliver high quality contents to a wide audience. To enable seamless introduction of immersive 360° video services over terrestrial broadcast, the deployed technologies shall fulfill requirements such as backward compatibility to legacy receivers and high bandwidth efficiency. While bandwidth efficiency is addressed by existing techniques, none of them enables legacy video services decoding. In this paper, a novel scalable coding scheme is proposed to enable immersive 360° video services introduction over broadcast networks. The experiments show that the proposed scalable coding scheme provides substantial coding gains of 14.99% compared to simulcast coding and introduces a limited coding overhead of 5.15% compared to 360° single-layer coding. A real-time decoding implementation is proposed, highlighting the relevance of the proposed design. Eventually, an end-to-end demonstrator illustrates how the proposed solution could be integrated in a real terrestrial broadcast environment.

[1]  Yiming Li,et al.  Spherical domain rate-distortion optimization for 360-degree video coding , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[2]  Yan Ye,et al.  Geometry Padding for Motion Compensated Prediction in 360 Video Coding , 2017, 2017 Data Compression Conference (DCC).

[3]  Madhukar Budagavi,et al.  360 degrees video coding using region adaptive smoothing , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[4]  Zhu Li,et al.  Co-projection-plane based 3-D padding for polyhedron projection for 360-degree video , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[5]  Mohammad Hosseini,et al.  View-aware tile-based adaptations in 360 virtual reality video streaming , 2017, 2017 IEEE Virtual Reality (VR).

[6]  Ying Chen,et al.  Overview of the Multiview and 3D Extensions of High Efficiency Video Coding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Jean Le Feuvre,et al.  A Test Bed for Hybrid Broadcast Broadband Services , 2015 .

[8]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Olivier Déforges,et al.  Real-time and parallel SHVC hybrid codec AVC to HEVC decoder , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[10]  Mohammad Hosseini,et al.  Adaptive 360 VR Video Streaming Based on MPEG-DASH SRD , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[11]  Shaowei Xie,et al.  Dynamic VR live streaming over MMT , 2017, 2017 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[12]  Cyril Concolato,et al.  GPAC: open source multimedia framework , 2007, ACM Multimedia.

[13]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[14]  Jill Boyce MPEG-I Future Directions , 2018 .

[15]  Miska M. Hannuksela,et al.  Standard-Compliant Multiview Video Coding and Streaming for Virtual Reality Applications , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[16]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[17]  Ying Chen,et al.  Standardized Extensions of High Efficiency Video Coding (HEVC) , 2013, IEEE Journal of Selected Topics in Signal Processing.

[18]  Miska M. Hannuksela,et al.  Efficient Coding of 360-Degree Pseudo-Cylindrical Panoramic Video for Virtual Reality Applications , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[19]  Mickaël Raulet,et al.  4K Real-Time and Parallel Software Video Decoder for Multilayer HEVC Extensions , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Jianle Chen,et al.  Overview of SHVC: Scalable Extensions of the High Efficiency Video Coding Standard , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Youngkwon Lim,et al.  Delivery of ATSC 3.0 Services With MPEG Media Transport Standard Considering Redistribution in MPEG-2 TS Format , 2016, IEEE Transactions on Broadcasting.