A client-based adaptation framework for 360-degree video streaming

Abstract 360-degree video is one of the key components of Virtual Reality (VR) applications. 360-degree videos viewed on Head Mounted Displays can offer impressive viewing experiences to users. Yet, streaming of 360-degree videos over the Internet is a very challenging task since it requires extremely high bandwidth. To reduce the bandwidth requirement while still providing good experiences, viewport adaptive streaming has been introduced. In this paper, we propose a client-based adaptation framework for viewport adaptive streaming of 360 videos, which can support different application scenarios. The key components and important issues are presented with a general problem formulation for tile version selection. Especially, we introduce for the first time the use of bitrate and quality estimation in viewport adaptive streaming of 360 videos. Experiments show that the proposed framework can significantly improve video quality for users. In addition, the impacts of buffering delay and projection formats in VR context are investigated.

[1]  Miska M. Hannuksela,et al.  Viewport-Adaptive Encoding and Streaming of 360-Degree Video for Virtual Reality Applications , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[2]  Anh T. Pham,et al.  Seamless Mobile Video Streaming over HTTP/2 with Gradual Quality Transitions , 2017, IEICE Trans. Commun..

[3]  Jean-François Macq,et al.  Interactive omnidirectional video delivery: A bandwidth-effective approach , 2012, Bell Labs Technical Journal.

[4]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Cheng-Hsin Hsu,et al.  Fixation Prediction for 360° Video Streaming in Head-Mounted Virtual Reality , 2017, NOSSDAV.

[6]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Yong Man Ro,et al.  Adaptive video streaming over HTTP with dynamic resource estimation , 2013, Journal of Communications and Networks.

[8]  Bernd Girod,et al.  A Framework to Evaluate Omnidirectional Video Coding Schemes , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[9]  Yong Man Ro,et al.  Multiple Region-of-Interest Support in Scalable Video Coding , 2006 .

[10]  Mohammad Hosseini,et al.  Adaptive 360 VR Video Streaming: Divide and Conquer , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[11]  Anh T. Pham,et al.  A Probabilistic Adaptation Method for HTTP Low-Delay Live Streaming over Mobile Networks , 2017, IEICE Trans. Inf. Syst..

[12]  Truong Cong Thang,et al.  Adaptation method for video streaming over HTTP/2 , 2016 .

[13]  Anh T. Pham,et al.  A Study on Quality Metrics for 360 Video Communications , 2018, IEICE Trans. Inf. Syst..

[14]  Yong Man Ro,et al.  An Evaluation of Bitrate Adaptation Methods for HTTP Live Streaming , 2014, IEEE Journal on Selected Areas in Communications.

[15]  Anh T. Pham,et al.  Adaptive streaming of audiovisual content using MPEG DASH , 2012, IEEE Transactions on Consumer Electronics.

[16]  Luigi Rizzo,et al.  Dummynet: a simple approach to the evaluation of network protocols , 1997, CCRV.