Smart Streaming of Panoramic Videos

The streaming of panoramic videos comes with a new challenge: adapting the streamed content to user attention. In this paper, by making some abstraction we study the key issues of the problem: (1) online content switching strategies, and (2) offline segmentation in preparation for adaptive streaming. Our work demonstrates how the problem depends fundamentally on user behavior, represented by user attention trajectories. Although we only relied on a typical real-world measured trajectory and two artificially generated benchmark trajectories, we point out how more knowledge of user attention can help optimize both the online and offline strategies.

[1]  Jon M. Peha,et al.  Streaming video over the Internet: approaches and directions , 2001, IEEE Trans. Circuits Syst. Video Technol..

[2]  Ravi Prakash,et al.  Adaptive 360-degree video streaming using layered video coding , 2017, 2017 IEEE Virtual Reality (VR).

[3]  Zhimin Xu,et al.  360ProbDASH: Improving QoE of 360 Video Streaming Using Tile-based HTTP Adaptive Streaming , 2017, ACM Multimedia.

[4]  Cyril Concolato,et al.  Tiled-based adaptive streaming using MPEG-DASH , 2016, MMSys.

[5]  Gwendal Simon,et al.  Optimal Set of 360-Degree Videos for Viewport-Adaptive Streaming , 2017, ACM Multimedia.

[6]  Minhua Zhou,et al.  An Overview of Tiles in HEVC , 2013, IEEE Journal of Selected Topics in Signal Processing.

[7]  Thomas Stockhammer,et al.  Dynamic adaptive streaming over HTTP --: standards and design principles , 2011, MMSys.

[8]  Ramesh K. Sitaraman,et al.  BOLA: Near-Optimal Bitrate Adaptation for Online Videos , 2016, IEEE/ACM Transactions on Networking.

[9]  Filip De Turck,et al.  An HTTP/2-Based Adaptive Streaming Framework for 360° Virtual Reality Videos , 2017, ACM Multimedia.

[10]  Zhenhua Li,et al.  A Measurement Study of Oculus 360 Degree Video Streaming , 2017, MMSys.

[11]  Te-Yuan Huang,et al.  A buffer-based approach to rate adaptation: evidence from a large video streaming service , 2015, SIGCOMM 2015.

[12]  Hongzi Mao,et al.  Neural Adaptive Video Streaming with Pensieve , 2017, SIGCOMM.

[13]  Miska M. Hannuksela,et al.  HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications , 2016, ACM Multimedia.

[14]  Songqing Chen,et al.  OpTile: Toward Optimal Tiling in 360-degree Video Streaming , 2017, ACM Multimedia.

[15]  Bruno Sinopoli,et al.  A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP , 2015, Comput. Commun. Rev..

[16]  Feng Qian,et al.  A Rate Adaptation Algorithm for Tile-based 360-degree Video Streaming , 2017, ArXiv.