A Fast FoV-Switching DASH System Based on Tiling Mechanism for Practical Omnidirectional Video Services

With the development of multimedia technologies and virtual reality display devices, omnidirectional videos have gained popularity nowadays. To reduce the bandwidth requirement for omnidirectional video transmission, tile-based viewport adaptive streaming methods have been proposed in the literatures. Challenges related to decoding the tiles simultaneously with limited number of decoders, and ensuring user's viewing experience during the viewport switch are still to be solved. In this paper, a two-layer fast viewport switching dynamic adaptive streaming over HTTP (DASH) system based on tiling mechanism is proposed, which incorporates the viewing trajectory of end users. To deal with the simultaneously decoding problem, an open group of picture (GOP) technique is proposed to enable merging different types of tiles into a composite stream at the client side. To reduce the quality recovery duration after the viewport change, a fast-switching strategy is also proposed. Moreover, considering the priorities of different types of chunks, a download strategy is further proposed to adapt the bandwidth fluctuations and viewport changes. Experimental results showed that the proposed system can significantly reduce the recovery duration of high quality video by approximately 90%, which can provide a better viewing experience to end users.

[1]  Mohammad Hosseini,et al.  View-aware tile-based adaptations in 360 virtual reality video streaming , 2017, 2017 IEEE Virtual Reality (VR).

[2]  Miska M. Hannuksela,et al.  Viewport-Adaptive Encoding and Streaming of 360-Degree Video for Virtual Reality Applications , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[3]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Feng Li,et al.  Rubiks: Practical 360-Degree Streaming for Smartphones , 2018, MobiSys.

[5]  Bong-Seok Seo,et al.  Internet of Things (IoT) for Seamless Virtual Reality Space: Challenges and Perspectives , 2018, IEEE Access.

[6]  Yong Man Ro,et al.  An Evaluation of Bitrate Adaptation Methods for HTTP Live Streaming , 2014, IEEE Journal on Selected Areas in Communications.

[7]  Cornelius Hellge,et al.  Random access point period optimization for viewport adaptive tile based streaming of 360° video , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[8]  Sujit Dey,et al.  Predictive View Generation to Enable Mobile 360-degree and VR Experiences , 2018, VR/AR Network@SIGCOMM.

[9]  Anh T. Pham,et al.  Adaptive streaming of audiovisual content using MPEG DASH , 2012, IEEE Transactions on Consumer Electronics.

[10]  Gwendal Simon,et al.  Viewport-adaptive navigable 360-degree video delivery , 2016, 2017 IEEE International Conference on Communications (ICC).

[11]  Zhenhua Li,et al.  A Measurement Study of Oculus 360 Degree Video Streaming , 2017, MMSys.

[12]  Yong Liu,et al.  View direction and bandwidth adaptive 360 degree video streaming using a two-tier system , 2017, 2017 IEEE International Symposium on Circuits and Systems (ISCAS).

[13]  Zhimin Xu,et al.  360ProbDASH: Improving QoE of 360 Video Streaming Using Tile-based HTTP Adaptive Streaming , 2017, ACM Multimedia.

[14]  Cyril Concolato,et al.  Tiled-based adaptive streaming using MPEG-DASH , 2016, MMSys.

[15]  Luigi Rizzo,et al.  Dummynet: a simple approach to the evaluation of network protocols , 1997, CCRV.

[16]  Bernd Girod,et al.  Content Adaptive Representations of Omnidirectional Videos for Cinematic Virtual Reality , 2015, ImmersiveME@ACM Multimedia.

[17]  Thomas Stockhammer,et al.  Dynamic adaptive streaming over HTTP --: standards and design principles , 2011, MMSys.

[18]  Truong Cong Thang,et al.  An adaptive streaming method of 360 videos over HTTP/2 protocol , 2017, 2017 4th NAFOSTED Conference on Information and Computer Science.

[19]  Mohammad Hosseini,et al.  Adaptive 360 VR Video Streaming: Divide and Conquer , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[20]  Dongho You,et al.  MPEG-DASH MPD for Tile-based Hybrid Stereoscopic 360-degree Video Streaming , 2018, 2018 Tenth International Conference on Ubiquitous and Future Networks (ICUFN).

[21]  Hwangjun Song,et al.  An Energy-Efficient HTTP Adaptive Video Streaming With Networking Cost Constraint Over Heterogeneous Wireless Networks , 2015, IEEE Transactions on Multimedia.

[22]  Zhenhua Li,et al.  On the Effectiveness of Offset Projections for 360-Degree Video Streaming , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[23]  Yong Liu,et al.  Towards Agile and Smooth Video Adaptation in HTTP Adaptive Streaming , 2016, IEEE/ACM Transactions on Networking.

[24]  Cisco Visual Networking Index: Forecast and Methodology 2016-2021.(2017) http://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual- networking-index-vni/complete-white-paper-c11-481360.html. High Efficiency Video Coding (HEVC) Algorithms and Architectures https://jvet.hhi.fraunhofer. , 2017 .

[25]  Will Reese,et al.  Nginx: the high-performance web server and reverse proxy , 2008 .

[26]  Cyril Concolato,et al.  MPEG DASH SRD: spatial relationship description , 2016, MMSys.

[27]  Filip De Turck,et al.  HTTP/2-Based Adaptive Streaming of HEVC Video Over 4G/LTE Networks , 2016, IEEE Communications Letters.

[28]  Sándor Molnár,et al.  On the effect of the background traffic on TCP's throughput , 2005, 10th IEEE Symposium on Computers and Communications (ISCC'05).

[29]  Christian Timmerer,et al.  Towards Bandwidth Efficient Adaptive Streaming of Omnidirectional Video over HTTP: Design, Implementation, and Evaluation , 2017, MMSys.

[30]  Michael Riegler,et al.  Tiling in Interactive Panoramic Video: Approaches and Evaluation , 2016, IEEE Transactions on Multimedia.

[31]  Miska M. Hannuksela,et al.  HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications , 2016, ACM Multimedia.

[32]  Hideaki Kimata,et al.  Interactive panoramic video streaming system over restricted bandwidth network , 2010, ACM Multimedia.

[33]  Afshin Taghavi Nasrabadi,et al.  Adaptive 360-Degree Video Streaming using Scalable Video Coding , 2017, ACM Multimedia.

[34]  Filip De Turck,et al.  An HTTP/2-Based Adaptive Streaming Framework for 360° Virtual Reality Videos , 2017, ACM Multimedia.

[35]  Daniel Stenberg HTTP2 explained , 2014, CCRV.

[36]  Wenjie Zhang,et al.  Region-of-interest streaming based on improved MCTS for high-definition panoramic videos , 2017, 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS).

[37]  Cheng-Hsin Hsu,et al.  360° Video Viewing Dataset in Head-Mounted Virtual Reality , 2017, MMSys.

[38]  Yong Liu,et al.  Multi-path multi-tier 360-degree video streaming in 5G networks , 2018, MMSys.

[39]  Christopher Bulla,et al.  Efficient Stream-Reassembling for Video Conferencing Applications using Tiles in HEVC , 2013, International Conference on Advances in Multimedia.

[40]  Feng Qian,et al.  Optimizing 360 video delivery over cellular networks , 2016, ATC@MobiCom.

[41]  Christian Timmerer,et al.  Statistically Indifferent Quality Variation: An Approach for Reducing Multimedia Distribution Cost for Adaptive Video Streaming Services , 2017, IEEE Transactions on Multimedia.

[42]  Lin Zhang,et al.  Cooperative Tile-Based 360° Panoramic Streaming in Heterogeneous Networks Using Scalable Video Coding , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Cornelius Hellge,et al.  Tile Based HEVC Video for Head Mounted Displays , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[44]  Martin Thomson,et al.  Hypertext Transfer Protocol Version 2 (HTTP/2) , 2015, RFC.