Impact of Video Streaming Delay on User Experience with Head-Mounted Displays

Delays in the delivery of immersive video to Head Mounted Devices (HMDs) are considered in the paper. The goal of this paper is to analyze the impact of video streaming latency on user experience with HMDs. The paper reports the results of the subjective quality assessment as a function of delay. The possible practical solutions are identified and, on this base, an experimental model of the considered systems is proposed. In order to properly test the influence of the streaming delay on the quality, the extensive subjective tests have been performed. Interesting conclusions have been drawn, showing that human acceptance of delay of translation of virtual point of viewing is much stronger than for delay of rotation of virtual viewing direction in immersive video. Finally, the influence of such observations on the system architectures is concluded.

[1]  Chung-Hyun Ahn,et al.  Perceived smoothness of viewpoint transition in multi-viewpoint stereoscopic displays , 2005, IS&T/SPIE Electronic Imaging.

[2]  Ahmet M. Kondoz,et al.  Predicting head trajectories in 360° virtual reality videos , 2017, 2017 International Conference on 3D Immersion (IC3D).

[3]  Yuesheng Zhu,et al.  Foreground Removal Approach for Hole Filling in 3D Video and FVV Synthesis , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Frank Steinicke,et al.  Camera Time Warp: Compensating Latency in Video See-Through Head-Mounted-Displays for Reduced Cybersickness Effects , 2018, ISMAR Adjunct.

[5]  Miska M. Hannuksela,et al.  Viewport-Adaptive Encoding and Streaming of 360-Degree Video for Virtual Reality Applications , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[6]  Xin Liu,et al.  Shooting a moving target: Motion-prediction-based transmission for 360-degree videos , 2016, 2016 IEEE International Conference on Big Data (Big Data).

[7]  Gwendal Simon,et al.  Viewport-adaptive navigable 360-degree video delivery , 2016, 2017 IEEE International Conference on Communications (ICC).

[8]  Mohammad Hosseini,et al.  Adaptive 360 VR Video Streaming Based on MPEG-DASH SRD , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[9]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[10]  Olgierd Stankiewicz,et al.  A Free-Viewpoint Television System for Horizontal Virtual Navigation , 2018, IEEE Transactions on Multimedia.

[11]  D. Runde,et al.  How to realize a natural image reproduction using stereoscopic displays with motion parallax , 2000, IEEE Trans. Circuits Syst. Video Technol..

[12]  Narciso García,et al.  QoE Analysis of Dense Multiview Video With Head-Mounted Devices , 2020, IEEE Transactions on Multimedia.

[13]  Cornelius Hellge,et al.  Delay Impact on MPEG OMAF’s Tile-Based Viewport-Dependent 360° Video Streaming , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[14]  Shuai Li,et al.  Depth Image Based View Synthesis: New Insights and Perspectives on Hole Generation and Filling , 2016, IEEE Transactions on Broadcasting.

[15]  Narciso García,et al.  Viability analysis of content preparation configurations to deliver 360VR video via MPEG-DASH technology , 2018, 2018 IEEE International Conference on Consumer Electronics (ICCE).

[16]  A. Khatiullin,et al.  FAST OCCLUSION FILLING METHOD FOR MULTIVIEW VIDEO GENERATION , 2018, 2018 - 3DTV-Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[17]  J. M. P. van Waveren,et al.  The asynchronous time warp for virtual reality on consumer hardware , 2016, VRST.