Methodology for accurately assessing the quality perceived by users on 360VR contents

To properly evaluate the performance of 360VR-specific encoding and transmission schemes, and particularly of the solutions based on viewport adaptation, it is necessary to consider not only the bandwidth saved, but also the quality of the portion of the scene actually seen by users over time. With this motivation, we propose a robust, yet flexible methodology for accurately assessing the quality within the viewport along the visualization session. This procedure is based on a complete analysis of the geometric relations involved. Moreover, the designed methodology allows for both offline and online usage thanks to the use of different approximations. In this way, our methodology can be used regardless of the approach to properly evaluate the implemented strategy, obtaining a fairer comparison between them.

[1]  Thomas Stockhammer,et al.  360-Degree Video Streaming with MPEG-DASH , 2018 .

[2]  Cheng-Hsin Hsu,et al.  360° Video Viewing Dataset in Head-Mounted Virtual Reality , 2017, MMSys.

[3]  Wesley De Neve,et al.  Flexible macroblock ordering in H.264/AVC , 2006, J. Vis. Commun. Image Represent..

[4]  Guangtao Zhai,et al.  The Prediction of Saliency Map for Head and Eye Movements in 360 Degree Images , 2020, IEEE Transactions on Multimedia.

[5]  Christian Timmerer,et al.  A Survey on Bitrate Adaptation Schemes for Streaming Media Over HTTP , 2019, IEEE Communications Surveys & Tutorials.

[6]  Zhan Ma,et al.  Modeling the Perceptual Impact of Viewport Adaptation for Immersive Video , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[7]  Christian Timmerer,et al.  Adaptive Streaming of VR / 360-degree Immersive Media Services with high QoE , 2017 .

[8]  Narciso García,et al.  Video Multimethod Assessment Fusion (VMAF) on 360VR Contents , 2019, IEEE Transactions on Consumer Electronics.

[9]  Muhammad Imran,et al.  Quality of Experience for a Virtual Reality simulator , 2018, HVEI.

[10]  Mohammad Hosseini,et al.  View-aware tile-based adaptations in 360 virtual reality video streaming , 2017, 2017 IEEE Virtual Reality (VR).

[11]  Hao Jiang,et al.  Scalable Video Coding Based on User's View for Real-Time Virtual Reality Applications , 2018, IEEE Commun. Lett..

[12]  Yiming Li,et al.  Recent advances in omnidirectional video coding for virtual reality: Projection and evaluation , 2018, Signal Process..

[13]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[14]  Patrick Le Callet,et al.  A Dataset of Head and Eye Movements for 360 Degree Images , 2017, MMSys.

[15]  Michela Ott,et al.  A LITERATURE REVIEW ON IMMERSIVE VIRTUAL REALITY IN EDUCATION: STATE OF THE ART AND PERSPECTIVES. , 2015, 11th International Conference eLearning and Software for Education.

[16]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Miska M. Hannuksela,et al.  Viewport-dependent delivery schemes for stereoscopic panoramic video , 2017, 2017 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video (3DTV-CON).

[18]  Filip De Turck,et al.  An HTTP/2-Based Adaptive Streaming Framework for 360° Virtual Reality Videos , 2017, ACM Multimedia.

[19]  Luciano Bononi,et al.  Dynamic segment size selection in HTTP based adaptive video streaming , 2017, 2017 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[20]  Robert S. Allison,et al.  Perspectives on the definition of visually lossless quality for mobile and large format displays , 2018, J. Electronic Imaging.

[21]  Antoine Coutrot,et al.  A dataset of head and eye movements for 360° videos , 2018, MMSys.

[22]  Touradj Ebrahimi,et al.  On the performance of objective metrics for omnidirectional visual content , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[23]  Jinsil Hwaryoung Seo,et al.  Anatomy builder VR: Applying a constructive learning method in the virtual reality canine skeletal system , 2017, 2017 IEEE Virtual Reality (VR).

[24]  Narciso García,et al.  Viability analysis of content preparation configurations to deliver 360VR video via MPEG-DASH technology , 2018, 2018 IEEE International Conference on Consumer Electronics (ICCE).

[25]  Xiongkuo Min,et al.  The prediction of head and eye movement for 360 degree images , 2018, Signal Process. Image Commun..

[26]  Miska M. Hannuksela,et al.  HEVC-compliant Tile-based Streaming of Panoramic Video for Virtual Reality Applications , 2016, ACM Multimedia.

[27]  Mohamed Hefeeda,et al.  Streaming Virtual Reality Content , 2016, ArXiv.

[28]  Cornelius Hellge,et al.  Shifted IDR Representations for Low Delay Live DASH Streaming Using HEVC Tiles , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[29]  Aljoscha Smolic,et al.  Viewport-aware adaptive 360° video streaming using tiles for virtual reality , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[30]  Wojciech Samek,et al.  Quality perception of advanced multimedia systems , 2019, Digit. Signal Process..

[31]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[32]  Gwendal Simon,et al.  Viewport-adaptive navigable 360-degree video delivery , 2016, 2017 IEEE International Conference on Communications (ICC).

[33]  Pascal Frossard,et al.  Visual Distortions in 360-degree Videos , 2019, ArXiv.

[34]  Ran Ma,et al.  Scalable Omnidirectional Video Coding for Real-Time Virtual Reality Applications , 2018, IEEE Access.