Voronoi-based Objective Quality Metrics for Omnidirectional Video

Omnidirectional video (ODV) represents one of the latest and most promising trends in immersive media. The success of ODV depends on the ability to deliver high-quality ODV to the viewers. For this reason, new methods are needed to measure ODV quality that takes into account the interactive look around nature and the spherical representation of ODV. In this paper, we study full-reference objective quality metrics for ODV based on typical encoding distortions in adaptive streaming systems, namely, scaling and compression. The contribution of this paper is three-fold. First, we propose new objective metrics that take into account the unique aspects of ODV. The proposed metrics are based on the subdivision of a given ODV into multiple patches using the spherical Voronoi diagram. Second, we introduce a new dataset of 75 impaired ODVs with different resolutions and compression levels, together with the subjective quality scores gathered during an experiment with 21 participants. Third, we evaluate the proposed Voronoi-based objective metrics using our dataset. The evaluation of the proposed objective metrics and the comparison with existing metrics show that the proposed metrics achieve a better correlation with the subjective scores. The ODV dataset together with the subjective quality scores and the code of the proposed quality metrics are available with this paper.

[1]  Lu Yu,et al.  Weighted-to-Spherically-Uniform Quality Evaluation for Omnidirectional Video , 2017, IEEE Signal Processing Letters.

[2]  Touradj Ebrahimi,et al.  Testbed for subjective evaluation of omnidirectional visual content , 2016, 2016 Picture Coding Symposium (PCS).

[3]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[4]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[5]  Aljoscha Smolic,et al.  Visual Attention in Omnidirectional Video for Virtual Reality Applications , 2018, 2018 Tenth International Conference on Quality of Multimedia Experience (QoMEX).

[6]  Sebastian Möller,et al.  An Evaluation of Video Quality Assessment Metrics for Passive Gaming Video Streaming , 2018, PV@MMSys.

[7]  Wei Sun,et al.  A Large-Scale Compressed 360-Degree Spherical Image Database: From Subjective Quality Evaluation to Objective Model Comparison , 2018, 2018 IEEE 20th International Workshop on Multimedia Signal Processing (MMSP).

[8]  Bernd Girod,et al.  A Framework to Evaluate Omnidirectional Video Coding Schemes , 2015, 2015 IEEE International Symposium on Mixed and Augmented Reality.

[9]  Truong Cong Thang,et al.  An evaluation of quality metrics for 360 videos , 2017, 2017 Ninth International Conference on Ubiquitous and Future Networks (ICUFN).

[10]  Aljoscha Smolic,et al.  A framework for quality control in cinematic VR based on Voronoi patches and saliency , 2017, 2017 International Conference on 3D Immersion (IC3D).

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Zulin Wang,et al.  Assessing Visual Quality of Omnidirectional Videos , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Zhenzhong Chen,et al.  Subjective Panoramic Video Quality Assessment Database for Coding Applications , 2018, IEEE Transactions on Broadcasting.

[14]  Touradj Ebrahimi,et al.  On the performance of objective metrics for omnidirectional visual content , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[15]  Vladyslav Zakharchenko,et al.  Quality metric for spherical panoramic video , 2016, Optical Engineering + Applications.

[16]  Cagri Ozcinar,et al.  Visual Attention-Aware Omnidirectional Video Streaming Using Optimal Tiles for Virtual Reality , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.