Visual saliency aided High Dynamic Range (HDR) video quality metrics

As High Dynamic Range (HDR) video is emerging as the next revolution in digital entertainment, finding effective ways for measuring its visual quality is of paramount importance. In this paper, we utilize the saliency information derived from an HDR Visual Attention Model (VAM), called LBVS-HDR, for assessing the quality of HDR video content. To this end, this saliency information is incorporated into existing state-of-the-art HDR quality metrics such as the HDR-VDP-2, deltaE2000, mPSNR, and tPSNR as well as the Standard Dynamic Range (SDR) benchmark quality metric, PSNR. The Visual Information Fidelity (VIF) index is also included in our comparisons, as it is reported to perform well for HDR content. Comparing the results of the VAM-aided quality metrics with those of the original ones, we verified that, in general, using saliency prediction for HDR quality assessment improves the performance of all the existing quality metrics. We also observed that the VIF index achieves the highest correlation between the objective and subjective test results.

[1]  Panos Nasiopoulos,et al.  ISO/IEC JTC1/SC29/WG11 MPEG2014/ m34661: Quality Assessment of High Dynamic Range (HDR) Video Content Using Existing Full-Reference Metrics , 2018 .

[2]  Wolfgang Heidrich,et al.  HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions , 2011, SIGGRAPH 2011.

[3]  Panos Nasiopoulos,et al.  Compression of high dynamic range video using the HEVC and H.264/AVC standards , 2014, 10th International Conference on Heterogeneous Networking for Quality, Reliability, Security and Robustness.

[4]  Panos Nasiopoulos,et al.  Demystifying High-Dynamic-Range Technology: A new evolution in digital media. , 2015, IEEE Consumer Electronics Magazine.

[5]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[6]  James A. Ferwerda,et al.  Elements of Early Vision for Computer Graphics (Tutorial) , 2001, IEEE Computer Graphics and Applications.

[7]  Touradj Ebrahimi,et al.  Towards high dynamic range extensions of HEVC: subjective evaluation of potential coding technologies , 2015, SPIE Optical Engineering + Applications.

[8]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[9]  Panos Nasiopoulos,et al.  Evaluating the Performance of Existing Full-Reference Quality Metrics on High Dynamic Range (HDR) Video Content , 2018, 1803.04815.

[10]  Panos Nasiopoulos,et al.  A learning-based visual saliency fusion model for High Dynamic Range video (LBVS-HDR) , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[11]  F. Kainz,et al.  The OpenEXR image file format , 2004 .

[12]  Hans-Peter Seidel,et al.  Extending quality metrics to full luminance range images , 2008, Electronic Imaging.

[13]  Gregory Ward Larson,et al.  LogLuv Encoding for Full-Gamut, High-Dynamic Range Images , 1998, J. Graphics, GPU, & Game Tools.

[14]  Tomas Akenine-Möller,et al.  High dynamic range texture compression for graphics hardware , 2006, SIGGRAPH 2006.

[15]  Touradj Ebrahimi,et al.  [ISO/IEC MPEG contribution] Correlation of subjective scores and objective metrics for HDR video quality assessment , 2014 .

[16]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..