Xpsnr: A Low-Complexity Extension of The Perceptually Weighted Peak Signal-To-Noise Ratio For High-Resolution Video Quality Assessment

The objective PSNR metric is known to correlate quite poorly with subjective assessments of video coding quality. Thus, a number of alternative VQA measures such as (MS-)SSIM and VMAF have been proposed. These, however, are often algorithmically complex and difficult to use for visually motivated encoder optimization tasks, especially subjectively optimized bit allocation. In this paper we show that, by way of low-complexity enhancements of our previous work on a perceptually weighted PSNR (WPSNR) metric, addressing shortcomings with video and ultra high-definition content, the prediction of human judgments of video coding quality by the WPSNR can be improved. In fact, the resulting XPSNR seems to match the performance of the aforementioned state-of-the-art methods.

[1]  Rajiv Soundararajan,et al.  Study of Subjective and Objective Quality Assessment of Video , 2010, IEEE Transactions on Image Processing.

[2]  Alan C. Bovik,et al.  Spatiotemporal Feature Integration and Model Fusion for Full Reference Video Quality Assessment , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Gary J. Sullivan,et al.  High Efficiency Video Coding (HEVC), Algorithms and Architectures , 2014, Integrated Circuits and Systems.

[4]  Pierrick Philippe,et al.  Subjective comparison of VVC and HEVC , 2019 .

[5]  D. Kerslake The stress of hot environments. , 1972, Monographs of the Physiological Society.

[6]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[7]  Jinwoo Kim,et al.  Deep Video Quality Assessor: From Spatio-Temporal Visual Sensitivity to a Convolutional Neural Aggregation Network , 2018, ECCV.

[8]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Heiko Schwarz,et al.  Perceptually Optimized Bit-Allocation and Associated Distortion Measure for Block-Based Image or Video Coding , 2019, 2019 Data Compression Conference (DCC).

[10]  Yanjiao Chen,et al.  From QoS to QoE: A Tutorial on Video Quality Assessment , 2015, IEEE Communications Surveys & Tutorials.

[11]  K. R. Rao,et al.  High Efficiency Video Coding(HEVC) , 2014 .

[12]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[13]  A. Valberg Light Vision Color , 2005 .

[14]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[15]  Rong Xie,et al.  SJTU 4K video subjective quality dataset for content adaptive bit rate estimation without encoding , 2016, 2016 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[16]  Thomas Wiegand,et al.  A Neural Network Model of Spatial Distortion Sensitivity for Video Quality Estimation , 2019, 2019 IEEE 29th International Workshop on Machine Learning for Signal Processing (MLSP).

[17]  Heiko Schwarz,et al.  Video Compression Using Generalized Binary Partitioning, Trellis Coded Quantization, Perceptually Optimized Encoding, and Advanced Prediction and Transform Coding , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Jong-Seok Lee,et al.  Subjective and Objective Quality Assessment of Compressed 4K UHD Videos for Immersive Experience , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  S. Rimac-Drlje,et al.  ECVQ and EVVQ video quality databases , 2012, Proceedings ELMAR-2012.

[20]  Heiko Schwarz,et al.  A Study of the Perceptually Weighted Peak Signal-To-Noise Ratio (WPSNR) for Image Compression , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[21]  André Kaup,et al.  Temporal Trajectory Aware Video Quality Measure , 2009, IEEE Journal of Selected Topics in Signal Processing.

[22]  Alan C. Bovik,et al.  Motion Tuned Spatio-Temporal Quality Assessment of Natural Videos , 2010, IEEE Transactions on Image Processing.