Perceptual quantization matrices for high dynamic range H.265/MPEG-HEVC video coding

In this work, perceptual quantization matrices for high-resolution High Dynamic Range (HDR) video coding have been developed for optimizing perceived visual quality and for reducing video transmission bit-rate, further making a special emphasis on the Ultra High Definition (UltraHD) resolution and H.265/MPEG-HEVC video coding standard. According to the proposed coding scheme, perceptual quantization matrices are first calculated according to Human Visual System (HVS) characteristics and based on predefined viewing conditions, and then utilized during the encoding loop for removing non-perceptible visual information. The above-mentioned predefined conditions include, for example, a target HDR display resolution and a variety of display characteristics, such as a distance between a user and display, luminance levels, and many others. According to the detailed experimental results presented in this work, visual quality of the UltraHD HDR video sequences is significantly improved, for substantially the same bit-rate, in terms of both SSIMPlus and PSNR objective quality metrics. On the other hand, the video transmission bit-rate is reduced by up 11.3% and 2.4%, respectively, while keeping the visual quality at substantially the same level.

[1]  C. Furmanski,et al.  An oblique effect in human primary visual cortex , 2000, Nature Neuroscience.

[2]  King Ngi Ngan,et al.  Adaptive cosine transform coding of images in perceptual domain , 1989, IEEE Trans. Acoust. Speech Signal Process..

[3]  Detlev Marpe,et al.  Coding efficiency comparison of AV1/VP9, H.265/MPEG-HEVC, and H.264/MPEG-AVC encoders , 2016, 2016 Picture Coding Symposium (PCS).

[4]  Peter G. J. Barten,et al.  Formula for the contrast sensitivity of the human eye , 2003, IS&T/SPIE Electronic Imaging.

[5]  Di Yuan,et al.  Visual JND: A Perceptual Measurement in Video Coding , 2019, IEEE Access.

[6]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Xinfeng Zhang,et al.  Perceptual Video Coding Based on Visual Saliency Modulated Just Noticeable Distortion , 2019, 2019 Data Compression Conference (DCC).

[8]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[9]  Rodney L. Miller,et al.  Design of minimum visual modulation halftone patterns , 1991, IEEE Trans. Syst. Man Cybern..

[10]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[11]  Scott J. Daly A visual model for optimizing the design of image processing algorithms , 1994, Proceedings of 1st International Conference on Image Processing.

[12]  Timo Kunkel,et al.  Preference limits of the visual dynamic range for ultra high quality and aesthetic conveyance , 2013, Electronic Imaging.

[13]  Hye-Yeon Cheong,et al.  Adaptive spatio-temporal filtering for video denoising , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[14]  Victor Sanchez,et al.  Adaptive Quantization Matrices for HD and UHD Resolutions in Scalable HEVC , 2016, 2016 Data Compression Conference (DCC).

[15]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Jie Liang,et al.  Weighting Quantization Matrices for HEVC/H.265-Coded RGB Videos , 2019, IEEE Access.