Rate-distortion optimised quantisation for HEVC using spatial just noticeable distortion

Due to the higher requirements associated with Ultra High Definition (UHD) resolutions in terms of memory and transmission bandwidth, the feasibility of UHD video communication applications is strongly dependent on the performance of video compression solutions. Even though the High Efficiency Video Coding (HEVC) standard allows significantly superior rate-distortion performances compared to previous video coding standards, further performance improvements are possible when exploiting the perceptual properties of the Human Visual System (HVS). This paper proposes a novel perceptual-based solution fully compliant with the HEVC standard, where a low complexity Just Noticeable Distortion model is used to drive the encoder's rate-distortion optimised quantisation process. This technique allows a simple and effective way to influence the decisions made at the encoder, based on the limitations of the HVS. The experiments conducted for UHD resolutions show average bitrate savings of 21% with no visual quality degradations when compared to the HEVC reference software.

[1]  Jun Sun,et al.  Rate-distortion Optimized Trellis-Coded Quantization , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[2]  King Ngi Ngan,et al.  Spatio-Temporal Just Noticeable Distortion Profile for Grey Scale Image/Video in DCT Domain , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  King Ngi Ngan,et al.  Enhancing compression rate by just-noticeable distortion model for H.264/AVC , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[4]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Andrew B. Watson,et al.  DCTune: A TECHNIQUE FOR VISUAL OPTIMIZATION OF DCT QUANTIZATION MATRICES FOR INDIVIDUAL IMAGES. , 1993 .

[6]  Margaret H. Pinson,et al.  A new standardized method for objectively measuring video quality , 2004, IEEE Transactions on Broadcasting.

[7]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[8]  Munchurl Kim,et al.  A Novel Generalized DCT-Based JND Profile Based on an Elaborate CM-JND Model for Variable Block-Sized Transforms in Monochrome Images , 2014, IEEE Transactions on Image Processing.

[9]  Sung-Ho Bae,et al.  An HEVC-Compliant Perceptual Video Coding Scheme Based on JND Models for Variable Block-Sized Transform Kernels , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Geoffrey M. Boynton,et al.  New model of human luminance pattern vision mechanisms: analysis of the effects of pattern orientation, spatial phase, and temporal frequency , 1994, Other Conferences.

[11]  Weisi Lin,et al.  Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile , 2005, IEEE Trans. Circuits Syst. Video Technol..

[12]  Heidi A. Peterson,et al.  Luminance-model-based DCT quantization for color image compression , 1992, Electronic Imaging.

[13]  Marta Mrak,et al.  Intensity dependent spatial quantization with application in HEVC , 2013, 2013 IEEE International Conference on Multimedia and Expo (ICME).

[14]  Fernando Pereira,et al.  Integrating a spatial just noticeable distortion model in the under development HEVC codec , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Fernando Pereira,et al.  Advanced H.264/AVC-Based Perceptual Video Coding: Architecture, Tools, and Assessment , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  A. Watson,et al.  A standard model for foveal detection of spatial contrast. , 2005, Journal of vision.

[17]  Christine Guillemot,et al.  Perceptually-friendly H.264/AVC video coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[18]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.