Joint perceptually-based Intra prediction and quantization for HEVC

This paper proposes a new coding scheme which jointly applies perceptual quality metrics to prediction, quantization and rate-distortion optimization (RDO) within the High Efficiency Video Coding (HEVC) framework. A new prediction approach which uses template matching is introduced. The template matching uses a structural similarity metric (SSIM) and a Just-Noticeable Distortion (JND) model. The matched candidates are linearly filtered to generate a prediction. We also modify the JND model and use Supra-threshold Distortion (StD) as the distortion measurement in RDO. Experimental results showing improvements for coding textured areas are presented as well.

[1]  William B. Pennebaker,et al.  Quantization of color image components in the DCT domain , 1991, Electronic Imaging.

[2]  Lina J. Karam,et al.  Adaptive image coding with perceptual distortion control , 2002, IEEE Trans. Image Process..

[3]  David L. Neuhoff,et al.  Structural similarity metrics for texture analysis and retrieval , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[4]  David L. Neuhoff,et al.  Matched-texture coding for structurally lossless compression , 2012, 2012 19th IEEE International Conference on Image Processing.

[5]  David S. Taubman,et al.  Perceptual Optimization for Scalable Video Compression Based on Visual Masking Principles , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Heidi A. Peterson,et al.  Luminance-model-based DCT quantization for color image compression , 1992, Electronic Imaging.

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  M. A. Bouman,et al.  Spatial Modulation Transfer in the Human Eye , 1967 .

[9]  Christine Guillemot,et al.  Perceptually-friendly H.264/AVC video coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[10]  Weisi Lin,et al.  Estimating Just-Noticeable Distortion for Video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Thrasyvoulos N. Pappas,et al.  Perceptual criteria for image quality evaluation , 2005 .

[12]  Guangming Shi,et al.  Intra frame coding with template matching prediction and adaptive transform , 2010, 2010 IEEE International Conference on Image Processing.

[13]  Kuo-Cheng Liu.  Prediction error preprocessing for perceptual color image compression , 2012, EURASIP J. Image Video Process..

[14]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..

[15]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[16]  King Ngi Ngan,et al.  Spatio-Temporal Just Noticeable Distortion Profile for Grey Scale Image/Video in DCT Domain , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Zhou Wang,et al.  Video quality assessment using a statistical model of human visual speed perception. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  Zhou Wang,et al.  Foveation scalable video coding with automatic fixation selection , 2003, IEEE Trans. Image Process..

[19]  Mehmet Türkan,et al.  Spatial intra-prediction based on mixtures of sparse representations , 2010, 2010 IEEE International Workshop on Multimedia Signal Processing.

[20]  H. Bastian.  Sensation and Perception.—I , 1869, Nature.

[21]  R. J. Safranek,et al.  A perceptually tuned sub-band image coder with image dependent quantization and post-quantization data compression , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[22]  Fernando Pereira,et al.  Advanced H.264/AVC-Based Perceptual Video Coding: Architecture, Tools, and Assessment , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Wenjun Zeng,et al.  An overview of the visual optimization tools in JPEG 2000 , 2002, Signal Process. Image Commun..

[24]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[25]  Y. Morikawa,et al.  Lossless image coding based on minimum mean absolute error predictors , 2007, SICE Annual Conference 2007.

[26]  Andrew B. Watson,et al.  Visually optimal DCT quantization matrices for individual images , 1993, [Proceedings] DCC `93: Data Compression Conference.

[27]  J A Solomon,et al.  Model of visual contrast gain control and pattern masking. , 1997, Journal of the Optical Society of America. A, Optics, image science, and vision.

[28]  Weisi Lin,et al.  Improved estimation for just-noticeable visual distortion , 2005, Signal Process..

[29]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[30]  Zhen Liu,et al.  JPEG2000 encoding with perceptual distortion control , 2006, IEEE Transactions on Image Processing.

[31]  Fernando Pereira,et al.  Comparing spatial masking modelling in just noticeable distortion controlled H.264/AVC video coding , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[32]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[33]  Weisi Lin,et al.  Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile , 2005, IEEE Trans. Circuits Syst. Video Technol..

[34]  J. Robson.  Spatial and Temporal Contrast-Sensitivity Functions of the Visual System , 1966 .

[35]  Geoffrey M. Boynton,et al.  New model of human luminance pattern vision mechanisms: analysis of the effects of pattern orientation, spatial phase, and temporal frequency , 1994, Other Conferences.

[36]  Wen Gao,et al.  SSIM-Motivated Rate-Distortion Optimization for Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  Lina J. Karam,et al.  APIC: adaptive perceptual image coding based on subband decomposition with locally adaptive perceptual weighting , 1997, Proceedings of International Conference on Image Processing.

[38]  Weisi Lin,et al.  Perceptual multiview video coding using synthesized Just Noticeable Distortion maps , 2011, 2011 IEEE International Symposium of Circuits and Systems (ISCAS).

[39]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.