Modeling the perceptual distortion of dynamic textures and its application in HEVC

In the quest of perceptually optimized video coding, coding textures is representing a challenging case. While a large body of research was put into the perception of static textures, dynamic textures are still not sufficiently explored. In this paper, we focus on short term consistent patches, known as dynamic textures, with a very limited spatial and temporal extent. We estimated the visual distortion due to HEVC compression via subjective testing. The estimated distortion profile per texture was used to optimize the HEVC coding process. Experimental results showed that this technique can offer a high bitrate saving for the same subjective quality.

[1]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[2]  Sheila S. Hemami,et al.  Parametric quality assessment of synthesized textures , 2011, Electronic Imaging.

[3]  Touradj Ebrahimi,et al.  Perceptual Video Compression: A Survey , 2012, IEEE Journal of Selected Topics in Signal Processing.

[4]  OhmJens-Rainer,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012 .

[5]  P. Callet,et al.  PERFORMANCE ANALYSIS OF TEXTURE SIMILARITY METRICS IN HEVC INTRA PREDICTION , 2015 .

[6]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[7]  Kenneth Knoblauch,et al.  MLDS: Maximum Likelihood Difference Scaling in R , 2008 .

[8]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[9]  Laurence T Maloney,et al.  Maximum likelihood difference scaling. , 2003, Journal of vision.

[10]  Vincent Ricordel,et al.  Local texture synthesis: A static texture coding algorithm fully compatible with HEVC , 2015, 2015 International Conference on Systems, Signals and Image Processing (IWSSIP).

[11]  Weisi Lin,et al.  Perceptual Visual Signal Compression and Transmission , 2013, Proceedings of the IEEE.

[12]  David L. Neuhoff,et al.  Matched-texture coding for structurally lossless compression , 2012, 2012 19th IEEE International Conference on Image Processing.

[13]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[15]  Lina J. Karam,et al.  On the assessment of the quality of textures in visual media , 2010, 2010 44th Annual Conference on Information Sciences and Systems (CISS).

[16]  Mark J. Huiskes,et al.  DynTex: A comprehensive database of dynamic textures , 2010, Pattern Recognit. Lett..

[17]  Jens-Rainer Ohm,et al.  Models for Static and Dynamic Texture Synthesis in Image and Video Compression , 2011, IEEE Journal of Selected Topics in Signal Processing.

[18]  Kurt Hornik,et al.  Text Mining Infrastructure in R , 2008 .

[19]  Fan Zhang,et al.  A video texture database for perceptual compression and quality assessment , 2015, 2015 IEEE International Conference on Image Processing (ICIP).