Texture analysis and synthesis using steerable pyramid decomposition for video coding

Natural textures like grass, water, sand etc. contain large amount of visual details that consume a lot of bitrate while compressing it, but in fact such details are irrelevant for the human vision. Therefore, exploiting human perception properties could provide better compression of such data. In this paper we propose two novel schemes for identifying and processing static and dynamic textures based on 2D Dual Tree Complex Wavelet Transform and Steerable Pyramid Transform. The use of Steerable Filters is motivated by the fact that the frequency and directional selectivity of the Human Visual System can be well modelled by the Steerable Filters.

[1]  Yanxi Liu,et al.  A comparison study of four texture synthesis algorithms on near-regular textures , 2004, SIGGRAPH '04.

[2]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[3]  Jens-Rainer Ohm,et al.  Models for Static and Dynamic Texture Synthesis in Image and Video Compression , 2011, IEEE Journal of Selected Topics in Signal Processing.

[4]  Zhou Wang,et al.  Local Phase Coherence and the Perception of Blur , 2003, NIPS.

[5]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[6]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[7]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[8]  Vincent Ricordel,et al.  Experimenting texture similarity metric STSIM for intra prediction mode selection and block partitioning in HEVC , 2014, 2014 19th International Conference on Digital Signal Processing.

[9]  Fan Zhang,et al.  A Parametric Framework for Video Compression Using Region-Based Texture Models , 2011, IEEE Journal of Selected Topics in Signal Processing.

[10]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  A. Smolic,et al.  VIDEO CODING USING TEXTURE ANALYSIS AND SYNTHESIS , 2003 .

[12]  J. Jennifer Ranjani,et al.  Dual-Tree Complex Wavelet Transform Based SAR Despeckling Using Interscale Dependence , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[13]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Michael Rubinstein,et al.  Analysis and visualization of temporal variations in video , 2014 .

[15]  David L. Neuhoff,et al.  Structural Texture Similarity Metrics for Image Analysis and Retrieval , 2013, IEEE Transactions on Image Processing.