Dynamic texture synthesis using linear phase shift interpolation

Dynamic texture motions like flowing water, motion of leaves etc. have a complex random character. A sequence containing such a content is challenging to encode even when using state of the art High Efficiency Video Coding (HEVC) especially, if the available bandwidth is limited. It is observed that often when predicting dynamic textures, codec switches to intra prediction. At lower rates, dynamic texture content shows visually annoying blurring and blocking artifacts. For dynamic textures, both spatial and temporal details are perceptually of less importance. This property of the Human Visual System (HVS) can be exploited when coding dynamic texture content, as suggested in this paper. At the encoder, preprocessing is done by skipping even numbered B pictures. At the decoder side, skipped pictures are synthesized using linear phase shift interpolation of the complex wavelet coefficients, from the adjacent already decoded pictures. Subjective evaluation of proposed approach is done by using a pair wise comparison test between the proposed results and the conventional HEVC decoded bitstream at similar bitrates. The evaluation results show that viewers prefer the proposed result over conventional HEVC.

[1]  Ling Lu,et al.  An Improved Rate Control Algorithm of H.264/AVC Based on Human Visual System , 2012 .

[2]  Vincent Ricordel,et al.  Estimation of perceptual redundancies of HEVC encoded dynamic textures , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[3]  Uday Singh Thakur,et al.  Image coding using parametric texture synthesis , 2016, 2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP).

[4]  Frédo Durand,et al.  Phase-based video motion processing , 2013, ACM Trans. Graph..

[5]  Wei Zhang,et al.  The SJTU 4K video sequence dataset , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[6]  Fan Zhang,et al.  A Parametric Framework for Video Compression Using Region-Based Texture Models , 2011, IEEE Journal of Selected Topics in Signal Processing.

[7]  Uday Singh Thakur,et al.  Texture analysis and synthesis using steerable pyramid decomposition for video coding , 2015, 2015 International Conference on Systems, Signals and Image Processing (IWSSIP).

[8]  William T. Freeman,et al.  Presented at: 2nd Annual IEEE International Conference on Image , 1995 .

[9]  Barry G. Haskell,et al.  A texture replacement method at the encoder for bit-rate reduction of compressed video , 2003, IEEE Trans. Circuits Syst. Video Technol..

[10]  Hua Li,et al.  Perceptually Adaptive Lagrange Multiplier for Rate-Distortion Optimization in H.264 , 2007, Future Generation Communication and Networking (FGCN 2007).

[11]  Mathias Wien,et al.  High Efficiency Video Coding: Coding Tools and Specification , 2014 .

[12]  Vincent Ricordel,et al.  Local texture synthesis: A static texture coding algorithm fully compatible with HEVC , 2015, 2015 International Conference on Systems, Signals and Image Processing (IWSSIP).

[13]  Heiko Schwarz,et al.  Improved H.264/AVC coding using texture analysis and synthesis , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[14]  Max Grosse,et al.  Phase-based frame interpolation for video , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Fan Zhang,et al.  A video texture database for perceptual compression and quality assessment , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[16]  Jens-Rainer Ohm,et al.  Models for Static and Dynamic Texture Synthesis in Image and Video Compression , 2011, IEEE Journal of Selected Topics in Signal Processing.

[17]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.