Extending HEVC using texture synthesis

The High Efficiency Video Coding (HEVC) standard provides superior coding efficiency compared to its predecessors. Nevertheless, the encoding of complex and thus hardly to predict textures either requires high bit rates or results in low quality of the reconstructed signal. To compensate for this limitation of HEVC, we propose a sophisticated texture synthesis framework which solves multiple lacks of previous texture synthesis approaches. By easing the bit rate cost for synthesizable regions and reallocating the freed bit rate resources to non-synthesizable regions, for high-value soccer content we are able to achieve average BD-rate gains of 21.9% for all-intra, 17.6% for low delay, and 16.3% for random access, respectively, while maintaining the same objective quality for the latter. Subjective tests for the synthesizable regions confirm the objectively measured convincing results. The general applicability of our method is confirmed for other types of content.

[1]  Olivier Déforges,et al.  Characterization and adaptive texture synthesis-based compression scheme , 2011, 2011 19th European Signal Processing Conference.

[2]  Detlev Marpe,et al.  Overview of the Range Extensions for the HEVC Standard: Tools, Profiles, and Performance , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[4]  A. Smolic,et al.  VIDEO CODING USING TEXTURE ANALYSIS AND SYNTHESIS , 2003 .

[5]  Barry G. Haskell,et al.  An encoder-decoder texture replacement method with application to content-based movie coding , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Dong Liu,et al.  Edge-Based Inpainting and Texture Synthesis for Image Compression , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[8]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[9]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[10]  Jörn Ostermann,et al.  Codec independent region of interest video coding using a joint pre- and postprocessing framework , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[11]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[12]  Anne Aaron,et al.  A large-scale video codec comparison of x264, x265 and libvpx for practical VOD applications , 2016, Optical Engineering + Applications.