Generalized binary splits: A versatile partitioning scheme for block-based hybrid video coding

Block partitioning is the basis of every modern hybrid video coding standard. It specifies how the video pictures can be subdivided into blocks for prediction and residual coding. In H.265/HEVC, quad-tree partitioning is one of the key technologies allowing for flexible mode allocation and providing a substantial part of the gains over H.264/AVC. The current draft of the upcoming standard Versatile Video Coding (VVC) provides over 30% bit-rate savings over HEVC and almost one third of the gain is achieved by using a more flexible partitioning scheme than the quad-tree partitioning used in HEVC. In this paper, we describe a partitioning concept that generalizes many of the ideas developed during the exploration and early standardization phase of VVC. In fact, our method includes the VVC partitioning as well as many other state-of-the-art methods. The proposed method can be implemented in a fully configurable design. For instance, it can be configured to match the performance of VTM-1.0 at much faster runtime (69%) or it can be configured to obtain additional bit-rate savings of up to 3% by exploiting additional degrees of freedom.

[1]  D. Marpe,et al.  The H.264/MPEG4 advanced video coding standard and its applications , 2006, IEEE Communications Magazine.

[2]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Shiqi Wang,et al.  Extended Quad-Tree Partitioning for Future Video Coding , 2019, 2019 Data Compression Conference (DCC).

[4]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[5]  Heiko Schwarz,et al.  Video Compression Using Nested Quadtree Structures, Leaf Merging, and Improved Techniques for Motion Representation and Entropy Coding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Jian Zhang,et al.  Effective Quadtree Plus Binary Tree Block Partition Decision for Future Video Coding , 2017, 2017 Data Compression Conference (DCC).

[7]  Heiko Schwarz,et al.  Fast Partitioning Decision Strategies for The Upcoming Versatile Video Coding (VVC) Standard , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[8]  Heiko Schwarz,et al.  Recursive Partitioning Search Space Pruning Using Split Cost Prediction , 2019, 2019 Data Compression Conference (DCC).

[9]  Jian Zhang,et al.  Probabilistic Decision Based Block Partitioning for Future Video Coding. , 2018, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[10]  Marta Karczewicz,et al.  Highly Flexible Coding Structures for Next-Generation Video Compression Standard , 2019, 2019 Data Compression Conference (DCC).

[11]  Heiko Schwarz,et al.  Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard , 2003, IEEE Trans. Circuits Syst. Video Technol..