Video Codec Using Flexible Block Partitioning and Advanced Prediction, Transform and Loop Filtering Technologies

This paper describes a joint response to the Call for Proposals by Samsung, Huawei, GoPro, and HiSilicon on Video Compression with Capability beyond HEVC/H.265, jointly issued by ITU-T SG16 Q.6 (VCEG) and ISO/IEC JTC1/SC29/WG11 (MPEG). In the proposed codec, the coding framework supports hierarchical splitting with binary and ternary trees and flexible coding order representations. Additionally, novel compression tools on inter/intra prediction, in-loop filtering, and entropy coding have been proposed. The proposed compression scheme provides significantly higher compression capability than the state-of-the-art HEVC/H.265 standard for SDR (Standard Dynamic Range) category while maintaining complexity acceptable for emerging applications. When all the proposed algorithmic tools are used, the proposed video codec achieves approximately 40% bit-saving for the SDR cetegory on average compared to HEVC/H.265 anchor.

[1]  Jeong-Hoon Park,et al.  Block Partitioning Structure in the HEVC Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Atsushi Shimizu,et al.  A 120 fps High Frame Rate Real-time HEVC Video Encoder with Parallel Configuration Scalable to 4K , 2018, IEEE Transactions on Multi-Scale Computing Systems.

[3]  Jian Zhang,et al.  Adaptive Progressive Motion Vector Resolution Selection Based on Rate–Distortion Optimization , 2017, IEEE Transactions on Image Processing.

[4]  Byung Cheol Song,et al.  Block Adaptive Inter-Color Compensation Algorithm for RGB 4:4:4 Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Kazuhisa Iguchi,et al.  A Study on the Required Video Bit-rate for 8K 120-Hz HEVC/H.265 Temporal Scalable Coding , 2018, 2018 Picture Coding Symposium (PCS).

[6]  Hsueh-Ming Hang,et al.  Adaptive Schemes For Motion-Compensated Coding , 1988, Other Conferences.

[7]  Moncef Gabbouj,et al.  Video Coding Using Spatially Varying Transform , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Jeong-Hoon Park,et al.  High precision probability estimation for CABAC , 2013, 2013 Visual Communications and Image Processing (VCIP).

[9]  C. Holt Author's retrospective on ‘Forecasting seasonals and trends by exponentially weighted moving averages’ , 2004 .

[10]  Woo-Shik Kim,et al.  Interplane prediction for RGB video coding , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[11]  Ronan Parois,et al.  Hybrid Broadband/Broadcast ATSC 3.0 SHVC Distribution Chain , 2018, 2018 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting (BMSB).

[12]  Jianle Chen,et al.  Joint Separable and Non-Separable Transforms for Next-Generation Video Coding , 2018, IEEE Transactions on Image Processing.

[13]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Yan Ye,et al.  360° Video Coding Based on Projection Format Adaptation and Spherical Neighboring Relationship , 2019, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[15]  Gary J. Sullivan,et al.  The Joint Exploration Model (JEM) for Video Compression With Capability Beyond HEVC , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Detlev Marpe,et al.  Cross-Component Prediction in HEVC , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Atsushi Shimizu,et al.  A 120 fps high frame rate real-time HEVC video encoder with parallel configuration scalable to 4K , 2017, 2017 IEEE Symposium in Low-Power and High-Speed Chips (COOL CHIPS).

[18]  J. M. Foley,et al.  Contrast masking in human vision. , 1980, Journal of the Optical Society of America.

[19]  King Ngi Ngan,et al.  Spatio-Temporal Just Noticeable Distortion Profile for Grey Scale Image/Video in DCT Domain , 2009, IEEE Transactions on Circuits and Systems for Video Technology.