Complexity Analysis Of Next-Generation VVC Encoding And Decoding

While the next generation video compression standard, Versatile Video Coding (VVC), provides a superior compression efficiency, its computational complexity dramatically increases. This paper thoroughly analyzes this complexity for both encoder and decoder of VVC Test Model 6, by quantifying the complexity break-down for each coding tool and measuring the complexity and memory requirements for VVC encoding/decoding. These extensive analyses are performed for six video sequences of 720p, 1080p, and 2160p, under Low-Delay (LD), Random-Access (RA), and All-Intra (AI) conditions (a total of 320 encoding/decoding). Results indicate that the VVC encoder and decoder are 5x and 1.5x more complex compared to HEVC in LD, and 31x and 1.8x in AI, respectively. Detailed analysis of coding tools reveals that in LD on average, motion estimation tools with 53%, transformation and quantization with 22%, and entropy coding with 7% dominate the encoding complexity. In decoding, loop filters with 30%, motion compensation with 20%, and entropy decoding with 16%, are the most complex modules. Moreover, the required memory bandwidth for VVC encoding/decoding are measured through memory profiling, which are 30x and 3x of HEVC. The reported results and insights are a guide for future research and implementations of energy-efficient VVC encoder/decoder.

[1]  Zhiping Jia,et al.  Hybrid scratchpad and cache memory management for energy-efficient parallel HEVC encoding , 2015, 2015 33rd IEEE International Conference on Computer Design (ICCD).

[2]  W. Hamidouche,et al.  Complexity Reduction Opportunities in the Future VVC Intra Encoder , 2019, 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP).

[3]  Liang-Gee Chen,et al.  A 1062Mpixels/s 8192×4320p High Efficiency Video Coding (H.265) encoder chip , 2013, 2013 Symposium on VLSI Circuits.

[4]  Jun Sun,et al.  Novel Efficient HEVC Decoding Solution on General-Purpose Processors , 2014, IEEE Transactions on Multimedia.

[5]  Mahmoud Reza Hashemi,et al.  Fast and efficient intra mode decision for HEVC, based on dual-tree complex wavelet , 2016, Multimedia Tools and Applications.

[6]  Xiang Zhang,et al.  Look-Ahead Prediction Based Coding Unit Size Pruning for VVC Intra Coding , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[7]  Mahmoud Reza Hashemi,et al.  A low complexity and computationally scalable fast motion estimation algorithm for HEVC , 2020, Multimedia Tools and Applications.

[8]  Anantha Chandrakasan,et al.  Energy and area-efficient hardware implementation of HEVC inverse transform and dequantization , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[9]  Xiang Li,et al.  Fast Adaptive Multiple Transform for Versatile Video Coding , 2019, 2019 Data Compression Conference (DCC).

[10]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[11]  Moncef Gabbouj,et al.  Complexity analysis of next-generation HEVC decoder , 2012, 2012 IEEE International Symposium on Circuits and Systems.

[12]  Ebroul Izquierdo,et al.  An Effective Strategy for Early Skip Mode Decision in HEVC , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[13]  Jizheng Xu,et al.  History-Based Motion Vector Prediction in Versatile Video Coding , 2019, 2019 Data Compression Conference (DCC).

[14]  Mohamed M. Fouad,et al.  High throughput parallel scheme for HEVC deblocking filter , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[15]  Zhenyu Liu,et al.  Lossless Frame Memory Compression Using Pixel-Grain Prediction and Dynamic Order Entropy Coding , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  L. Yang,et al.  An Adaptive CU Size Decision Algorithm for HEVC Intra Prediction Based on Complexity Classification Using Machine Learning , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Pierrick Philippe,et al.  Subjective comparison of VVC and HEVC , 2019 .

[18]  Mahmoud Reza Hashemi,et al.  Fast Motion Estimation Algorithm with Efficient Memory Access for HEVC Hardware Encoders , 2018, 2018 7th European Workshop on Visual Information Processing (EUVIP).

[19]  David Flynn,et al.  HEVC Complexity and Implementation Analysis , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Mahmoud Reza Hashemi,et al.  A computationally scalable fast intra coding scheme for HEVC video encoder , 2018, Multimedia Tools and Applications.

[21]  Chein-Wei Jen,et al.  On the data reuse and memory bandwidth analysis for full-search block-matching VLSI architecture , 2002, IEEE Trans. Circuits Syst. Video Technol..

[22]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[23]  Jianjun Lei,et al.  Early MERGE Mode Decision Based on Motion Estimation and Hierarchical Depth Correlation for HEVC , 2014, IEEE Transactions on Broadcasting.

[24]  Ilkka Hautala,et al.  Programmable 28nm coprocessor for HEVC/H.265 in-loop filters , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).