Multi-objective design space exploration for the optimization of the HEVC mode decision process

Finding the best possible encoding decisions for compressing a video sequence is a highly complex problem. In this work, we propose a multi-objective Design Space Exploration (DSE) method to automatically find HEVC encoder implementations that are optimized for several different criteria. The DSE shall optimize the coding mode evaluation order of the mode decision process and jointly explore early skip conditions to minimize the four objectives a) bitrate, b) distortion, c) encoding time, and d) decoding energy. In this context, we use a SystemC-based actor model of the HM test model encoder for the evaluation of each explored solution. The evaluation that is based on real measurements shows that our framework can automatically generate encoder solutions that save more than 60% of encoding time or 3% of decoding energy when accepting bitrate increases of around 3%.

[1]  Zhan Ma,et al.  Fast Intra Mode Decision for High Efficiency Video Coding (HEVC) , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Yung-Lyul Lee,et al.  Early Termination of CU Encoding to Reduce HEVC Complexity , 2012, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[3]  Michael Glaß,et al.  Analysis and Exploitation of CTU-Level Parallelism in the HEVC Mode Decision Process Using Actor-Based Modeling , 2016, ARCS.

[4]  André Kaup,et al.  Fast exclusion of angular intra prediction modes in HEVC using reference sample variance , 2016, 2016 IEEE International Symposium on Circuits and Systems (ISCAS).

[5]  Yiming Cao,et al.  A mode filtering algorithm for accelerating HEVC FME , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[6]  Rafael Rosales,et al.  MAESTRO— Holistic Actor-Oriented Modeling of Nonfunctional Properties and Firmware Behavior for MPSoCs , 2014, TODE.

[7]  Martin Lukasiewycz,et al.  Opt4J: a modular framework for meta-heuristic optimization , 2011, GECCO '11.

[8]  André Kaup,et al.  Joint optimization of rate, distortion, and decoding energy for HEVC intraframe coding , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[9]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[10]  André Kaup,et al.  Modeling the Energy Consumption of the HEVC Decoding Process , 2022, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[12]  Marko Viitanen,et al.  Efficient Mode Decision Schemes for HEVC Inter Prediction , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Tao Fan,et al.  Fast CU size decision and PU mode decision algorithm in HEVC intra coding , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[15]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .