Energy-constrained real-time H.264/AVC video coding

Energy consumption has become a leading design constraint for computing devices in order to defray electric bills for individuals and businesses. Over the past years, digital video communication technologies have demanded higher computing power availability and, therefore, higher energy expenditure. In order to meet the challenge to provide software-based video encoding solutions, we adopted an open source software implementation of an H.264 video encoder, the x264 encoder, and optimized its prediction stage in the energy sense (E). Thus, besides looking for the coding options which lead to the best coded representation in terms of rate and distortion (RD), we constrain the process to fit within a certain energy budget. i.e., an RDE optimization. We considered energy as the time integration of the real demanded electric power for a given system. We present an RDE-optimized framework which allows for software-based real-time video compression, meeting the desired targets of electrical consumption, hence, controlling carbon emissions. We show results of energy-constrained compression wherein one can save as much as 35% of the energy with small impact on RD performance.

[1]  A. Zaghetto,et al.  Fringe benefits of the H.264/AVC , 2006, 2006 International Telecommunications Symposium.

[2]  Ishfaq Ahmad,et al.  Power-rate-distortion analysis for wireless video communication under energy constraints , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[4]  Olli Silvén,et al.  Observations on Power-Efficiency Trends in Mobile Communication Devices , 2007, EURASIP J. Embed. Syst..

[5]  Sungdae Cho,et al.  Efficient design and implementation of visual computing algorithms on the GPU , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[6]  Lance Fortnow,et al.  A Short History of Computational Complexity , 2003, Bull. EATCS.

[7]  G. Blelloch Introduction to Data Compression * , 2022 .

[8]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[9]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[10]  Byung-Gyu Kim,et al.  Efficient Inter-Mode Decision Based on Contextual Prediction for the P-Slice in H.264/AVC Video Coding , 2006, 2006 International Conference on Image Processing.

[11]  I. Richardson,et al.  COMPLEXITY CONTROL OF H . 264 BASED ON A BAYESIAN FRAMEWORK , 2007 .

[12]  Liang-Gee Chen,et al.  Analysis and complexity reduction of multiple reference frames motion estimation in H.264/AVC , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  D. Marpe,et al.  Video coding with H.264/AVC: tools, performance, and complexity , 2004, IEEE Circuits and Systems Magazine.

[14]  Rahul Vanam,et al.  Improved Rate Control and Motion Estimation for H.264 Encoder , 2007, 2007 IEEE International Conference on Image Processing.

[15]  Rui Seara,et al.  Sorting Rates in Video Encoding Process for Complexity Reduction , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Albert Y. Zomaya,et al.  A Taxonomy and Survey of Energy-Efficient Data Centers and Cloud Computing Systems , 2010, Adv. Comput..

[17]  Itu-T and Iso Iec Jtc Advanced video coding for generic audiovisual services , 2010 .