Complexity-constrained rate-distortion optimization for h.264/avc video coding

In order to enable real-time software-based video encoding, in this work we optimized the prediction stage of an H.264 video encoder, in the complexity sense. Thus, besides looking for the coding options which lead to the best coded representation in terms of rate and distortion (RD), we constrain to a complexity (C) budget. We present a complexity optimized framework (RDC-optimized) which allows for real-time video compression and that does not make use of frame-skipping to comply to the desired encoding speed. We developed our framework around an open source software implementation of the H.264/AVC, the the ×264 encoder. Results show that tight complexity control is attainable in practice, with very little loss in RD performance.

[1]  A. Zaghetto,et al.  Fringe benefits of the H.264/AVC , 2006, 2006 International Telecommunications Symposium.

[2]  Rahul Vanam,et al.  Improved Rate Control and Motion Estimation for H.264 Encoder , 2007, 2007 IEEE International Conference on Image Processing.

[3]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Liang-Gee Chen,et al.  Analysis and complexity reduction of multiple reference frames motion estimation in H.264/AVC , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Khalid Sayood,et al.  Introduction to Data Compression , 1996 .

[6]  I. Richardson,et al.  COMPLEXITY CONTROL OF H . 264 BASED ON A BAYESIAN FRAMEWORK , 2007 .

[7]  Byung-Gyu Kim,et al.  Efficient Inter-Mode Decision Based on Contextual Prediction for the P-Slice in H.264/AVC Video Coding , 2006, 2006 International Conference on Image Processing.

[8]  Itu-T and Iso Iec Jtc.  Advanced video coding for generic audiovisual services , 2010 .

[9]  Pao-Chi Chang,et al.  Complexity control for H.264 video encoding over power-scalable embedded systems , 2009, 2009 IEEE 13th International Symposium on Consumer Electronics.

[10]  Ajay Luthra,et al.  The H.264/AVC Advanced Video Coding standard: overview and introduction to the fidelity range extensions , 2004, SPIE Optics + Photonics.

[11]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[12]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Sungdae Cho,et al.  Efficient design and implementation of visual computing algorithms on the GPU , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[14]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[15]  Ishfaq Ahmad,et al.  Power-rate-distortion analysis for wireless video communication under energy constraints , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Rui Seara,et al.  Sorting Rates in Video Encoding Process for Complexity Reduction , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Katsuhiko Ogata,et al.  Modern Control Engineering , 1970 .

[18]  D. Marpe,et al.  Video coding with H.264/AVC: tools, performance, and complexity , 2004, IEEE Circuits and Systems Magazine.

[19]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..