Complexity scalable motion estimation control for H.264/AVC

Guaranteeing real-time performance for video encoding on platforms with limited resources is becoming increasingly important for consumer electronics applications. In this paper, an extension of an H.264/AVC encoder with complexity scalable motion estimation (ME) control is presented. An upper bound on the complexity of encoding a single frame is achieved by restricting Sum of Absolute Differences (SAD) computations performed during ME and trading complexity allocation per frame for output quality. Allocation based on residual, i.e. SAD distortion of the final ME match before quantization, of the co-located macroblock in the previous frame outperforms other approaches in the literature in video quality.

[1]  Jiebo Luo,et al.  Visual Communications and Image Processing 2007 , 2007 .

[2]  Wen Gao,et al.  Real-time video coding under power constraint based on H.264 codec , 2007, Electronic Imaging.

[3]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Yücel Altunbasak,et al.  Rate-Distortion and Complexity Optimized Motion Estimation for H.264 Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Sergio Saponara,et al.  “The JVT Advanced Video Coding Standard: Complexity and Performance Analysis on a Tool-by-tool Basis” , 2003 .

[6]  Jill M. Boyce,et al.  Fast mode decision and motion estimation for JVT/H.264 , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[7]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, SPIE Optics + Photonics.

[8]  Ishfaq Ahmad,et al.  Power-rate-distortion analysis for wireless video communication under energy constraints , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Peter H. N. de With,et al.  New Complexity Scalable MPEG Encoding Techniques for Mobile Applications , 2004, EURASIP J. Adv. Signal Process..

[10]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[11]  D. Marpe,et al.  Video coding with H.264/AVC: tools, performance, and complexity , 2004, IEEE Circuits and Systems Magazine.

[12]  C.-C. Jay Kuo,et al.  Complexity scalable motion estimation for H.264/AVC , 2006, Electronic Imaging.

[13]  Oscar C. Au,et al.  Predictive motion vector field adaptive search technique (PMVFAST): enhancing block-based motion estimation , 2000, IS&T/SPIE Electronic Imaging.