Context Adaptive Lagrange Multiplier (CALM) for Rate-Distortion Optimal Motion Estimation in Video Coding

In this paper, we propose an efficient and practical algorithm to dynamically adapt the Lagrange multipliers for each macroblock based on the context of the neighboring or upper layer blocks to improve rate-distortion performance. Our method improves the accuracy for the detection of true motion vectors as well as the most efficient encoding modes for luma, which are used for deriving the motion vectors, and modes for chroma. Simulation results for H.264/advanced video coding video demonstrate that our method reduces bit rate significantly and achieves peak signal-to-noise ratio gain over those of the joint model (JM) software for all sequences tested, with negligible extra computational cost. The improvement is particularly significant for high motion high-resolution videos. This paper describes our work that led to our Joint Video Team adopted contribution (included in software JM 12.0 onward), collectively known as context adaptive Lagrange multiplier (CALM).

[1]  Gary J. Sullivan,et al.  Video Compression - From Concepts to the H.264/AVC Standard , 2005, Proceedings of the IEEE.

[2]  Philip A. Chou,et al.  Entropy-constrained vector quantization , 1989, IEEE Trans. Acoust. Speech Signal Process..

[3]  Janne Heikkilä,et al.  Selection of the Lagrange multiplier for block-based motion estimation criteria , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  R. L. Baker,et al.  Rate-distortion optimized motion compensation for video compression using fixed or variable size blocks , 1991, IEEE Global Telecommunications Conference GLOBECOM '91: Countdown to the New Millennium. Conference Record.

[5]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[6]  Nam Ling,et al.  Improved Normalized Partial Distortion Search With Dual-Halfway-Stop for Rapid Block Motion Estimation , 2007, IEEE Transactions on Multimedia.

[7]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Sanjit K. Mitra,et al.  Rate-distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standard , 1996, IEEE Trans. Circuits Syst. Video Technol..

[9]  Lulin Chen,et al.  Adaptive λ estimation in Lagrangian rate-distortion optimization for video coding , 2006, Electronic Imaging.

[10]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[11]  A. N. Willson,et al.  Rate-distortion optimal motion estimation algorithms for motion-compensated transform video coding , 1998, IEEE Trans. Circuits Syst. Video Technol..

[12]  X. Yi,et al.  Improved and simplified fast motion estimation for JM , 2005 .

[13]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[14]  Iain E. Garden Richardson,et al.  Low-complexity skip prediction for H.264 through Lagrangian cost estimation , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Ming-Ting Sun,et al.  Efficient rate-distortion estimation for H.264/AVC coders , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Philip M. Long,et al.  Efficient cost measures for motion estimation at low bit rates , 1998, IEEE Trans. Circuits Syst. Video Technol..

[17]  Thomas Wiegand,et al.  Lagrange multiplier selection in hybrid video coder control , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[18]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[19]  Antonio Ortega,et al.  Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders , 1994, IEEE Trans. Image Process..

[20]  Wen Gao,et al.  Statistical model, analysis and approximation of rate-distortion function in MPEG-4 FGS videos , 2005, Visual Communications and Image Processing.

[21]  Jun Zhang,et al.  Bit rate distribution analysis for motion estimation in H.264 , 2006, 2006 Digest of Technical Papers International Conference on Consumer Electronics.

[22]  Antonio Ortega,et al.  Optimal trellis-based buffered compression and fast approximations , 1994, IEEE Trans. Image Process..

[23]  Harvey J. Everett.  Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources , 1963 .