Optimizing motion-vector accuracy in block-based video coding

All motion-vectors are encoded with the same tired accuracy, typically 1/2-pixel accuracy, but the best motion-vector accuracies are not known. We present a theoretical framework to find the motion-vector accuracies that minimize the total encoding rate with this type of coder, for the classical case where all motion-vectors are encoded with the same accuracy, and for new cases where the accuracy is adapted on a frame-by-frame or block-by-block basis. To do this, we analytically model the effect of motion-vector accuracy and show that the energy in a block of the difference frame is approximately quadratic in the accuracy of the block's motion-vector. This energy-accuracy model is then used to obtain expressions for the total bit rate (motion rate plus difference frame rate) in terms of the blocks' motion accuracies and other key parameters. Minimizing these expressions leads to simple formulas that indicate how to choose the best motion-vector accuracies for this type of coder. These formulas also show that the motion accuracy must increase where more texture is present and decrease when there is much scene noise or when the level of compression is high. We implement several entropy and MPEG-like video coders based on our analysis and present experimental results on synthetic and real video sequences. These results suggest that our formulas are accurate and that significant bit rate savings can be achieved when our optimization procedures are used.

[1]  Xiaoming Li,et al.  A locally quadratic model of the motion estimation error criterion function and its application to subpixel interpolations , 1996, IEEE Trans. Circuits Syst. Video Technol..

[2]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[3]  Ralf Buschmann,et al.  Efficiency of displacement estimation techniques , 1997, Signal Process. Image Commun..

[4]  Jorge Herbert de Lira,et al.  Two-Dimensional Signal and Image Processing , 1989 .

[5]  Hiroshi Ito,et al.  On motion compensation of wavelet coefficients , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[6]  Arun N. Netravali,et al.  Digital Pictures: Representation and Compression , 1988 .

[7]  David L. Neuhoff,et al.  Optimal motion vector accuracy for block-based motion-compensated video coders , 1996, Electronic Imaging.

[8]  David L. Neuhoff,et al.  Reducing rate/complexity in video coding by motion estimation with block adaptive accuracy , 1996, Other Conferences.

[9]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[10]  Itu-T Video coding for low bitrate communication , 1996 .

[11]  Luc Vandendorpe,et al.  Statistical properties of prediction error images in motion compensated interlaced image coding , 1995, Proceedings., International Conference on Image Processing.

[12]  David L. Neuhoff,et al.  Optimizing the motion vector accuracies in block-based video coding , 1996 .

[13]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[14]  David L. Neuhoff,et al.  Optimizing block size in motion-compensated video coding , 1998, J. Electronic Imaging.

[15]  Philippe Guillotel,et al.  Comparison of motion vector coding techniques , 1994, Other Conferences.

[16]  Michael Hötter,et al.  Optimization and efficiency of an object-oriented analysis-synthesis coder , 1994, IEEE Trans. Circuits Syst. Video Technol..

[17]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[18]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[19]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[20]  Bernd Girod Why B-pictures work: a theory of multi-hypothesis motion-compensated prediction , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[21]  Allen Gersho,et al.  Fractional pixel motion estimation , 1993, Other Conferences.

[22]  Frederic Dufaux,et al.  Entropy criterion for optimal bit allocation between motion and prediction error information , 1993, Other Conferences.

[23]  Bernd Girod,et al.  The Efficiency of Motion-Compensating Prediction for Hybrid Coding of Video Sequences , 1987, IEEE J. Sel. Areas Commun..