Motion vector optimization of control grid interpolation and overlapped block motion compensation using iterative dynamic programming

Interdependence between motion vectors (MVs), introduced by control grid interpolation (CGI) and overlapped block motion compensation (OBMC) algorithms, is the key to improving temporal prediction performance of conventional block-matching motion compensation schemes. Unfortunately, this dependency makes the problem of finding optimal MVs intractable. While standard schemes that successively optimize each MV are susceptible to severe local minimum problems, we propose a dynamic programming (DP) paradigm, where each horizontal or vertical slice of MVs is jointly determined during an iterative optimization process. To retain reasonably low complexity, our algorithm effectively identifies an initial search region and then chooses a proper search scheme for each MV. In addition, a computationally-efficient multiscale search strategy is employed. The performance of the proposed method is compared with that of the standard optimization techniques, and our experimental results show that the proposed scheme always gives a better rate-distortion performance. Especially for CGI, the PSNR improvements and the percentage of bit-rate savings provided by our algorithm, in some cases, are in excess of 1.0 dB and 20%, respectively.

[1]  Alan N. Willson,et al.  A Logarithmic-Time Adaptive Block-Matching Algorithm for Estimating Large-Displacement Motion Vectors , 1996 .

[2]  Aggelos K. Katsaggelos,et al.  A video compression scheme with optimal bit allocation between displacement vector field and displaced frame difference , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[3]  Rabab Kreidieh Ward,et al.  Predictive RD Optimized Motion Estimation for Very Low Bit-Rate Video Coding , 1997, IEEE J. Sel. Areas Commun..

[4]  Hiroshi Harashima,et al.  Motion compensation based on spatial transformations , 1994, IEEE Trans. Circuits Syst. Video Technol..

[5]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[6]  Bernd Girod,et al.  Rate-constrained motion estimation , 1994, Other Conferences.

[7]  Gary J. Sullivan,et al.  Motion compensation for video compression using control grid interpolation , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[8]  Dimitri P. Bertsekas,et al.  Dynamic Programming: Deterministic and Stochastic Models , 1987 .

[9]  Wilson C. Chung,et al.  Rate-distortion-constrained statistical motion estimation for video coding , 1995, Proceedings., International Conference on Image Processing.

[10]  Frederic Dufaux,et al.  Multigrid block-matching motion estimation with an adaptive local mesh refinement , 1992, Other Conferences.

[11]  D. Legall,et al.  MPEG : A video compression standard for multimedia applications , 1991 .

[12]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[13]  Sharad Singhal,et al.  Windowed motion compensation , 1991, Other Conferences.

[14]  Alan N. Willson,et al.  Rate-distortion optimal motion estimation algorithm for video coding , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[15]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[16]  Peter Pirsch,et al.  VLSI architectures for video compression-a survey , 1995, Proc. IEEE.

[17]  S. Okubo Reference model methodology-A tool for the collaborative creation of video coding standards , 1995 .

[18]  Sanjit K. Mitra,et al.  Rate-distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standard , 1996, IEEE Trans. Circuits Syst. Video Technol..

[19]  Ming-Ting Sun,et al.  A family of vlsi designs for the motion compensation block-matching algorithm , 1989 .

[20]  Chung-Lin Huang,et al.  A new motion compensation method for image sequence coding using hierarchical grid interpolation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[21]  Mohammad Ghanbari,et al.  General approach to block-matching motion estimation , 1993 .

[22]  Antonio Ortega,et al.  Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders , 1994, IEEE Trans. Image Process..

[23]  Frederic Dufaux,et al.  Motion estimation techniques for digital TV: a review and a new contribution , 1995, Proc. IEEE.

[24]  Michael T. Orchard,et al.  Overlapped block motion compensation: an estimation-theoretic approach , 1994, IEEE Trans. Image Process..