Quadtree-structured variable-size block-matching motion estimation with minimal error

This paper reports two efficient quadtree-based algorithms for variable-size block matching (VSBM) motion estimation. The schemes allow the dimensions of blocks to adapt to local activity within the image, and the total number of blocks in any frame can be varied while still accurately representing true motion. This permits adaptive bit allocation between the representation of displacement and residual data, and also the variation of the overall bit-rate on a frame-by-frame basis. The first algorithm computes the optimal selection of variable-sized blocks to provide the best-achievable prediction error under the fixed number of blocks for a quadtree-based VSBM technique. The algorithm employs an efficient dynamic programming technique utilizing the special structure of a quadtree. Although this algorithm is computationally intensive, it does provide a yardstick by which the performance of other more practical VSBM techniques can be measured. The second algorithm adopts a heuristic way to select variable-sized square blocks. It relies more on local motion information than on global error optimization. Experiments suggest that the effective use of local information contributes to minimizing the overall error. The result is a more computationally efficient VSBM technique than the optimal algorithm, but with a comparable prediction error.

[1]  Peter Strobach,et al.  Quadtree-structured recursive plane decomposition coding of images , 1991, IEEE Trans. Signal Process..

[2]  Graham R. Martin,et al.  Variable size block matching motion estimation with minimal error , 1996, Electronic Imaging.

[3]  JongWon Kim,et al.  Hierarchical variable block size motion estimation technique for motion sequence coding , 1993, Other Conferences.

[4]  K. Rijkse,et al.  H.263: video coding for low-bit-rate communication , 1996, IEEE Commun. Mag..

[5]  Itu-T Video coding for low bitrate communication , 1996 .

[6]  Jungwoo Lee,et al.  Optimal quadtree for variable block size motion estimation , 1995, Proceedings., International Conference on Image Processing.

[7]  Gary J. Sullivan,et al.  Efficient quadtree coding of images and video , 1994, IEEE Trans. Image Process..

[8]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[9]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[10]  Anthony G. Constantinides,et al.  Variable size block matching motion compensation with applications to video coding , 1990 .

[11]  Allen Gersho,et al.  Image compression with variable block size segmentation , 1992, IEEE Trans. Signal Process..

[12]  Gary J. Sullivan,et al.  Recursive optimal pruning with applications to tree structured vector quantizers , 1992, IEEE Trans. Image Process..

[13]  D Marr,et al.  Directional selectivity and its use in early visual processing , 1981, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[14]  Wai-Yip Chan,et al.  Rate-constrained hierarchical motion estimation using BFOS tree pruning , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[15]  Allen Gersho,et al.  Variable block-size image coding , 1987, ICASSP '87. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  Andre Zaccarin,et al.  Fast algorithms for block motion estimation , 1992, [Proceedings] ICASSP-92: 1992 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[17]  Philip A. Chou,et al.  Optimal pruning with applications to tree-structured source coding and modeling , 1989, IEEE Trans. Inf. Theory.

[18]  Josef Kittler,et al.  Variable block size video coding with motion prediction and motion segmentation , 1995, Electronic Imaging.