Graphics hardware for gradient-based motion estimation

Motion estimation and compensation is a key component in video procesing. Motion estimation is necessary for high quality compression. It is also a key component in archive video restoration and motion picture post-production. Very accurate motion vectors are usually required in the latter two applications. More accurate motion vectors can also lead to greater coding efficiency. Real-time, accurate motion estimation is currently not attainable on standard desktop PCs. It usually requires some kind of dedicated hardware such as on video coding chips. Gradient based motion estimation is one which gives good accuracy for reasonable computational cost. This paper uses the Wiener based motion estimator as a vehicle to explore the acceleration of gradient based motion estimation on the PC.

[1]  Dennis Michael Martinez.  Model-based motion estimation and its application to restoration and interpolation of motion pictures , 1986 .

[2]  Anil Kokaram,et al.  Fast image interpolation for motion estimation using graphics hardware , 2004, IS&T/SPIE Electronic Imaging.

[3]  A. Kokaram.  Motion picture restoration , 1998 .

[4]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[5]  G. A. Thomas,et al.  Television motion measurement for DATV and other applications , 1987 .

[6]  Anil C. Kokaram,et al.  A Bayesian framework for recursive object removal in movie post-production , 2003, ICIP.

[7]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[8]  J. D. Robbins,et al.  Motion-compensated television coding: Part I , 1979, The Bell System Technical Journal.

[9]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[10]  D. Boekee,et al.  A pel-recursive Wiener-based displacement estimation algorithm , 1987 .

[11]  M. Bierling,et al.  Displacement Estimation By Hierarchical Blockmatching , 1988, Other Conferences.

[12]  Hans-Hellmut Nagel,et al.  An Investigation of Smoothness Constraints for the Estimation of Displacement Vector Fields from Image Sequences , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Ciro Cafforio,et al.  Methods for measuring small displacements of television images , 1976, IEEE Trans. Inf. Theory.

[14]  Michael R. Macedonia,et al.  The GPU Enters Computing's Mainstream , 2003, Computer.

[15]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[16]  William R. Mark,et al.  Cg: a system for programming graphics hardware in a C-like language , 2003, ACM Trans. Graph..