Analysis of fast block matching motion estimation algorithms for video super-resolution systems

In general, all the video super-resolution (SR) algorithms present the important drawback of a very high computational load, mainly due to the huge amount of operations executed by the motion estimation (ME) stage. Commonly, there is a trade-off between the accuracy of the estimated motion, given as a motion vector (MV), and the computational cost associated. In this sense, the ME algorithms that explore more exhaustively the search area among images use to deliver better MVs, at the cost of a higher computational load and resources use. Due to this reason, the proper choice of a ME algorithm is a key factor not only to reach real-time applications, but also to obtain high quality video sequences independently of their characteristics. Under the hardware point of view, the preferred ME algorithms are based on matching fixed-size blocks in different frames. In this paper, a comparison of nine of the most representative Fast Block Matching Algorithms (FBMAs) is made in order to select the one which presents the best tradeoff between video quality and computational cost, thus allowing reliable real-time hardware implementations of video super-resolution systems.

[1]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[2]  Sethuraman Panchanathan,et al.  Experiments on block-matching techniques for video coding , 1994, Multimedia Systems.

[3]  R. Srinivasan,et al.  Predictive Coding Based on Efficient Motion Estimation , 1985, IEEE Trans. Commun..

[4]  Gustavo Marrero Callicó,et al.  Low-cost implementation of a super-resolution algorithm for real-time video applications , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[5]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[6]  Klamer Schutte,et al.  Performance of optimal registration estimators , 2005, SPIE Defense + Commercial Sensing.

[7]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[8]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[9]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[10]  Sebastián López,et al.  Low-Cost Super-Resolution Algorithms Implementation Over a HW/SW Video Compression Platform , 2006, EURASIP J. Adv. Signal Process..

[11]  Mohammed Ghanbari,et al.  The Cross-Search Algorithm for Motion Estimation , 1990 .

[12]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[13]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[14]  Kai-Kuang Ma,et al.  Correction to "a new diamond search algorithm for fast block-matching motion estimation" , 2000, IEEE Trans. Image Process..

[15]  Lurng-Kuo Liu,et al.  A block-based gradient descent search algorithm for block motion estimation in video coding , 1996, IEEE Trans. Circuits Syst. Video Technol..

[16]  Bing Zeng,et al.  A new three-step search algorithm for block motion estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[17]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[18]  Michael Elad,et al.  A fast super-resolution reconstruction algorithm for pure translational motion and common space-invariant blur , 2001, IEEE Trans. Image Process..

[19]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[20]  M. GHANBARI,et al.  The cross-search algorithm for motion estimation [image coding] , 1990, IEEE Trans. Commun..