Investigation of performance trade off in motion estimation algorithms on sub-pixel displacement

This paper presents a performance evaluation of two different sub-pixel motion estimation algorithms, one base on Block-Matching and the other based on optical flow to obtain sub-pixel displacement. On block-matching, we focus on block-based full search (FS), three step search (TSS) [1], two dimensional logarithm search (TDL) [2], cross search algorithm (CSA) [3], a new three step search algorithm (NTSS) [4], a novel four-step search algorithm (NFSS) [5], a block-based gradient descent search algorithm (BBGDS) [6], a new diamond search algorithm (DS) [7] and hexagon search algorithm (HS) [8]. And on optical flow, we focus on 2D optical flow block-based full search algorithm (OF), bidirectional confidence based optical flow algorithm (BCOF) [9]. These are evaluated based on mean average error (MAE), peak signal to noise ratio (PSNR), and computational time. These experiment results are comprehensively tested on several standard sequences such as AKIYO, COASTGUARD, CONTAINER, and FOREMAN.

[1]  M. GHANBARI,et al.  The cross-search algorithm for motion estimation [image coding] , 1990, IEEE Trans. Commun..

[2]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[3]  Lurng-Kuo Liu,et al.  A block-based gradient descent search algorithm for block motion estimation in video coding , 1996, IEEE Trans. Circuits Syst. Video Technol..

[4]  Songyu Yu,et al.  Confidence based optical flow algorithm for high reliability , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[6]  Kai-Kuang Ma,et al.  A new diamond search algorithm for fast block-matching motion estimation , 2000, IEEE Trans. Image Process..

[7]  Bing Zeng,et al.  A new three-step search algorithm for block motion estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[8]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[9]  Lap-Pui Chau,et al.  Hexagon-based search pattern for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[10]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[11]  Mohammed Ghanbari,et al.  The Cross-Search Algorithm for Motion Estimation , 1990 .

[12]  Kai-Kuang Ma,et al.  Correction to "a new diamond search algorithm for fast block-matching motion estimation" , 2000, IEEE Trans. Image Process..