Motion compensated frame interpolation by new block-based motion estimation algorithm

In this paper, a motion compensated frame interpolation (MCI) algorithm adapting new block-based motion estimation (BME), which is overlapped block-based motion estimation (OBME), is proposed for frame rate up-conversion (FRC). Unlike conventional BME algorithms, where a video frame is divided into many non-overlapping square blocks of pixels, the proposed BME is executed using an overlapped matching block in order to get more accurate motion trajectory. To reduce computational complexity caused by the OBME, a sub-sampled pixel block is used for the OBME. The proposed OBME is executed with the various overlapped blocks that have different block sizes and sub-sampling ratios. In this paper, instead of mean absolute difference (MAD) used for general BME, a modified MAD is applied for the OBME. The MAD proposed is weighted using the magnitude of MV that corresponds to the estimating position. From the simulation results, the proposed methods show better performance in estimating "true motion" and reducing blocking artifacts with less complexity in calculation compared to a conventional method.

[1]  Bing Zeng,et al.  A new fast motion estimation algorithm based on search window sub-sampling and object boundary pixel block matching , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[2]  Frederic Dufaux,et al.  Motion estimation techniques for digital TV: a review and a new contribution , 1995, Proc. IEEE.

[3]  Rae-Hong Park,et al.  Weighted-adaptive motion-compensated frame rate up-conversion , 2003, IEEE Trans. Consumer Electron..

[4]  G. Haan,et al.  Robust motion-compensated video upconversion , 1997 .

[5]  Gerard de Haan,et al.  A new algorithm for high quality video format conversion , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[6]  Rae-Hong Park,et al.  Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure , 2003, IEEE Trans. Consumer Electron..

[7]  Yongmin Kim,et al.  Using motion-compensated frame-rate conversion for the correction of 3: 2 pulldown artifacts in video sequences , 2000, IEEE Trans. Circuits Syst. Video Technol..

[8]  Kenji Sugiyama,et al.  A method of de-interlacing with motion compensated interpolation , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[9]  Bede Liu,et al.  New fast algorithms for the estimation of block motion vectors , 1993, IEEE Trans. Circuits Syst. Video Technol..

[10]  Roberto Castagno,et al.  A method for motion adaptive frame rate up-conversion , 1996, IEEE Trans. Circuits Syst. Video Technol..

[11]  Sung-Jea Ko,et al.  New frame rate up-conversion using bi-directional motion estimation , 2000, IEEE Trans. Consumer Electron..