Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation

In this work, we develop a new motion-compe (MC) interpolation algorithm to enhance the temporal resolution of video sequences. First, we propose the bilateral motion estimation scheme to obtain the motion field of an interpolated frame without yielding the hole and overlapping problems. Then, we partition a frame into several object regions by clustering motion vectors. We apply the variable-size block MC (VS-BMC) algorithm to object boundaries in order to reconstruct edge information with a higher quality. Finally, we use the adaptive overlapped block MC (OBMC), which adjusts the coefficients of overlapped windows based on the reliabilities of neighboring motion vectors. The adaptive OBMC (AOBMC) can overcome the limitations of the conventional OBMC, such as over-smoothing and poor de-blocking. Experimental results show that the proposed algorithm provides a better image quality than conventional methods both objectively and subjectively

[1]  Til Aach,et al.  Efficient prediction of uncovered background in interframe coding using spatial extrapolation , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Packwood,et al.  VARIABLE SIZE BLOCK MATCHING MOTION CODING , 2004 .

[3]  Yrjö Neuvo,et al.  Fractional frame rate up-conversion using weighted median filters , 1989 .

[4]  Guobin Shen,et al.  Transcoder with arbitrarily resizing capability , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[5]  Wen-Liang Hwang,et al.  Advanced motion compensation techniques for blocking artifacts reduction in 3-D video coding systems , 2005, IEEE International Conference on Image Processing 2005.

[6]  Lap-Pui Chau,et al.  Arbitrary downsizing video transcoding using fast motion vector reestimation , 2002, IEEE Signal Processing Letters.

[7]  Yongmin Kim,et al.  Using motion-compensated frame-rate conversion for the correction of 3: 2 pulldown artifacts in video sequences , 2000, IEEE Trans. Circuits Syst. Video Technol..

[8]  Roberto Castagno,et al.  A method for motion adaptive frame rate up-conversion , 1996, IEEE Trans. Circuits Syst. Video Technol..

[9]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[10]  Chung-Lin Huang,et al.  A new motion compensation method for image sequence coding using hierarchical grid interpolation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[11]  Sun-Yuan Kung,et al.  Rate optimization by true motion estimation , 1997, Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing.

[12]  Rae-Hong Park,et al.  Coarse-to-fine frame interpolation for frame rate up-conversion using pyramid structure , 2003, IEEE Trans. Consumer Electron..

[13]  Edward H. Adelson,et al.  Representing moving images with layers , 1994, IEEE Trans. Image Process..

[14]  Sharad Singhal,et al.  Windowed motion compensation , 1991, Other Conferences.

[15]  Michael T. Orchard,et al.  Overlapped block motion compensation: an estimation-theoretic approach , 1994, IEEE Trans. Image Process..

[16]  Sun-Yuan Kung,et al.  Frame-rate up-conversion using transmitted true motion vectors , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[17]  Sung-Jea Ko,et al.  New frame rate up-conversion using bi-directional motion estimation , 2000, IEEE Trans. Consumer Electron..

[18]  Alan N. Willson,et al.  Motion vector optimization of control grid interpolation and overlapped block motion compensation using iterative dynamic programming , 1996, 1996 8th European Signal Processing Conference (EUSIPCO 1996).

[19]  Seungjoon Yang,et al.  Adaptive motion-compensated interpolation for frame rate up-conversion , 2002, 2002 Digest of Technical Papers. International Conference on Consumer Electronics (IEEE Cat. No.02CH37300).

[20]  Yao Wang,et al.  Active mesh-a feature seeking and tracking image sequence representation scheme , 1994, IEEE Trans. Image Process..

[21]  R. J. Schutten,et al.  Real-time 2-3 Pull-down Elimination Applying Motion Estimation/compensation In A Programmable Device , 1998, International 1998 Conference on Consumer Electronics.

[22]  Jiang Li,et al.  A low complexity motion compensated frame interpolation method , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[23]  Peter Csillag,et al.  Enhancement of video data using motion-compensated postprocessing techniques , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[24]  Dong-Wook Kim,et al.  A new video interpolation technique based on motion-adaptive subsampling , 1999, 1999 Digest of Technical Papers. International Conference on Consumer Electronics (Cat. No.99CH36277).

[25]  Hiroshi Harashima,et al.  Motion compensation based on spatial transformations , 1994, IEEE Trans. Circuits Syst. Video Technol..

[26]  C.-C. Jay Kuo,et al.  Motion-compensated interpolation for low-bit-rate video quality enhancement , 1998, Optics & Photonics.