A Novel Spatial-Temporal Position Prediction Motion-Compensated Interpolation for Frame Rate Up-Conversion

In this paper, a novel spatial-temporal position prediction motion-compensated interpolation method (MCI) for frame rate up-conversion is proposed using the transmitted Motion Vectors (MVs). Based on our previous proposed GMPP algorithm, the new method uses the motion vectors correction (MVC) first. Then joint spatial-temporal position prediction algorithm is applied on the transmitted MVs to predict more accurately the positions the interpolated blocks really move to, which makes the MVs used for interpolation more nearer to the true motion. Then the weighted-adaptive spatial-temporal MCI algorithm is used to complete the final interpolation. Applied to the H.264 decoder, the new proposed method can achieve significant increase on PSNR and obvious decrease of the block artifacts, which can be widely used in video streaming and distributed video coding applications.

[1]  Rae-Hong Park,et al.  Weighted-adaptive motion-compensated frame rate up-conversion , 2003, IEEE Trans. Consumer Electron..

[2]  Truong Q. Nguyen,et al.  Motion vector processing for frame rate up conversion , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Sun-Yuan Kung,et al.  Frame-rate up-conversion using transmitted true motion vectors , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[4]  Lifeng Sun,et al.  Position prediction motion-compensated interpolation for frame rate up-conversion using temporal modeling , 2005, IEEE International Conference on Image Processing 2005.

[5]  Satoshi Kondo,et al.  Frame-rate up-conversion using reliable analysis of transmitted motion information , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Tao Chen Adaptive temporal interpolation using bidirectional motion estimation and compensation , 2002, Proceedings. International Conference on Image Processing.

[7]  Sung-Jea Ko,et al.  New frame rate up-conversion using bi-directional motion estimation , 2000, IEEE Trans. Consumer Electron..

[8]  Luis Torres,et al.  Iterative generation of motion-compensated side information for distributed video coding , 2005, IEEE International Conference on Image Processing 2005.