Position prediction motion-compensated interpolation for frame rate up-conversion using temporal modeling

In this paper, a new motion-compensated interpolation method (MCI) for frame rate up-conversion is proposed. In conventional MCI algorithms using transmitted motion vectors (MVs), the block artifacts are caused by the unreliable MVs from the encoder. In our proposed method, motion vectors correction (MVC) is applied on the transmitted MVs before interpolation considering the spatial correlation. In consideration of the temporal correlation, generative model is used to generate the temporal-predicted MVs. Then position prediction method is applied on the transmitted MVs and the temporal-predicted MVs separately to predict the positions the interpolated blocks really move to, which makes the MVs used for interpolation nearer to the true motion. The final MVs are selected from the two candidates of position prediction by the minimum sum of absolute difference (SAD). Applied to the H.264 decoder, our proposed method achieves significant increase on PSNR and obvious decrease of the block artifacts.