An Efficient Motion-Compensated Frame Interpolation Method Using Temporal Information for High-Resolution Videos

High-resolution (HR) videos have many different properties from low-resolution videos in terms of motion vectors (MVs) and occlusions. Therefore, it is necessary to develop an optimized motion-compensated frame interpolation (MCFI) method for HR videos. This paper proposes an MCFI method for HR videos that uses a hierarchical motion estimation composed of a modified 3-D recursive search and motion refinement using temporal MV smoothness. In addition, a robust frame interpolation method is proposed that assigns accurate MVs to the intermediate frame. The experimental results confirm that the proposed method outperforms previous MCFI methods in terms of the quality of the intermediate frames.

[1]  Yücel Altunbasak,et al.  Novel True-Motion Estimation Algorithm and Its Application to Motion-Compensated Temporal Frame Interpolation , 2013, IEEE Transactions on Image Processing.

[2]  Yongmin Kim,et al.  Using motion-compensated frame-rate conversion for the correction of 3: 2 pulldown artifacts in video sequences , 2000, IEEE Trans. Circuits Syst. Video Technol..

[3]  Chang-Su Kim,et al.  Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[5]  Lei Zhang,et al.  Frame Rate Up-Conversion Using Trilateral Filtering , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Gerard de Haan,et al.  Optimization of Hierarchical 3DRS Motion Estimators for Picture Rate Conversion , 2011, IEEE Journal of Selected Topics in Signal Processing.

[7]  Mert Cetin,et al.  An adaptive true motion estimation algorithm for frame rate conversion of high definition video and its hardware implementations , 2011, IEEE Transactions on Consumer Electronics.

[8]  Hyun Wook Park,et al.  A Symmetric Motion Estimation Method for Motion-Compensated Frame Interpolation , 2011, IEEE Transactions on Image Processing.

[9]  Taehyeun Ha,et al.  Motion compensated frame interpolation by new block-based motion estimation algorithm , 2004, IEEE Transactions on Consumer Electronics.

[10]  Truong Q. Nguyen,et al.  Correlation-Based Motion Vector Processing With Adaptive Interpolation Scheme for Motion-Compensated Frame Interpolation , 2009, IEEE Transactions on Image Processing.

[11]  Truong Q. Nguyen,et al.  Subpixel motion estimation without interpolation , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  G. Eichmann,et al.  Vector median filters , 1987 .

[13]  Truong Q. Nguyen,et al.  A Novel Approach to FRUC Using Discriminant Saliency and Frame Segmentation , 2010, IEEE Transactions on Image Processing.

[14]  Hyun Wook Park,et al.  Iterative True Motion Estimation for Motion-Compensated Frame Interpolation , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Jeffrey S. McVeigh,et al.  Intermediate view synthesis considering occluded and ambiguously referenced image regions , 1996, Signal Process. Image Commun..

[16]  Victor H. S. Ha,et al.  Portable receivers for digital multimedia broadcasting , 2004, IEEE Transactions on Consumer Electronics.

[17]  Suk-Ju Kang,et al.  Multiframe-based bilateral motion estimation with emphasis on stationary caption processing for frame rate up-conversion , 2008, IEEE Transactions on Consumer Electronics.