A frame rate up-conversion method with quadruple motion vector post-processing

We propose a frame rate up-conversion method with quadruple motion vector post-processing scheme (QMVPS). By considering occlusion and hole problems, we adopt the hybrid motion estimation (ME) method which is a combination of bilateral ME and unilateral ME in both directions. To produce better quality-interpolated frames, the motion vector (MV) outliers of the both unilateral MV fields are detected and corrected by prior-information-based MV refining method and the bilateral MV field is smoothed by using vector extrapolation and weighted summation. Moreover, the selection and determination criterion, which is composed of matching ratio of blocks and ladder-style analysis, is proposed to select and decide the denser bilateral MV field. Experimental results verify the superiority of our work in both objective and subjective performances compared with other conventional ME and MV post-processing methods.

[1]  Kyoung-Rok Cho,et al.  Motion Compensated Frame Rate Up-Conversion Using Extended Bilateral Motion Estimation , 2007, IEEE Transactions on Consumer Electronics.

[2]  Truong Q. Nguyen,et al.  A Multistage Motion Vector Processing Method for Motion-Compensated Frame Interpolation , 2008, IEEE Transactions on Image Processing.

[3]  Yücel Altunbasak,et al.  Novel True-Motion Estimation Algorithm and Its Application to Motion-Compensated Temporal Frame Interpolation , 2013, IEEE Transactions on Image Processing.

[4]  Zhiyong Gao,et al.  Frame Rate Up-Conversion Method for Video Processing Applications , 2014, IEEE Transactions on Broadcasting.

[5]  Jaeseok Kim,et al.  Motion compensated frame interpolation by new block-based motion estimation algorithm , 2004, IEEE Trans. Consumer Electron..

[6]  Truong Q. Nguyen,et al.  Subpixel motion estimation without interpolation , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[7]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[8]  Wenjun Zhang,et al.  Temporal compensated motion estimation with simple block-based prediction , 2003, IEEE Trans. Broadcast..

[9]  Chang-Su Kim,et al.  Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Suk-Ju Kang,et al.  Multiframe-based bilateral motion estimation with emphasis on stationary caption processing for frame rate up-conversion , 2008, IEEE Transactions on Consumer Electronics.

[11]  Truong Q. Nguyen,et al.  Motion vector processing for frame rate up conversion , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Taehyeun Ha,et al.  Motion compensated frame interpolation by new block-based motion estimation algorithm , 2004, IEEE Transactions on Consumer Electronics.

[13]  Hyun-Soo Kang,et al.  Frame rate up-conversion method based on texture adaptive bilateral motion estimation , 2014, IEEE Transactions on Consumer Electronics.

[14]  Young Hwan Kim,et al.  Direction-Select Motion Estimation for Motion-Compensated Frame Rate Up-Conversion , 2013, Journal of Display Technology.

[15]  Wenbo Wan,et al.  An improved FRUC scheme based on motion vector refinement , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[16]  Lei Zhang,et al.  Frame Rate Up-Conversion Using Trilateral Filtering , 2010, IEEE Transactions on Circuits and Systems for Video Technology.