Parallel-Friendly Frame Rate Up-Conversion Algorithm Based on Patch Match

In this paper, we propose a parallel-friendly frame rate up-conversion (FRUC) algorithm based on the patch match. The key points of the algorithm are the generation of self-similarity patch, parallel true motion estimation and motion vectors post-processing dealing with occlusion problem. Our algorithm is fully parallel at each step and can be implemented on GPU. The GPU implementation achieves up to 48 times speedup over its CPU implementation. Compared with the traditional FRUC algorithm based on 3-D Recursive Search, our algorithm has a good performance in handling the fine motion structure and occlusion problem.

[1]  Gerard de Haan,et al.  True-motion estimation using feature correspondences , 2004, IS&T/SPIE Electronic Imaging.

[2]  HyunWook Park,et al.  An Efficient Motion-Compensated Frame Interpolation Method Using Temporal Information for High-Resolution Videos , 2015, Journal of Display Technology.

[3]  Giancarlo Calvagno,et al.  A parallel true motion estimation method based on binarized cross correlation , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[4]  Carsten Rother,et al.  Fast Cost-Volume Filtering for Visual Correspondence and Beyond , 2013, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Moon-Cheol Kim,et al.  Fourier-Domain Analysis of Display Pixel Structure for Image Quality , 2016, Journal of Display Technology.

[6]  Li Chen,et al.  Parallel-Friendly Patch Match Based on Jump Flooding , 2012, IFTC.

[7]  Tiow Seng Tan,et al.  Jump flooding in GPU with applications to Voronoi diagram and distance transform , 2006, I3D '06.

[8]  Hailin Jin,et al.  Fast Edge-Preserving PatchMatch for Large Displacement Optical Flow , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Giancarlo Calvagno,et al.  A true motion estimation method based on binarized cross correlation , 2013, 2013 IEEE Third International Conference on Consumer Electronics ¿ Berlin (ICCE-Berlin).

[10]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[11]  Adam Finkelstein,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, SIGGRAPH 2009.

[12]  Zhiyong Gao,et al.  Frame Rate Up-Conversion Method for Video Processing Applications , 2014, IEEE Transactions on Broadcasting.