An improved FRUC scheme based on motion vector refinement

In this paper, a low-complexity and high-efficiency scheme is developed for frame rate up conversion (FRUC). Texture based adaptive motion estimation is carried out for improving the accuracy of motion vectors. In addition, the proposed scheme comprises a motion vector post-processing method which corrects the outliers in nine directions. Moreover, in order to deal with the artifacts caused by the problem of overlaps and holes, a simple motion refinement method by calculating motion vectors of overlaps and holes is proposed. Experimental results verify the superiority of our work in both objective and subjective performances compared with conventional methods.

[1]  Luciano Alparone,et al.  Adaptively weighted vector-median filters for motion-fields smoothing , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[2]  Truong Q. Nguyen,et al.  Subpixel motion estimation without interpolation , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Ju Liu,et al.  Key frames-based video super-resolution using adaptive overlapped block motion compensation , 2012, Proceedings of the 10th World Congress on Intelligent Control and Automation.

[4]  Michael T. Orchard,et al.  Overlapped block motion compensation: an estimation-theoretic approach , 1994, IEEE Trans. Image Process..

[5]  T.Q. Nguyen,et al.  Smooth motion vector resampling for standard compatible video post-processing , 2004, Conference Record of the Thirty-Eighth Asilomar Conference on Signals, Systems and Computers, 2004..

[6]  Lei Zhang,et al.  Frame Rate Up-Conversion Using Trilateral Filtering , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Wen Gao,et al.  Multiple Hypotheses Bayesian Frame Rate Up-Conversion by Adaptive Fusion of Motion-Compensated Interpolations , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Truong Q. Nguyen,et al.  Fast one-pass motion compensated frame interpolation in high-definition video processing , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[9]  Chang-Su Kim,et al.  Motion-Compensated Frame Interpolation Using Bilateral Motion Estimation and Adaptive Overlapped Block Motion Compensation , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[11]  Demin Wang,et al.  Motion-Compensated Frame Rate Up-Conversion—Part II: New Algorithms for Frame Interpolation , 2010, IEEE Transactions on Broadcasting.

[12]  Jenny Benois-Pineau,et al.  A New Method for Region-Based Depth Ordering in a Video Sequence: Application to Frame Interpolation , 2002, J. Vis. Commun. Image Represent..

[13]  Bei-Ji Zou,et al.  Enhanced Hexagonal-Based Search Using Direction-Oriented Inner Search for Motion Estimation , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Ce Liu,et al.  Exploring new representations and applications for motion analysis , 2009 .

[15]  J.-L. Wu,et al.  Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Liang-Gee Chen,et al.  One-dimensional full search motion estimation algorithm for video coding , 1994, IEEE Trans. Circuits Syst. Video Technol..

[17]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.