Hardware-efficient true motion estimator based on Markov Random Field motion vector correction

True motion estimation is a well-known technique to find the true object motion trajectory in a video, and it has a lot of applications in computer vision and display systems. However, if the target frame size becomes large, many new design challenges are introduced, such as huge computation, large bandwidth and large on-chip SRAM size requirements. Within the consideration of both algorithm and architecture, we develop a true motion estimator with ±128x±128 search range for video systems with Full-HD (1920×1080) resolution. The PSNR evaluation shows that our algorithm is better than other three existing algorithms. For hardware implementation, we use Verilog-HDL and synthesize it by SYNOPSIS Design Compiler with UMC 90nm cell library. The implementation works at 300MHz frequency, and it shows that there are total 76% bandwidth reduction, 66% cycle reduction and 88% on-chip SRAM reduction with the proposed ping-pong two-way scheduling and motion vector grouping techniques.

[1]  Demin Wang,et al.  Motion-Compensated Frame Rate Up-Conversion—Part I: Fast Multi-Frame Motion Estimation , 2010, IEEE Transactions on Broadcasting.

[2]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[3]  Xiqi Gao,et al.  A multilevel successive elimination algorithm for block matching motion estimation , 2000, IEEE Trans. Image Process..

[4]  Shao-Yi Chien,et al.  Frame rate up-conversionwith global-to-local iterative motion compensated interpolation , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[5]  Alexis M. Tourapis,et al.  Enhanced predictive zonal search for single and multiple frame motion estimation , 2002, IS&T/SPIE Electronic Imaging.

[6]  Yi-Nung Liu,et al.  Motion blur reduction of liquid crystal displays using perception-aware motion compensated frame rate up-conversion , 2011, 2011 IEEE Workshop on Signal Processing Systems (SiPS).

[7]  Richard Szeliski,et al.  A Comparative Study of Energy Minimization Methods for Markov Random Fields , 2006, ECCV.

[8]  Yi-Nung Liu,et al.  MRF-based true motion estimation using H.264 decoding information , 2010, 2010 IEEE Workshop On Signal Processing Systems.

[9]  Bing Zeng,et al.  A new three-step search algorithm for block motion estimation , 1994, IEEE Trans. Circuits Syst. Video Technol..

[10]  J.-L. Wu,et al.  Quality Enhancement of Frame Rate Up-Converted Video by Adaptive Frame Skip and Reliable Motion Extraction , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Gerard de Haan,et al.  True-motion estimation with 3-D recursive search block matching , 1993, IEEE Trans. Circuits Syst. Video Technol..

[12]  Richard Szeliski,et al.  A Comparative Study of Energy Minimization Methods for Markov Random Fields with Smoothness-Based Priors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Chein-Wei Jen,et al.  On the data reuse and memory bandwidth analysis for full-search block-matching VLSI architecture , 2002, IEEE Trans. Circuits Syst. Video Technol..

[14]  Wenjun Zhang,et al.  Temporal compensated motion estimation with simple block-based prediction , 2003, IEEE Trans. Broadcast..