Computation-constrained dynamic search range control for real-time video encoder

Search range (SR) is a key parameter on the search quality control for motion estimation (ME) of a real-time video encoder. Dynamic search range (DSR) is a commonly employed algorithm to reduce the computational complexity of ME in a video encoder. In this paper, we model an effective predicted motion vector (PMV) deviation metric to predict the relationship between SR and motion vector difference (MVD), according to the prediction differences of both temporal and spatial motions of neighboring blocks. In addition, a computation-constrained DSR (CDSR) control algorithm is proposed to manage the computational complexity while maximizing video coding quality in a real-time computational constrained scenario. The SR is dynamically determined by three factors: motion complexity, user-defined probability and computation budget. Compared to the conventional DSR algorithms, the proposed CDSR is an effective and quantifiable algorithm to allocate more computation budget to the blocks with high PMV deviations (such as motion object boundary), and less computation budget to the well-matched motion predicted blocks, while maintaining a constrained computation requirement. Experimental results show that the proposed CDSR control algorithm is an effective method to manage the computation consumption of the DSR algorithm while keeping similar rate-distortion (RD) performance. It can achieve about 0.1-0.3dB average PSNR improvement when the computation consumption is restricted to a specific level as compared with its equivalent Fixed SR algorithm and can achieve about 50-90% computation savings when compared to the benchmarks. For ME with high performance Processing Element (PE) engine, the quality degradation caused by the proposed CDSR algorithm can be ignored. Proposed an effective metric to model the relationship between SR and MVD.Proposed a linear model for computational complexity prediction.Proposed a quantifiable computation-constrained DSR control algorithm.

[1]  Thomas Sikora,et al.  MPEG digital video-coding standards , 1997, IEEE Signal Process. Mag..

[2]  Lin Sun,et al.  Adaptive search range algorithm based on Cauchy distribution , 2012, 2012 Visual Communications and Image Processing.

[3]  Liang-Gee Chen,et al.  Survey on Block Matching Motion Estimation Algorithms and Architectures with New Results , 2006, J. VLSI Signal Process..

[4]  Liang-Gee Chen,et al.  Level C+ data reuse scheme for motion estimation with corresponding coding orders , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Yasuhiro Takishima,et al.  Dual-path block size decision for fast motion search in H.264/AVC , 2005, Visual Communications and Image Processing.

[6]  Hsueh-Ming Hang,et al.  Modeling of Pattern-Based Block Motion Estimation and Its Application , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Chein-Wei Jen,et al.  On the data reuse and memory bandwidth analysis for full-search block-matching VLSI architecture , 2002, IEEE Trans. Circuits Syst. Video Technol..

[8]  Liang-Gee Chen,et al.  Analysis and architecture design of variable block-size motion estimation for H.264/AVC , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[9]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[10]  Liang-Gee Chen,et al.  Cache-based integer motion/disparity estimation for quad-HD H.264/AVC and HD multiview video coding , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  J. Peacock.  Two-dimensional goodness-of-fit testing in astronomy , 1983 .

[12]  Kosuke Saito,et al.  Adaptive Search Range Motion Estimation Algorithm for H.264/AVC , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[13]  Chein-Wei Jen,et al.  An efficient quality-aware memory controller for multimedia platform SoC , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Wen Gao,et al.  A Hardware-Efficient Multi-Resolution Block Matching Algorithm and its VLSI Architecture for High Definition MPEG-Like Video Encoders , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Wen Guo,et al.  Improved FFSBM algorithm and its VLSI architecture for variable block size motion estimation of H.264 , 2005, 2005 International Symposium on Intelligent Signal Processing and Communication Systems.

[16]  Nuno Roma,et al.  Efficient and configurable full-search block-matching processors , 2002, IEEE Trans. Circuits Syst. Video Technol..

[17]  Jo Yew Tham,et al.  A novel unrestricted center-biased diamond search algorithm for block motion estimation , 1998, IEEE Trans. Circuits Syst. Video Technol..

[18]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[19]  Lap-Pui Chau,et al.  Hexagon-based search pattern for fast block motion estimation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[20]  Yücel Altunbasak,et al.  Frame bit allocation for the H.264/AVC video coder via Cauchy-density-based rate and distortion models , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Rabab Kreidieh Ward,et al.  Efficient motion estimation using spatial and temporal motion vector prediction , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[22]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[23]  Soontorn Oraintara,et al.  Complexity comparison of fast block-matching motion estimation algorithms , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[24]  Liang-Gee Chen,et al.  Analysis and architecture design of an HDTV720p 30 frames/s H.264/AVC encoder , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  John V. McCanny,et al.  A VLSI architecture for variable block size video motion estimation , 2004, IEEE Transactions on Circuits and Systems II: Express Briefs.

[26]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..

[27]  Masao Ikekawa,et al.  Fast and accurate motion estimation algorithm by adaptive search range and shape selection , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[28]  Qing Liu,et al.  Application of topology abstraction techniques in multi-domain optical networks , 2006, Proceedings of 15th International Conference on Computer Communications and Networks.

[29]  Zhan Ma,et al.  Adaptive Motion Vector Prediction Based on Spatiotemporal Correlation , 2006, 2006 International Conference on Wireless Communications, Networking and Mobile Computing.

[30]  Liang-Gee Chen,et al.  A 212 MPixels/s 4096 $\times$ 2160p Multiview Video Encoder Chip for 3D/Quad Full HDTV Applications , 2010, IEEE Journal of Solid-State Circuits.

[31]  Si-Woong Lee,et al.  Adaptive search range motion estimation using neighboring motion vector differences , 2011, IEEE Transactions on Consumer Electronics.

[32]  C.-C. Jay Kuo,et al.  Motion vector search window prediction in memory-constrained systems , 2009, Optical Engineering + Applications.

[33]  S. Mochizuki,et al.  A 64 mW High Picture Quality H.264/MPEG-4 Video Codec IP for HD Mobile Applications in 90 nm CMOS , 2008, IEEE Journal of Solid-State Circuits.

[34]  C.-C. Jay Kuo,et al.  Adaptive Motion Search Range Prediction for Video Encoding , 2010, IEEE Transactions on Circuits and Systems for Video Technology.