Region-of-interest based dynamical parameter allocation for H.264/AVC encoder

Since H.264 is a high performance coding standard in with high computational requirements, it is hard to implement on portable devices. According to the human visual system (HVS) research, human eyes can only focus on one area in a frame, which is called region-of-interest (ROI). This phenomenon gives a chance to code all macroblocks unequally. In this work, the ROI is detected using texture contrast and motion features. This detector uses a simple scheme to meet the low power requirement of portable application. After getting ROI, coding parameters, in terms of search ranges, and valid modes, are allocated in ROI and non-ROI respectively. This strategy reduces the coding complexity and keeps the visual quality. The ROI detector and the encoder are designed to be decoding-friendly and hardware-friendly.

[1]  Weisi Lin,et al.  Modeling visual attention's modulatory aftereffects on visual sensitivity and quality evaluation , 2005, IEEE Transactions on Image Processing.

[2]  Tien-Ying Kuo,et al.  Dynamic Search Range Control for H.264 , 2007, Ninth IEEE International Symposium on Multimedia Workshops (ISMW 2007).

[3]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[4]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[5]  Benjamin B. Bederson,et al.  Automatic thumbnail cropping and its effectiveness , 2003, UIST '03.

[6]  Xiang Li,et al.  Fast multi-frame motion estimation algorithm with adaptive search strategies in H.264 , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[7]  Zhengguo Li,et al.  Region-of-Interest Based Resource Allocation for Conversational Video Communication of H.264/AVC , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Christof Koch,et al.  Comparison of feature combination strategies for saliency-based visual attention systems , 1999, Electronic Imaging.

[9]  Luca Fanucci,et al.  Dynamic control of motion estimation search parameters for low complex H.264 video coding , 2006, IEEE Transactions on Consumer Electronics.

[10]  Tien-Ying Kuo,et al.  Dynamic Search Range Control for H.264 , 2007, ISM 2007.