Adapting hierarchical bidirectional inter prediction on a GPU-based platform for 2D and 3D H.264 video coding

The H.264/AVC video coding standard introduces some improved tools in order to increase compression efficiency. Moreover, the multi-view extension of H.264/AVC, called H.264/MVC, adopts many of them. Among the new features, variable block-size motion estimation is one which contributes to high coding efficiency. Furthermore, it defines a different prediction structure that includes hierarchical bidirectional pictures, outperforming traditional Group of Pictures patterns in both scenarios: single-view and multi-view. However, these video coding techniques have high computational complexity. Several techniques have been proposed in the literature over the last few years which are aimed at accelerating the inter prediction process, but there are no works focusing on bidirectional prediction or hierarchical prediction. In this article, with the emergence of many-core processors or accelerators, a step forward is taken towards an implementation of an H.264/AVC and H.264/MVC inter prediction algorithm on a graphics processing unit. The results show a negligible rate distortion drop with a time reduction of up to 98% for the complete H.264/AVC encoder.

[1]  Wen Gao,et al.  A novel VLSI architecture of motion compensation for multiple standards , 2008, IEEE Transactions on Consumer Electronics.

[2]  Choudhury A. Rahman,et al.  UMHexagonS algorithm based motion estimation architecture for H.264/AVC , 2005, Fifth International Workshop on System-on-Chip for Real-Time Applications (IWSOC'05).

[3]  Rüdiger Westermann,et al.  Linear algebra operators for GPU implementation of numerical algorithms , 2003, SIGGRAPH Courses.

[4]  Aljoscha Smolic,et al.  Efficient Prediction Structures for Multiview Video Coding , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Iain E. G. Richardson,et al.  The H.264 Advanced Video Compression Standard , 2010 .

[6]  Oscar C. Au,et al.  Video Coding on Multicore Graphics Processors , 2010, IEEE Signal Processing Magazine.

[7]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[8]  Liang-Gee Chen,et al.  Content-Aware Prediction Algorithm With Inter-View Mode Decision for Multiview Video Coding , 2008, IEEE Transactions on Multimedia.

[9]  Gary Sullivan,et al.  Recommended Simulation Common Conditions for H.26L Coding Efficiency Experiments on Low Resolution Progressive Scan Source Material , 2001 .

[10]  Gary J. Sullivan,et al.  Overview of the Stereo and Multiview Video Coding Extensions of the H.264/MPEG-4 AVC Standard , 2011, Proceedings of the IEEE.

[11]  Hsueh-Ming Hang,et al.  Multiview encoder parallelized fast search realization on NVIDIA CUDA , 2011, 2011 Visual Communications and Image Processing (VCIP).

[12]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Harry Shum,et al.  Accelerate Video Decoding With Generic GPU , 2005, IEEE Trans. Circuits Syst. Video Technol..

[14]  Youn-Long Lin,et al.  A hardware accelerator for H.264/AVC motion compensation , 2005, IEEE Workshop on Signal Processing Systems Design and Implementation, 2005..

[15]  José Luis Martínez,et al.  H.264/AVC inter prediction on accelerator-based multi-core systems , 2013, Multimedia Tools and Applications.

[16]  Heiko Schwarz,et al.  Analysis of Hierarchical B Pictures and MCTF , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[17]  Zhipin Deng,et al.  Fast motion and disparity estimation for multiview video coding , 2010, Frontiers of Computer Science in China.

[18]  Hongyuan Zha,et al.  Inferring users' image-search goals with pseudo-images , 2011, 2011 Visual Communications and Image Processing (VCIP).

[19]  Ming Li,et al.  Scalable prediction structure for multiview video coding , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[20]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Shao-Yi Chien,et al.  Multi-Pass and Frame Parallel Algorithms of Motion Estimation in H.264/AVC for Generic GPU , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[22]  Hsueh-Ming Hang,et al.  H.264/AVC motion estimation implmentation on Compute Unified Device Architecture (CUDA) , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[23]  Iain E. Richardson,et al.  The H.264 Advanced Video Compression Standard: Richardson/The H.264 Advanced Video Compression Standard , 2010 .

[24]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[25]  Itu-T and Iso Iec Jtc Advanced video coding for generic audiovisual services , 2010 .

[26]  Zhi Liu,et al.  Selective Disparity Estimation and Variable Size Motion Estimation Based on Motion Homogeneity for Multi-View Coding , 2009, IEEE Transactions on Broadcasting.

[27]  Dinesh Manocha,et al.  High-performance computing using accelerators , 2007, Parallel Comput..

[28]  Mauro Barni,et al.  dsp Forum - Future of Video Coding and Transmission , 2006, IEEE Signal Processing Magazine.