Early Termination and Pipelining for Hardware Implementation of Fast H.264 Intraprediction Targeting Mobile HD Applications

H.264/AVC adopts aggressive compression algorithms at the cost of increased computational complexity. To speed up the H.264/AVC intraframe coding, this paper proposes two novel techniques: early termination and pipelined execution. In P slices, intra 4×4 and 16×16 predictions are early terminated with the threshold determined by the cost of motion estimation. In I slices, intra 4×4 prediction is early terminated with the threshold derived from intra 16×16 prediction. The threshold function is chosen as a monotonically decreasing linear function with its optimal coefficients determined by experiments. For the pipelined execution of 4×4 intrapredictions, the processing order of 4×4 blocks is changed to reduce the dependencies between consecutively processed blocks. In I slices, computation for 4×4 intraprediction is reduced by 19 percent with the proposed early termination. In P slices, computations for 4×4 and 16×16 intrapredictions are reduced by more than 81 and 91 percents, respectively. The pipelined execution reduces the computation time by 41 percent. In spite of the speed-up by the proposed methods, degradation in rate-distortion performance is negligible. The proposed pipelined execution is integrated with other H.264/AVC hardware accelerators and fabricated as an SoC using Dongbu 0.13 μm technology.

[1]  Kim-Han Thung,et al.  Edge Vector Based Mode Decision for H.264/AVC Intra Prediction , 2007, First Asia International Conference on Modelling & Simulation (AMS'07).

[2]  Lai-Man Po,et al.  A fast H.264 intra prediction algorithm using macroblock properties , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[3]  Ilker Hamzaoglu,et al.  An Efficient Hardware Architecture for H.264 Intra Prediction Algorithm , 2007, 2007 Design, Automation & Test in Europe Conference & Exhibition.

[4]  Yongdong Zhang,et al.  Fast 4*4 intra-prediction mode selection for H.264 , 2004, ICME.

[5]  Li Qiang,et al.  A Fast Block Type Decision Method for H.264/AVC Intra Prediction , 2007, The 9th International Conference on Advanced Communication Technology.

[6]  King Ngi Ngan,et al.  A Fast Macroblock Mode Decision Algorithm for H.264 , 2006, APCCAS 2006 - 2006 IEEE Asia Pacific Conference on Circuits and Systems.

[7]  Jhing-Fa Wang,et al.  Efficient Intra Prediction in H.264 Based on Intensity Gradient Approach , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[8]  Liang-Gee Chen,et al.  Performance analysis of hardware oriented algorithm modifications in H.264 , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[9]  Byeungwoo Jeon,et al.  Fast Coding Mode Selection With Rate-Distortion Optimization for MPEG-4 Part-10 AVC/H.264 , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Chou-Chen Wang,et al.  Fast Intra-Mode Decision in H.264 using Interblock Correlation , 2006, 2006 International Conference on Image Processing.

[11]  Susanto Rahardja,et al.  Fast mode decision algorithm for intraprediction in H.264/AVC video coding , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Guizhong Liu,et al.  Fast Mode Decision Algorithm for Intra Prediction in H.264/AVC , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[13]  Oscar C. Au,et al.  Efficient intra-prediction algorithm in H.264 , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[14]  Qiang Peng,et al.  A Fast Transform Domain Based Algorithm for H.264/AVC Intra Prediction , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[15]  Zhang Yong-dong,et al.  Fast 4/spl times/4 intra-prediction mode selection for H.264 , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[16]  Junho Jeong,et al.  DCT Based Fast 4X4 Intra-Prediction Mode Selection , 2007, 2007 4th IEEE Consumer Communications and Networking Conference.

[17]  J.B. Song,et al.  A Novel Fast Intra Prediction Algorithm applied in H.264/AVC , 2006, 2006 8th international Conference on Signal Processing.

[18]  Liang-Gee Chen,et al.  Power-Scalable Algorithm and Reconfigurable Macro-Block Pipelining Architecture of H.264 Encoder for Mobile Application , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[19]  Liang-Gee Chen,et al.  Analysis and architecture design of an HDTV720p 30 frames/s H.264/AVC encoder , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Youn-Long Lin,et al.  A High-Performance VLSI Architecture for Intra Prediction and Mode Decision in H.264/AVC Video Encoding , 2006, APCCAS 2006 - 2006 IEEE Asia Pacific Conference on Circuits and Systems.

[21]  G. Hwang,et al.  Efficient Fast Intra Mode Decision using Transform Coefficients , 2007, The 9th International Conference on Advanced Communication Technology.

[22]  Hanjin Cho,et al.  An Efficient Hardware Architecture of Intra Prediction and TQ/IQIT Module for H.264 Encoder , 2005 .

[23]  Fangwen Fu,et al.  Fast intra prediction algorithm in H.264-AVC , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[24]  Yang Song,et al.  VLSI Oriented Fast Multiple Reference Frame Motion Estimation Algorithm for H.264/AVC , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[25]  Tian-Sheuan Chang,et al.  A 61MHz 72K Gates 1280×720 30FPS H.264 Intra Encoder , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[26]  Oscar C. Au,et al.  Efficient Intra-Prediction Mode Selection for 4x4 Blocks in H.264 , 2003 .

[27]  King Ngi Ngan,et al.  An Efficient Intra Mode Selection Algorithm For H.264 Based On Fast Edge Classification , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[28]  Rosa Lancini,et al.  Fast macroblock intra and inter modes selection for H.264/AVC , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[29]  Liang-Gee Chen,et al.  Performance analysis of hardware oriented algorithm modification in H.264 , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[30]  U. Mithun An Early Intra Mode Skipping Technique for Inter Frame Coding in H.264 BP , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[31]  Tian-Sheuan Chang,et al.  A High-Definition H.264/AVC Intra-Frame Codec IP for Digital Video and Still Camera Applications , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Jhing-Fa Wang,et al.  A novel fast algorithm for intra mode decision in H.264/AVC encoders , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[33]  Tian-Sheuan Chang,et al.  Fast block type decision algorithm for intra prediction in H.264 FRext , 2005, IEEE International Conference on Image Processing 2005.

[34]  Rui Yang,et al.  An Efficient Early Termination Algorithm of Intra Prediction for H.264/AVC , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[35]  Jhing-Fa Wang,et al.  A Simple and Robust Direction Detection Algorithm for Fast H.264 Intra Prediction , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[36]  Liang-Gee Chen,et al.  Analysis, fast algorithm, and VLSI architecture design for H.264/AVC intra frame coder , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .