A Segmentation-Based Chroma Intra Prediction Coding Scheme for H.264/AVC

In this paper, we propose a novel segmentation-based intra prediction coding scheme for low-bitrate video coding. Different coding schemes are separately designed for the luma and chroma components in our proposed method. The traditional block-based coding scheme is still used for the luma components, and the segmentation-based coding scheme is developed for the chroma components. The segmentation operation is used for the reconstructed luma components, which groups similar pixels together and produces a set of homogenous regions. Here, these local and homogenous regions are referred to superpixels. By utilizing the spatial correlation between the luma and chroma planes, we transfer the segmentation result of the luma components to the chroma components, which will not induce any side information in the chroma intra prediction coding. Instead of using the macroblock (MB) as the coding unit, the proposed method implements the chroma intra prediction in each superpixel, and the original pixels in each superpixel are employed to substitute the neighboring reconstructed samples in the prediction process. The experimental results show that the proposed method can achieve an average 0.20 dB and up to 0.63 dB coding gains in comparison to the directional intra prediction scheme for H.264/AVC low-bitrate video coding.

[1]  Marta Karczewicz,et al.  Improved h.264 intra coding based on bi-directional intra prediction, directional transform, and adaptive coefficient scanning , 2008, 2008 15th IEEE International Conference on Image Processing.

[2]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  King Ngi Ngan,et al.  A Co-Saliency Model of Image Pairs , 2011, IEEE Transactions on Image Processing.

[4]  Gary J. Sullivan,et al.  Comparison of the Coding Efficiency of Video Coding Standards—Including High Efficiency Video Coding (HEVC) , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Eduardo A. B. da Silva,et al.  Multiscale recurrent pattern image coding with a flexible partition scheme , 2008, 2008 15th IEEE International Conference on Image Processing.

[6]  King Ngi Ngan,et al.  Image Cosegmentation by Incorporating Color Reward Strategy and Active Contour Model , 2013, IEEE Transactions on Cybernetics.

[7]  Thiow Keng Tan,et al.  Intra Prediction by Template Matching , 2006, 2006 International Conference on Image Processing.

[8]  King Ngi Ngan,et al.  Fast and Efficient Method for Block Edge Classification and Its Application in H.264/AVC Video Coding , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  King Ngi Ngan,et al.  Object Co-Segmentation Based on Shortest Path Algorithm and Saliency Model , 2012, IEEE Transactions on Multimedia.

[10]  Mourad Ouaret,et al.  On comparing JPEG2000 and intraframe AVC , 2006, SPIE Optics + Photonics.

[11]  Susanto Rahardja,et al.  Chroma intra prediction using template matching with reconstructed luma components , 2011, 2011 18th IEEE International Conference on Image Processing.

[12]  Yo-Sung Ho,et al.  Line-by-line intra 16×16 prediction for high-quality video coding , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[13]  Yo-Sung Ho,et al.  Implicit Line-Based Intra 16×16 Prediction for H.264/AVC High-Quality Video Coding , 2012, Circuits Syst. Signal Process..

[14]  King Ngi Ngan,et al.  FaceSeg: Automatic Face Segmentation for Real-Time Video , 2009, IEEE Transactions on Multimedia.

[15]  Hongliang Li,et al.  Mode dependent down-sampling and interpolation scheme for high efficiency video coding , 2013, Signal Process. Image Commun..

[16]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[17]  Hyun Wook Park,et al.  Adaptive Interpolation-Based Divide-and-Predict Intra Coding for H.264/AVC , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Thomas Wiegand,et al.  Lagrange multiplier selection in hybrid video coder control , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[19]  Ashraf A. Kassim,et al.  3D Color Set Partitioning in Hierarchical Trees , 2009, Circuits Syst. Signal Process..

[20]  Thomas B. Moeslund,et al.  Long-Term Occupancy Analysis Using Graph-Based Optimisation in Thermal Imagery , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Minh N. Do,et al.  On the compression of two-dimensional piecewise smooth functions , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[22]  Tom E. Bishop,et al.  Blind Image Restoration Using a Block-Stationary Signal Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[23]  Iain E. G. Richardson,et al.  The H.264 Advanced Video Compression Standard , 2010 .

[24]  Ashraf A. Kassim,et al.  Performance of the color set partitioning in hierarchical tree scheme (CSPIHT) in video coding , 2001 .

[25]  David R. Bull,et al.  Projective image restoration using sparsity regularization , 2013, 2013 IEEE International Conference on Image Processing.

[26]  Trac D. Tran,et al.  Performance comparison of JPEG2000 and H.264/AVC high profile intra-frame coding on HD video sequences , 2006, SPIE Optics + Photonics.

[27]  Stefano Soatto,et al.  Class segmentation and object localization with superpixel neighborhoods , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[28]  Wen Gao,et al.  Position dependent linear intra prediction for image coding , 2010, 2010 IEEE International Conference on Image Processing.

[29]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[30]  King Ngi Ngan,et al.  Saliency model-based face segmentation and tracking in head-and-shoulder video sequences , 2008, J. Vis. Commun. Image Represent..

[31]  Dong Liu,et al.  Edge-Oriented Uniform Intra Prediction , 2008, IEEE Transactions on Image Processing.

[32]  Xin Li,et al.  Geometry-Adaptive Block Partitioning for Video Coding , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[33]  Ik-Hwan Cho,et al.  New intra luma prediction mode in H.264/AVC using collocated weighted chroma pixel value , 2006, Electronic Imaging.

[34]  Iain E. Richardson,et al.  The H.264 Advanced Video Compression Standard: Richardson/The H.264 Advanced Video Compression Standard , 2010 .

[35]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[36]  Umar Mohammed,et al.  Superpixel lattices , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  F C Billingsley,et al.  Applications of digital image processing. , 1970, Applied optics.

[38]  Hongliang Li,et al.  An efficient intra-mode selection algorithm for H.264 based on edge classification and rate-distortion estimation , 2008, Signal Process. Image Commun..

[39]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.