Video coding using arbitrarily shaped block partitions in globally optimal perspective

Algorithms using content-based patterns to segment moving regions at the macroblock (MB) level have exhibited good potential for improved coding efficiency when embedded into the H.264 standard as an extra mode. The content-based pattern generation (CPG) algorithm provides local optimal result as only one pattern can be optimally generated from a given set of moving regions. But, it failed to provide optimal results for multiple patterns from entire sets. Obviously, a global optimal solution for clustering the set and then generation of multiple patterns enhances the performance farther. But a global optimal solution is not achievable due to the non-polynomial nature of the clustering problem. In this paper, we propose a near-optimal content-based pattern generation (OCPG) algorithm which outperforms the existing approach. Coupling OCPG, generating a set of patterns after clustering the MBs into several disjoint sets, with a direct pattern selection algorithm by allowing all the MBs in multiple pattern modes outperforms the existing pattern-based coding when embedded into the H.264.

[1]  Bu-Sung Lee,et al.  Direct Intermode Selection for H.264 Video Coding Using Phase Correlation , 2011, IEEE Transactions on Image Processing.

[2]  Xin Li,et al.  Geometry-Adaptive Block Partitioning for Video Coding , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[3]  Mohammed Ghanbari,et al.  Heterogeneous Video Transcoding to Lower Spatio-Temporal Resolutions and Different Encoding Formats , 2000, IEEE Trans. Multim..

[4]  Tokumichi Murakami,et al.  Very low bit-rate video coding with block partitioning and adaptive selection of two time-differential frame memories , 1997, IEEE Trans. Circuits Syst. Video Technol..

[5]  Thomas Wiegand,et al.  Lagrange multiplier selection in hybrid video coder control , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[6]  Antonio Ortega,et al.  Motion compensation based on implicit block segmentation , 2008, 2008 15th IEEE International Conference on Image Processing.

[7]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[8]  K. Rijkse,et al.  H.263: video coding for low-bit-rate communication , 1996, IEEE Commun. Mag..

[9]  Weisi Lin,et al.  Analysis of the H.264 advanced video coding standard and an associated rate control scheme , 2008, J. Electronic Imaging.

[10]  Manoranjan Paul,et al.  Video Coding Focusing on Block Partitioning and Occlusion , 2010, IEEE Transactions on Image Processing.

[11]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[12]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[13]  Kin-Man Lam,et al.  An efficient low bit-rate video-coding algorithm focusing on moving regions , 2001, IEEE Trans. Circuits Syst. Video Technol..

[14]  W. Peizhuang Pattern Recognition with Fuzzy Objective Function Algorithms (James C. Bezdek) , 1983 .

[15]  Petros Maragos,et al.  Tutorial On Advances In Morphological Image Processing And Analysis , 1986, Other Conferences.

[16]  Brian W. Kernighan,et al.  An Effective Heuristic Algorithm for the Traveling-Salesman Problem , 1973, Oper. Res..

[17]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[18]  Manoranjan Paul,et al.  A real-time pattern selection algorithm for very low bit-rate video coding using relevance and similarity metrics , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Petros Maragos,et al.  Tutorial on advances in morphological image processing and analysis (Invited Paper) , 1987 .

[20]  M. Murshed,et al.  Superior VLBR video coding using pattern template for moving objects instead of variable block-size in H.264 , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..

[21]  Manoranjan Paul,et al.  An Optimal Content-Based Pattern Generation Algorithm , 2007, IEEE Signal Processing Letters.

[22]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[23]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[24]  J. C. Dunn,et al.  A Fuzzy Relative of the ISODATA Process and Its Use in Detecting Compact Well-Separated Clusters , 1973 .

[25]  Xiaoyang Wu,et al.  L-shaped segmentations in motion-compensated prediction of H.264 , 2008, 2008 IEEE International Symposium on Circuits and Systems.