SSIM-Based Game Theory Approach for Rate-Distortion Optimized Intra Frame CTU-Level Bit Allocation

A structural similarity (SSIM)-based game theory (GT) approach is proposed for rate-distortion (R-D) optimized CTU-level bit allocation in high efficiency video coding (HEVC). First, a SSIM-based bargaining game is formulated and the Nash bargaining solution (NBS) is proposed, in which a SSIM-based initial minimum utility is defined. Second, we propose a two-stage remaining bit refinement-based bit allocation scheme. The optimization scheme of the SSIM-based bargaining game sufficiently considers the different R-D characteristics of coding tree units (CTUs), in which the feasible utility set is proved to be convex based on the proposed SSIM-based utility and R-SSIM model. Compared with the other state-of-the-art CTU-level bit allocation methods, the R-D performance improvements on Bjøntegaard delta bit-rate (BD-BR), Bjøntegaard delta peak-signal-to-noise-ratio (BD-PSNR), and BD-SSIM metrics of the proposed method can averagely achieve significant gains, respectively. The achieved R-D performance gains have been very close to the coding performance limits from the FixedQP method. Moreover, the proposed SSIM-GT method also maintains good performances on quality smoothness, bit rate accuracy, and encoding complexity.

[1]  Jong-Ki Han,et al.  Rate Control for Consistent Objective Quality in High Efficiency Video Coding , 2013, IEEE Transactions on Image Processing.

[2]  J. Nash THE BARGAINING PROBLEM , 1950, Classics in Game Theory.

[3]  Yu Sun,et al.  Controlling the Bit Rate of Multi-Object Videos With Noncooperative Game Theory , 2010, IEEE Transactions on Multimedia.

[4]  Chun-Jen Tsai,et al.  Visual sensitivity guided bit allocation for video coding , 2006, IEEE Transactions on Multimedia.

[5]  Yun Zhang,et al.  Rate Distortion Optimized Inter-View Frame Level Bit Allocation Method for MV-HEVC , 2015, IEEE Transactions on Multimedia.

[6]  King Ngi Ngan,et al.  An Efficient Frame-Content Based Intra Frame Rate Control for High Efficiency Video Coding , 2015, IEEE Signal Processing Letters.

[7]  Dong-Gyu Sim,et al.  Pixel-Wise Unified Rate-Quantization Model for Multi-Level Rate Control , 2013, IEEE Journal of Selected Topics in Signal Processing.

[8]  C.-C. Jay Kuo,et al.  Rate Control Optimization for Temporal-Layer Scalable Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  C.-C. Jay Kuo,et al.  Novel Rate-Quantization Model-Based Rate Control With Adaptive Initialization for Spatial Scalable Video Coding , 2012, IEEE Transactions on Industrial Electronics.

[10]  Wen Gao,et al.  SSIM-Motivated Rate-Distortion Optimization for Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Wen Gao,et al.  Window-Level Rate Control for Smooth Picture Quality and Smooth Buffer Occupancy , 2011, IEEE Transactions on Image Processing.

[12]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Zhenzhong Chen,et al.  Rate and Power Allocation for Joint Coding and Transmission in Wireless Video Chat Applications , 2015, IEEE Transactions on Multimedia.

[14]  Wen Gao,et al.  Rate-GOP Based Rate Control for High Efficiency Video Coding , 2013, IEEE Journal of Selected Topics in Signal Processing.

[15]  Sam Kwong,et al.  DCT Coefficient Distribution Modeling and Quality Dependency Analysis Based Frame-Level Bit Allocation for HEVC , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Mihaela van der Schaar,et al.  Bargaining Strategies for Networked Multimedia Resource Management , 2007, IEEE Transactions on Signal Processing.

[17]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[18]  Michael W. Marcellin,et al.  FAST Rate Allocation for JPEG2000 Video Transmission Over Time-Varying Channels , 2013, IEEE Transactions on Multimedia.

[19]  Truong Q. Nguyen,et al.  A Frame-Level Rate Control Scheme Based on Texture and Nontexture Rate Models for High Efficiency Video Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Zhou Wang,et al.  On the Mathematical Properties of the Structural Similarity Index , 2012, IEEE Transactions on Image Processing.

[21]  Bo Yan,et al.  Efficient Frame Concealment for Depth Image-Based 3-D Video Transmission , 2012, IEEE Trans. Multimedia.

[22]  Mounir Kaaniche,et al.  Efficient Inter-View Bit Allocation Methods for Stereo Image Coding , 2015, IEEE Transactions on Multimedia.

[23]  张云 Applying Game Theory to Rate Control Optimization for Hierarchical B-pictures , 2013 .

[24]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Qionghai Dai,et al.  Joint Bit Allocation and Rate Control for Coding Multi-View Video Plus Depth Based 3D Video , 2013, IEEE Transactions on Multimedia.

[26]  Long Xu,et al.  Generalized Nash Bargaining Solution to Rate Control Optimization for Spatial Scalable Video Coding , 2014, IEEE Transactions on Image Processing.

[27]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[28]  Francesca Cuomo,et al.  An Empirical Model of Multiview Video Coding Efficiency for Wireless Multimedia Sensor Networks , 2013, IEEE Transactions on Multimedia.