SSIM-Based Global Optimization for CTU-Level Rate Control in HEVC

In this paper, we propose a coding tree unit (CTU)-level rate control scheme from the perspective of SSIM-based rate-distortion optimization to improve the coding efficiency. First, we establish the SSIM-based rate-distortion model based on the divisive normalization scheme, which characterizes the relationship between the local visual quality and the coding bits. Then, the established model is applied to the CTU-level rate control and transformed into a global optimization problem solved by convex optimization. Finally, a new model parameter updating strategy for the CTU-level rate control is presented that is robust to scene variations. Our algorithm can achieve optimal CTU-level bit allocation given the bit-rate budget. The experimental results show that our algorithm substantially enhances the coding performance and consistently outperforms both the rate control scheme in the HEVC reference software and existing algorithms in terms of rate-perceptual distortion performance using different test configurations.

[1]  Ning Wang,et al.  A new bit rate control strategy for H.264 , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[2]  Wen Gao,et al.  Perceptual Video Coding Based on SSIM-Inspired Divisive Normalization , 2013, IEEE Transactions on Image Processing.

[3]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Zhengguo Li,et al.  Adaptive Mad Prediction and Refined R-Q Model for H.264/AVC Rate Control , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[5]  Wen Gao,et al.  Adaptive rate control for High Efficiency Video Coding , 2012, 2012 Visual Communications and Image Processing.

[6]  King Ngi Ngan,et al.  Low-Delay Rate Control for Consistent Quality Using Distortion-Based Lagrange Multiplier , 2016, IEEE Transactions on Image Processing.

[7]  Bo Yan,et al.  Adaptive Distortion-Based Intra-Rate Estimation for H.264/AVC Rate Control , 2009, IEEE Signal Processing Letters.

[8]  Wen Gao,et al.  Rate control for JVT video coding scheme with HRD considerations , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[9]  Radha Poovendran,et al.  Activity Recognition Using a Combination of Category Components and Local Models for Video Surveillance , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Wen Gao,et al.  Rate-GOP Based Rate Control for High Efficiency Video Coding , 2013, IEEE Journal of Selected Topics in Signal Processing.

[11]  Yu Zhou,et al.  SSIM-Based Game Theory Approach for Rate-Distortion Optimized Intra Frame CTU-Level Bit Allocation , 2016, IEEE Transactions on Multimedia.

[12]  Houqiang Li,et al.  $\lambda $ Domain Rate Control Algorithm for High Efficiency Video Coding , 2014, IEEE Transactions on Image Processing.

[13]  Lai-Man Po,et al.  An SSIM-optimal H.264/AVC inter frame encoder , 2009, 2009 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[14]  King Ngi Ngan,et al.  An Efficient Frame-Content Based Intra Frame Rate Control for High Efficiency Video Coding , 2015, IEEE Signal Processing Letters.

[15]  Wen Gao,et al.  Lagrange multiplier based perceptual optimization for high efficiency video coding , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[16]  Qiang Wang,et al.  A novel R-Q model based rate control scheme in HEVC , 2013, 2013 Visual Communications and Image Processing (VCIP).

[17]  Sam Kwong,et al.  Joint Machine Learning and Game Theory for Rate Control in High Efficiency Video Coding. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[18]  Wen Gao,et al.  Adaptive rate control for H.264 , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[19]  Kai Zeng,et al.  SSIM-Motivated Two-Pass VBR Coding for HEVC , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Hassan Mansour,et al.  Rate and Distortion Modeling of CGS Coded Scalable Video Content , 2011, IEEE Transactions on Multimedia.

[21]  Dayong Wang,et al.  Effective macroblock layer rate control algorithm for H.264/AVC , 2011, Comput. Electr. Eng..

[22]  Yongdong Zhang,et al.  High Efficiency Video Coding: High Efficiency Video Coding , 2014 .

[23]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[24]  Hai-Miao Hu,et al.  Region-based intra-frame rate-control scheme for High Efficiency Video Coding , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[25]  Babu Hemanth Kumar Aswathappa,et al.  Rate-distortion optimization using structural information in H.264 strictly Intra-frame encoder , 2010, 2010 42nd Southeastern Symposium on System Theory (SSST).

[26]  Nam Ling,et al.  H.264/Advanced Video Control Perceptual Optimization Coding Based on JND-Directed Coefficient Suppression , 2013, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Nam Ling,et al.  A Context-Adaptive Prediction Scheme for Parameter Estimation in H.264/AVC Macroblock Layer Rate Control , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Wen Gao,et al.  SSIM-Motivated Rate-Distortion Optimization for Video Coding , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Zhihai He,et al.  Linear Rate Control and Optimum Statistical Multiplexing for H.264 Video Broadcast , 2008, IEEE Transactions on Multimedia.

[30]  Xiaoyan Sun,et al.  Optimal Bit Allocation for CTU Level Rate Control in HEVC , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Truong Q. Nguyen,et al.  A Frame-Level Rate Control Scheme Based on Texture and Nontexture Rate Models for High Efficiency Video Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Bo Li,et al.  Complexity Correlation-Based CTU-Level Rate Control with Direction Selection for HEVC , 2017, ACM Trans. Multim. Comput. Commun. Appl..

[33]  Qionghai Dai,et al.  Joint Bit Allocation and Rate Control for Coding Multi-View Video Plus Depth Based 3D Video , 2013, IEEE Transactions on Multimedia.