Window-based rate control for video quality optimization with a novel INTER-dependent rate-distortion model

Most model-based rate control schemes use independent rate-distortion (R-D) models at macroblock (MB) level to represent the relationship among bit rate, distortion and encoding complexity. However the correlations between frames (INTER-dependency) are not well considered for distortion, bit allocation and quantization parameter (QP) decision. In this paper, a novel INTER-dependent R-D model is proposed based on the theoretical analysis of the relationship between the predicted residual of one frame and the distortion of its reference frame. To achieve both bit rate accuracy and consistent video quality, a window-based rate control scheme with two sliding windows is introduced. One window is to group certain previously encoded frames and current frame to control the bit rate and buffer delay; the other is to group certain future encoding frames to optimize the fluctuation of video quality. Furthermore, the optimization of Lagrange multiplier is also discussed under the INTER-dependent situation. Experimental results demonstrate that the proposed window-based rate control scheme with INTER-dependent R-D model can achieve accurate target bit rate and improve PSNR performance, meanwhile the variation of PSNR is the smallest compared with other three benchmark algorithms. This one-pass rate control scheme is highly practical for the real-time video coding applications. Proposed a novel INTER-dependent R-D model.Proposed a window-based rate control scheme with two sliding windows to achieve both accurate bit rate and consistent video quality.Optimized the Lagrange multiplier under the INTER-dependent situation.

[1]  Joseph W. Goodman,et al.  A mathematical analysis of the DCT coefficient distributions for images , 2000, IEEE Trans. Image Process..

[2]  Christos Grecos,et al.  MPEG-7 Descriptors Based Shot Detection and Adaptive Initial Quantization Parameter Estimation for the H.264/AVC , 2009, IEEE Transactions on Broadcasting.

[3]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[4]  Hsueh-Ming Hang,et al.  Source model for transform video coder and its application. I. Fundamental theory , 1997, IEEE Trans. Circuits Syst. Video Technol..

[5]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[6]  Wen Gao,et al.  Rate-distortion analysis for H.264/AVC video coding and its application to rate control , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Yücel Altunbasak,et al.  Frame bit allocation for the H.264/AVC video coder via Cauchy-density-based rate and distortion models , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Shan Liu,et al.  Joint temporal-spatial bit allocation for video coding with dependency , 2005 .

[9]  Wenjun Zeng,et al.  A sequence-based rate control framework for consistent quality real-time video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Antonio Ortega,et al.  Bit-rate control using piecewise approximated rate-distortion characteristics , 1998, IEEE Trans. Circuits Syst. Video Technol..

[11]  Menno Wildeboer INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC1/SC29/WG11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC1/SC29/WG11 , 2009 .

[12]  Yongdong Zhang,et al.  A New Rate Control Scheme for H.264/AVC , 2006, International Conference on Digital Telecommunications (ICDT'06).

[13]  Sanjit K. Mitra,et al.  Low-delay rate control for DCT video coding via ?-domain source modeling , 2001, IEEE Trans. Circuits Syst. Video Technol..

[14]  Tihao Chiang,et al.  A new rate control scheme using quadratic rate distortion model , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[15]  Antonio Ortega,et al.  Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders , 1994, IEEE Trans. Image Process..

[16]  Truong Q. Nguyen,et al.  A Frame-Level Rate Control Scheme Based on Texture and Nontexture Rate Models for High Efficiency Video Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Do-Kyoung Kwon,et al.  Rate Control for H.264 Video With Enhanced Rate and Distortion Models , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Wen Gao,et al.  Low-delay window-based rate control scheme for video quality optimization in video encoder , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  C.-C. Jay Kuo,et al.  Bit Allocation for Spatial Scalability Coding of H.264/SVC With Dependent Rate-Distortion Analysis , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  André Kaup,et al.  Laplace Distribution Based Lagrangian Rate Distortion Optimization for Hybrid Video Coding , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Henrique S. Malvar,et al.  Low-complexity transform and quantization in H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[22]  Sanjit K. Mitra,et al.  . Optimum bit allocation and accurate rate control for video coding via ρ-domain source modeling , 2002, IEEE Trans. Circuits Syst. Video Technol..

[23]  Jong-Ki Han,et al.  Rate Control for Consistent Objective Quality in High Efficiency Video Coding , 2013, IEEE Transactions on Image Processing.

[24]  Nam Ling,et al.  A Context-Adaptive Prediction Scheme for Parameter Estimation in H.264/AVC Macroblock Layer Rate Control , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[26]  Zhengguo Li,et al.  A Novel Rate Control Scheme for Low Delay Video Communication of H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Joint Video Team Draft ITU-T Recommendation and Final draft international standard of joint video specification , 2003 .

[28]  Wen Gao,et al.  Window-Level Rate Control for Smooth Picture Quality and Smooth Buffer Occupancy , 2011, IEEE Transactions on Image Processing.

[29]  Ming-Ting Sun,et al.  Modeling DCT coefficients for fast video encoding , 1999, IEEE Trans. Circuits Syst. Video Technol..