Bitrate control using a heuristic spatial resolution adjustment for a real-time H.264/AVC encoder

Conventional bitrate control algorithms that change only the quantization parameter (QP) often suffer from quality degradation when the target bitrate is very low. Therefore, rate control algorithms that adjust spatial resolution in addition to QP control have recently been proposed, but their computations are too complex to be processed in real time. This research proposes a very simple, but effective, rate control algorithm that employs spatial resolution control as well as the existing QP-based bitrate control. The spatial resolution ratio for the best peak signal-to-noise ratio (PSNR) is calculated using a simple estimation model which defines the relationship between the PSNR and the spatial resolution at very low bitrate compression. In the proposed bitrate control algorithm, two scalability tools for adjusting the QP and the spatial resolution ratio are used sequentially to reach the target PSNR and the control decision is made for a group of pictures. Experimental results show that the proposed bitrate control algorithm approximates an optimal solution and yields a better subjective quality as well as objective quality at various bitrates compared to the conventional QP-based bitrate control algorithm. The decision of the control parameters requires very small computational complexity and is made in a completely automatic manner so that the proposed algorithm is well suited for real-time applications.

[1]  Susanto Rahardja,et al.  Adaptive rate control for H.264 , 2004, ICIP.

[2]  Michael Elad,et al.  Down-Scaling for Better Transform Compression , 2001, Scale-Space.

[3]  Zhiping Lin,et al.  A new bit estimation scheme for H.264 rate control , 2004, IEEE International Symposium on Consumer Electronics, 2004.

[4]  Anthony Vetro,et al.  Rate-distortion optimized video coding considering frameskip , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[5]  Heonshik Shin,et al.  Design of a mobile video streaming system using adaptive spatial resolution control , 2009, IEEE Transactions on Consumer Electronics.

[6]  Wen Gao,et al.  Rate-distortion analysis for H.264/AVC video coding and its application to rate control , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Yücel Altunbasak,et al.  Frame bit allocation for the H.264/AVC video coder via Cauchy-density-based rate and distortion models , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Susanto Rahardja,et al.  Adaptive frame skipping based on spatio-temporal complexity for low bit-rate video coding , 2006, J. Vis. Commun. Image Represent..

[9]  Shan Liu,et al.  Joint temporal-spatial bit allocation for video coding with dependency , 2005 .

[10]  S.A. Kasmani,et al.  A New Robust Digital Image Watermarking Technique Based on Joint DWT-DCT Transformation , 2008, 2008 Third International Conference on Convergence and Hybrid Information Technology.

[11]  Truong Q. Nguyen,et al.  Iterative Rate-Distortion Optimization of H.264 With Constant Bit Rate Constraint , 2008, IEEE Transactions on Image Processing.

[12]  Jin Ran,et al.  The Coding Rate Control of Consistent Perceptual Video Quality in H.264 ROI , 2009, 2009 International Symposium on Computer Network and Multimedia Technology.

[13]  Chung-Ming Huang,et al.  A Novel 4-D Perceptual Quantization Modeling for H.264 Bit-Rate Control , 2007, IEEE Transactions on Multimedia.

[14]  Zhengguo Li,et al.  Region-of-Interest Based Resource Allocation for Conversational Video Communication of H.264/AVC , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Qingxin Meng,et al.  Improved Macroblock-Level Rate Control Algorithm with Visual Properties , 2010, 2010 2nd International Workshop on Intelligent Systems and Applications.

[16]  Mehreen Afzal,et al.  Improved Data Hiding Technique for Shares in Extended Visual Secret Sharing Schemes , 2008, ICICS.

[17]  Jun Peng,et al.  Key Graphs and Secret Sharing Be Used in Network Multicast Security , 2009, 2009 International Symposium on Computer Network and Multimedia Technology.

[18]  Driss Aboutajdine,et al.  A macroblock-based perceptually adaptive bit allocation for H264 rate control , 2010, 2010 5th International Symposium On I/V Communications and Mobile Network.

[19]  Anne H. Anderson,et al.  Impact of video frame rate on communicative behaviour in two and four party groups , 2000, CSCW '00.

[20]  Sanjit K. Mitra,et al.  Low-delay rate control for DCT video coding via ?-domain source modeling , 2001, IEEE Trans. Circuits Syst. Video Technol..

[21]  Pao-Chi Chang,et al.  Adaptive down-sampling video coding , 2010, Electronic Imaging.

[22]  Xiuchang Zhu,et al.  SSIM-based content adaptive frame skipping for low bit rate H.264 video coding , 2010, 2010 IEEE 12th International Conference on Communication Technology.

[23]  S. Gary,et al.  Joint Model Reference Encoding Methods and Decoding Concealment Methods , 2003 .

[24]  Susanto Rahardja,et al.  Proactive frame-skipping decision scheme for variable frame rate video coding , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[25]  Homer H. Chen,et al.  SSIM-Based Perceptual Rate Control for Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Wen Gao,et al.  Rate control for JVT video coding scheme with HRD considerations , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[27]  Faouzi Kossentini,et al.  H.263+: video coding at low bit rates , 1998, IEEE Trans. Circuits Syst. Video Technol..

[28]  Weisi Lin,et al.  Rate control for videophone using local perceptual cues , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Guodong Wang,et al.  An image authentication scheme based on sliding window , 2008, 2008 Chinese Control and Decision Conference.

[30]  Michael Elad,et al.  Improved high-definition video by encoding at an intermediate resolution , 2004, IS&T/SPIE Electronic Imaging.

[31]  W.T. Penzhorn,et al.  Digital watermarking for copyright protection , 2004, 2004 IEEE Africon. 7th Africon Conference in Africa (IEEE Cat. No.04CH37590).

[32]  Do-Kyoung Kwon,et al.  Rate Control for H.264 Video With Enhanced Rate and Distortion Models , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  A. Zoubir,et al.  EURASIP Journal on Advances in Signal Processing , 2011 .

[34]  Yap-Peng Tan,et al.  On the methods and performances of rational downsizing video transcoding , 2004, Signal Process. Image Commun..

[35]  Lap-Pui Chau,et al.  The realization of arbitrary downsizing video transcoding , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  C.-C. Jay Kuo,et al.  Low complexity algorithm for robust video frame rate up-conversion (FRUC) technique , 2009, IEEE Transactions on Consumer Electronics.

[37]  Hwangjun Song,et al.  Rate control for low-bit-rate video via variable-encoding frame rates , 2001, IEEE Trans. Circuits Syst. Video Technol..

[38]  Yongdong Zhang,et al.  Optimum bit allocation and rate control for H.264/AVC , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Zhibing Wang,et al.  An Improved ROI-Based Rate Control Algorithm for H.264/AVC , 2006, 2006 8th international Conference on Signal Processing.

[40]  Euee S. Jang,et al.  Adaptive Key Frame Selection for Efficient Video Coding , 2007, PSIVT.

[41]  Weisi Lin,et al.  Adaptive downsampling/upsampling for better video compression at low bit rate , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[42]  Luis F. Chaparro,et al.  Low Bit Rate Video Coding Using DCT-Based Fast Decimation/Interpolation and Embedded Zerotree Coding , 2007, IEEE Trans. Circuits Syst. Video Technol..

[43]  JongWon Kim,et al.  TCP-friendly Internet Video Streaming employing Variable Framerate Encoding and Interpolation , 2000 .