Proactive frame-skipping decision scheme for variable frame rate video coding

Many rate control algorithms focus on the adjustment of quantisation values to retain a certain buffer level, and arbitrary frame-skipping is often needed to keep the buffer from overflow at very low bit-rates. A content adaptive rate control is proposed to optimise the balance between spatial and temporal quality via active frame-skipping. The occurrence of frame-skipping is jointly dependent on the temporal and spatial quality of the video, and on the fullness of the buffer. This helps to achieve a consistent spatial and temporal quality and to enhance the overall perceptual quality. Experimental results show that the new scheme is simple but very effective, with large average PSNR gains and consistently improved visual quality, and the improvement in perceptual quality is much more significant than that in average PSNRs.

[1]  Hwangjun Song,et al.  Rate control for low-bit-rate video via variable-encoding frame rates , 2001, IEEE Trans. Circuits Syst. Video Technol..

[2]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[3]  Tihao Chiang,et al.  Scalable rate control for MPEG-4 video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[4]  Hsueh-Ming Hang,et al.  Source model for transform video coder and its application. II. Variable frame rate coding , 1997, IEEE Trans. Circuits Syst. Video Technol..

[5]  Frédéric Dufaux,et al.  Constrained bit-rate control for very low bit-rate streaming-video applications , 2001, IEEE Trans. Circuits Syst. Video Technol..

[6]  Weisi Lin,et al.  A locally-adaptive algorithm for measuring blocking artifacts in images and videos , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[7]  Zhengguo Li,et al.  A study of MPEG-4 rate control scheme and its improvements , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Anthony Vetro,et al.  MPEG-4 rate control for multiple video objects , 1999, IEEE Trans. Circuits Syst. Video Technol..

[9]  Jungwoo Lee,et al.  Temporally adaptive motion interpolation exploiting temporal masking in visual perception , 1994, IEEE Trans. Image Process..