Rate Model for Compressed Video Considering Impacts Of Spatial, Temporal and Amplitude Resolutions and Its Applications for Video Coding and Adaptation

In this paper, we investigate the impacts of spatial, temporal and amplitude resolution (STAR) on the bit rate of a compressed video. We propose an analytical rate model in terms of the quantization stepsize, frame size and frame rate. Experimental results reveal that the increase of the video rate as the individual resolution increases follows a power function. Hence, the proposed model expresses the rate as the product of power functions of the quantization stepsize, frame size and frame rate, respectively. The proposed rate model is analytically tractable, requiring only four content dependent parameters. We also propose methods for predicting the model parameters from content features that can be computed from original video. Simulation results show that model predicted rates fit the measured data very well with high Pearson correlation (PC) and small relative root mean square error (RRMSE). The same model function works for different coding scenarios (including scalable and non-scalable video, temporal prediction using either hierarchical B or IPPP structure, etc.) with very high accuracy (average PC $>$ 0.99), but the values of model parameters differ. Using the proposed rate model and the quality model introduced in a separate work, we show how to optimize the STAR for a given rate constraint, which is important for both encoder rate control and scalable video adaptation. Furthermore, we demonstrate how to order the spatial, temporal and amplitude layers of a scalable video in a rate-quality optimized way.

[1]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[2]  Yücel Altunbasak,et al.  An analysis of the DCT coefficient distribution with the H.264 video coder , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Zhan Ma Modeling of Power, Rate and Perceptual Quality of Scalable Video and Its Applications , 2011 .

[4]  Tihao Chiang,et al.  A new rate control scheme using quadratic rate distortion model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[5]  Hao Hu,et al.  Proxy-Based Multi-Stream Scalable Video Adaptation Over Wireless Networks Using Subjective Quality and Rate Models , 2013, IEEE Transactions on Multimedia.

[6]  Wei Ding,et al.  Rate control of MPEG video coding and recording by rate-quantization modeling , 1996, IEEE Trans. Circuits Syst. Video Technol..

[7]  Shan Liu,et al.  Joint temporal-spatial bit allocation for video coding with dependency , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Sanjit K. Mitra,et al.  A novel linear source model and a unified rate control algorithm for H.263/MPEG-2/MPEG-4 , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[9]  Zhan Ma,et al.  A perceptual video quality model for mobile platform considering impact of spatial, temporal, and amplitude resolutions , 2011, 2011 IEEE 10th IVMSP Workshop: Perception and Visual Signal Analysis.