Real-time encoding frame rate control for H.263+ video over the Internet

Abstract Most existing H.263+ rate control algorithms, e.g. the one adopted in the test model of the near-term (TMN8), focus on the macroblock layer rate control and low latency under the assumptions of a constant frame rate and through a constant bit rate (CBR) channel. These algorithms do not accommodate the transmission bandwidth fluctuation efficiently, and the resulting video quality can be degraded. In this work, we propose a new H.263+ rate control scheme which supports the variable bit rate (VBR) channel through the adjustment of the encoding frame rate and quantization parameter. A fast algorithm for the encoding frame rate control based on the inherent motion information within a sliding window in the underlying video is developed to efficiently pursue a good tradeoff between spatial and temporal quality. The proposed rate control algorithm also takes the time-varying bandwidth characteristic of the Internet into account and is able to accommodate the change accordingly. Experimental results are provided to demonstrate the superior performance of the proposed scheme.

[1]  Deborah Estrin,et al.  RAP: An end-to-end rate-based congestion control mechanism for realtime streams in the Internet , 1999, IEEE INFOCOM '99. Conference on Computer Communications. Proceedings. Eighteenth Annual Joint Conference of the IEEE Computer and Communications Societies. The Future is Now (Cat. No.99CH36320).

[2]  Antonio Ortega,et al.  Rate control using spline-interpolated R-D characteristics , 1996, Other Conferences.

[3]  Antonio Ortega,et al.  Joint Selection of Source and Channel Rate for VBR Video Transmission Under ATM Policing Constraints , 1997, IEEE J. Sel. Areas Commun..

[4]  Antonio Ortega,et al.  Optimal trellis-based buffered compression and fast approximations , 1994, IEEE Trans. Image Process..

[5]  Aggelos K. Katsaggelos,et al.  Fast and efficient mode and quantizer selection in the rate distortion sense for H.263 , 1996, Other Conferences.

[6]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[7]  Jungwoo Lee,et al.  Temporally adaptive motion interpolation exploiting temporal masking in visual perception , 1994, IEEE Trans. Image Process..

[8]  Sanjit K. Mitra,et al.  Rate-distortion optimized mode selection for very low bit rate video coding and the emerging H.263 standard , 1996, IEEE Trans. Circuits Syst. Video Technol..

[9]  Jinho Choi,et al.  A stable feedback control of the buffer state using the controlled Lagrange multiplier method , 1994, IEEE Trans. Image Process..

[10]  Amy R. Reibman,et al.  Constraints on variable bit-rate video for ATM networks , 1992, IEEE Trans. Circuits Syst. Video Technol..

[11]  K Ramchandran,et al.  Best wavelet packet bases in a rate-distortion sense , 1993, IEEE Trans. Image Process..

[12]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[13]  Tihao Chiang,et al.  A new rate control scheme using quadratic rate distortion model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[14]  T. V. Lakshman,et al.  VBR video: tradeoffs and potentials , 1998, Proc. IEEE.

[15]  Tung-Sang Ng,et al.  Buffer control algorithm for low bit-rate video compression , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[16]  Jong Beom Ra,et al.  Fast algorithm for optimal bit allocation , 1997, Electronic Imaging.

[17]  Thomas S. Huang,et al.  Image processing , 1971 .

[18]  David W. Lin,et al.  Optimal Bit Allocation for Coding of Video Signals over ATM Networks , 1997, IEEE J. Sel. Areas Commun..

[19]  Antonio Ortega,et al.  Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders , 1994, IEEE Trans. Image Process..

[20]  Karen L. Oehler,et al.  Macroblock quantizer selection for H.263 video coding , 1997, Proceedings of International Conference on Image Processing.

[21]  Wei Ding,et al.  Rate control of MPEG video coding and recording by rate-quantization modeling , 1996, IEEE Trans. Circuits Syst. Video Technol..

[22]  David W. Lin,et al.  Efficient optimal rate-distortion coding of video sequences under multiple rate constraints , 1997, Proceedings of International Conference on Image Processing.

[23]  K. Yang,et al.  A normalized rate-distortion model for H.263-compatible codecs and its application to quantizer selection , 1997, Proceedings of International Conference on Image Processing.

[24]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[25]  Sanjit K. Mitra,et al.  Combined mode selection and macroblock quantization step adaptation for the H.263 video encoder , 1997, Proceedings of International Conference on Image Processing.

[26]  JongWon Kim,et al.  Continually traffic accommodating Internet streaming video , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[27]  David Tse,et al.  RCBR: a simple and efficient service for multiple time-scale traffic , 1997, TNET.