Rate control in DCT video coding for low-delay communications

An important motivation for the development of the emerging H.263+ and MPEG-4 coding standards is to enhance the quality of highly compressed video for two-way, real-time communications. In these applications, the delay produced by bits accumulated in the encoder buffer must be very small, typically below 100 ms, and the rate control strategy is responsible for encoding the video with high quality and maintaining a low buffer delay. In this work, we present a simple rate control technique that achieves these two objectives by smartly selecting the values of the quantization parameters in typical discrete cosine transform video coders. To do this, we derive models for bit rate and distortion in this type of coders, in terms of the quantization parameters. Using Lagrange optimization, we minimize distortion subject to the target bit constraint, and obtain formulas that indicate how to choose the quantization parameters. We implement our technique in H.263 and MPEG-4 coders, and compare its performance to TMN7 and VM7 rate control when the encoder buffer is small, for a variety of video sequences and bit rates. This new method has been adopted as a rate control tool in the test model TMN8 of H.263+ and (with some modifications) in the verification model VM8 of MPEG-4.

[1]  D A Pierre,et al.  Optimization Theory with Applications , 1986 .

[2]  Frederic Dufaux,et al.  Entropy criterion for optimal bit allocation between motion and prediction error information , 1993, Other Conferences.

[3]  Antonio Ortega,et al.  Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders , 1994, IEEE Trans. Image Process..

[4]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[5]  Fabio Bellifemine,et al.  Statistical analysis of the 2D-DCT coefficients of the differential signal for images , 1992, Signal Process. Image Commun..

[6]  Tihao Chiang,et al.  A new rate control scheme using quadratic rate distortion model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[7]  Atul Puri,et al.  Motion-compensated video coding with adaptive perceptual quantization , 1991, IEEE Trans. Circuits Syst. Video Technol..

[8]  Antonio Ortega,et al.  Rate control using spline-interpolated R-D characteristics , 1996, Other Conferences.

[9]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[10]  David L. Neuhoff,et al.  Optimizing block size in motion-compensated video coding , 1998, J. Electronic Imaging.

[11]  Jordi Ribas-Corbera,et al.  Face-based visually-optimized image sequence coding , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[12]  Antonio Ortega,et al.  Forward-adaptive quantization with optimal overhead cost for image and video coding with applications to MPEG video coders , 1995, Electronic Imaging.

[13]  David L. Neuhoff,et al.  Optimal motion vector accuracy for block-based motion-compensated video coders , 1996, Electronic Imaging.

[14]  Wei Ding,et al.  Rate control of MPEG video coding and recording by rate-quantization modeling , 1996, IEEE Trans. Circuits Syst. Video Technol..

[15]  Reginald L. Lagendijk,et al.  Forward rate control for MPEG recording , 1993, Other Conferences.

[16]  Hsueh-Ming Hang,et al.  Source model for transform video coder and its application. I. Fundamental theory , 1997, IEEE Trans. Circuits Syst. Video Technol..

[17]  Murat Kunt,et al.  Image Sequence Coding Using Motion Compensated Subband Decomposition , 1993 .

[18]  K. Yang,et al.  A normalized rate-distortion model for H.263-compatible codecs and its application to quantizer selection , 1997, Proceedings of International Conference on Image Processing.

[19]  M. L. Liou,et al.  Adaptive Predictive Rate Control Algorithm for MPEG Videos by Rate Quantization Method , 1997 .

[20]  Bo Tao,et al.  A rate-quantization model for MPEG encoders , 1997, Proceedings of International Conference on Image Processing.

[21]  Hsueh-Ming Hang,et al.  Source model for transform video coder and its application. II. Variable frame rate coding , 1997, IEEE Trans. Circuits Syst. Video Technol..