Convex Programming Formulations for Rate Allocation in Video Coding

A rate control technique for video encoding under complex transmission scenarios is presented. A typical application for this method is the transmission of video over variable bit rate channels while accounting for restrictions on the end-to-end delay and decoder buffer size. That the resulting multiple constraints on the source and channel rates may be relaxed without loss of optimality into a set of linear inequality constraints-though they are usually expressed in nonlinear form-is a key insight of this paper. This allows for a systematic treatment of a large class of rate constraints and leads to a convex programming (CP) formulation for rate control. Approximation of the frame distortion-rate data by piecewise linear functions further facilitates an efficient solution based on linear programming (LP), a special case of CP. The LP method provides bounds for the deviation from optimality. Results for a standard video test set show that the proposed method provides solutions with mean square error (MSE) distortion value within 2% of the global minimum across a range of rates. The proposed technique is also applied in conjunction with a perceived distortion measure. Results exhibit significant reduction in blocking artifacts and flicker compared to the use of MSE

[1]  James Renegar,et al.  A polynomial-time algorithm, based on Newton's method, for linear programming , 1988, Math. Program..

[2]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[3]  David W. Lin,et al.  Optimal Bit Allocation for Coding of Video Signals over ATM Networks , 1997, IEEE J. Sel. Areas Commun..

[4]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[5]  Erwin P. Rathgeb Modeling and Performance Comparison of Policing Mechanisms for ATM Networks , 1991, IEEE J. Sel. Areas Commun..

[6]  Antonio Ortega,et al.  Joint Selection of Source and Channel Rate for VBR Video Transmission Under ATM Policing Constraints , 1997, IEEE J. Sel. Areas Commun..

[7]  Harvey J. Everett Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources , 1963 .

[8]  Sanjit K. Mitra,et al.  A unified rate-distortion analysis framework for transform coding , 2001, IEEE Trans. Circuits Syst. Video Technol..

[9]  Donald F. Towsley,et al.  Supporting stored video: reducing rate variability and end-to-end resource requirements through optimal smoothing , 1998, TNET.

[10]  Antonio Ortega,et al.  Forward-adaptive quantization with optimal overhead cost for image and video coding with applications to MPEG video coders , 1995, Electronic Imaging.

[11]  Sheila S. Hemami,et al.  CVQE: a metric for continuous video quality evaluation at low bit rates , 2003, IS&T/SPIE Electronic Imaging.

[12]  Pankaj Batra,et al.  Modeling and efficient optimization for object-based scalability and some related problems , 2000, IEEE Trans. Image Process..

[13]  Philip A. Chou,et al.  Optimal pruning with applications to tree-structured source coding and modeling , 1989, IEEE Trans. Inf. Theory.

[14]  Antonio Ortega Optimal bit allocation under multiple rate constraints , 1996, Proceedings of Data Compression Conference - DCC '96.

[15]  Antonio Ortega,et al.  Bit-rate control using piecewise approximated rate-distortion characteristics , 1998, IEEE Trans. Circuits Syst. Video Technol..

[16]  Dzung Tien Hoang,et al.  Fast and efficient algorithms for text and video compression , 1997 .

[17]  Alexandros Eleftheriadis,et al.  Alternative formulations for bit allocation with dependent quantization , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[18]  Jordi Ribas-Corbera,et al.  A generalized hypothetical reference decoder for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[19]  Antonio Ortega,et al.  Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders , 1994, IEEE Trans. Image Process..

[20]  Eve A. Riskin,et al.  Optimal bit allocation via the generalized BFOS algorithm , 1991, IEEE Trans. Inf. Theory.

[21]  Amy R. Reibman,et al.  Constraints on variable bit-rate video for ATM networks , 1992, IEEE Trans. Circuits Syst. Video Technol..

[22]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.