A Content-Aware Video Encoding Scheme Based on Single-Pass Consistent Quality Control

In real-time video streaming applications based on battery-powered camera systems, it is crucial to capture and transmit critical information satisfying the storage capacity and channel bandwidth requirement. In this paper, we propose a single-pass content-aware video encoding scheme for such applications to achieve a consistent video quality while satisfying the bit-rate constraints. To achieve the objective we developed: 1) scene descriptor based on the discrete cosine transformation coefficients obtained from the video encoder; 2) a parameterized analytic distortion model for video encoding using the scene descriptor; 3) scene change detection based on the encoded MB mode ratio; and 4) a single-pass consistent video quality control scheme which exploits 1), 2), and 3). Experimental results show that the proposed method results in less deviation from the target distortion and less distortion variance than the up-to-date best result by up to 65.25% and 75.88%, respectively, while satisfying the given rate constraints. The computing time overhead in the proposed method was 0.560% and 0.571% for the variable and constrained variable bit-rate mode, respectively, which is negligible in nearly all embedded applications.

[1]  Ning Xu,et al.  Study on macroblock level distortion-quantization models , 2012, Digital Image Processing.

[2]  J. C. De Martin,et al.  PSNR control for GOP-level constant quality in H.264 video coding , 2005 .

[3]  Jianmin Jiang,et al.  A Block-Edge-Pattern-Based Content Descriptor in DCT Domain , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Xuan Jing,et al.  Frame Complexity-Based Rate-Quantization Model for H.264/AVC Intraframe Rate Control , 2008, IEEE Signal Processing Letters.

[5]  Lap-Pui Chau,et al.  Consistent Video Quality Control in Scalable Video Coding Using Dependent Distortion Quantization Model , 2013, IEEE Transactions on Broadcasting.

[6]  Hong Liu,et al.  Quality Assessment of Video Content for HD IPTV Applications , 2009, 2009 11th IEEE International Symposium on Multimedia.

[7]  Oleg V. Komogortsev,et al.  Predictive perceptual compression for real time video communication , 2004, MULTIMEDIA '04.

[8]  Sanjit K. Mitra,et al.  A unified rate-distortion analysis framework for transform coding , 2001, IEEE Trans. Circuits Syst. Video Technol..

[9]  Antonio Ortega,et al.  Variable Bit Rate Video Coding , 2018, Compressed Video Over Networks.

[10]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[11]  Bo Yan,et al.  Adaptive Distortion-Based Intra-Rate Estimation for H.264/AVC Rate Control , 2009, IEEE Signal Processing Letters.

[12]  Jar-Ferr Yang,et al.  Adaptive postprocessors with DCT-based block classifications , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Stefano Tubaro,et al.  Minimum Variance Optimal Rate Allocation for Multiplexed H.264/AVC Bitstreams , 2008, IEEE Transactions on Image Processing.

[14]  Richard E. Ladner,et al.  MultiStage: A MINMAX Bit Allocation Algorithm for Video Coders , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Sanghoon Sull,et al.  A VBR Video Encoding for Locally Consistent Picture Quality With Small Buffering Delay Under Limited Bandwidth , 2012, IEEE Transactions on Broadcasting.

[16]  Jerry D. Gibson,et al.  Distributions of the Two-Dimensional DCT Coefficients for Images , 1983, IEEE Trans. Commun..

[17]  Yücel Altunbasak,et al.  Frame bit allocation for the H.264/AVC video coder via Cauchy-density-based rate and distortion models , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Yang Song,et al.  HDTV1080p H.264/AVC Encoder Chip Design and Performance Analysis , 2009, IEEE Journal of Solid-State Circuits.

[19]  Sanjit K. Mitra,et al.  Low-delay rate control for DCT video coding via ?-domain source modeling , 2001, IEEE Trans. Circuits Syst. Video Technol..

[20]  Liao Qingmin,et al.  Leaky-bucket based rate control algorithm for C VBR video encoding , 1999 .

[21]  H.-M. Hang,et al.  Consistent Picture Quality Control Strategy for Dependent Video Coding , 2009, IEEE Transactions on Image Processing.

[22]  Bo Han,et al.  VBR rate control for perceptually consistent video quality , 2008, IEEE Transactions on Consumer Electronics.

[23]  Sam Kwong,et al.  Adaptive Quantization-Parameter Clip Scheme for Smooth Quality in H.264/AVC , 2012, IEEE Transactions on Image Processing.

[24]  Chuohao Yeo,et al.  Single-Pass Rate Control With Texture and Non-Texture Rate-Distortion Models , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Jar-Ferr Yang,et al.  Adaptive group-of-pictures and scene change detection methods based on existing H.264 advanced video coding information , 2008 .

[26]  Ghassan Al-Regib,et al.  Improved DCT coefficient distribution modeling for H.264-like video coders based on block classification , 2011, 2011 18th IEEE International Conference on Image Processing.

[27]  Chong-Min Kyung,et al.  Energy-Aware Operation of Black Box Surveillance Cameras under Event Uncertainty and Memory Constraint , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[28]  Do-Kyoung Kwon,et al.  Rate Control for H.264 Video With Enhanced Rate and Distortion Models , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  F. Windmeijer,et al.  An R-squared measure of goodness of fit for some common nonlinear regression models , 1997 .

[30]  Jens-Rainer Ohm,et al.  Rate-Complexity-Distortion Optimization for Hybrid Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[32]  Minqiang Jiang,et al.  Frame layer bit allocation scheme for constant quality video , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[33]  Sam Kwong,et al.  A Rate-Distortion Optimization Algorithm for Rate Control in H.264 , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[34]  Wen Gao,et al.  Window-Level Rate Control for Smooth Picture Quality and Smooth Buffer Occupancy , 2011, IEEE Transactions on Image Processing.

[35]  Po-Chyi Su,et al.  A Content-Adaptive Distortion–Quantization Model for H.264/AVC and its Applications , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Bo Yan,et al.  Joint Complexity Estimation of I-Frame and P-Frame for H.264/AVC Rate Control , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[37]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[38]  Mark S. Nixon,et al.  Feature Extraction and Image Processing , 2002 .

[39]  Jun Sun,et al.  Rate-Distortion Analysis of Dead-Zone Plus Uniform Threshold Scalar Quantization and Its Application—Part II: Two-Pass VBR Coding for H.264/AVC , 2013, IEEE Transactions on Image Processing.