Region Adaptive R- $\lambda$ Model-Based Rate Control for Depth Maps Coding

In this paper, a novel rate-control algorithm based on the region adaptive R-<inline-formula> <tex-math notation="LaTeX">$\lambda $ </tex-math></inline-formula> model is proposed for depth maps coding. First, in order to obtain an accurate rate control for depth maps coding, a modified frame level bit allocation method based on coding bits statistical distribution of depth maps is proposed. Second, considering that different areas in a depth map have an imparity effect on virtual view rendering, the blocks of the depth map are divided into two types, namely, interested blocks for virtual view rending (IBV) and noninterested blocks for virtual view rending (NIBV). Then, two different R-<inline-formula> <tex-math notation="LaTeX">$\lambda $ </tex-math></inline-formula> models are derived for IBV and NIBV, respectively. The optimal bitrates for IBV and NIBV are determined by solving an optimization problem. After that, based on the regional R-<inline-formula> <tex-math notation="LaTeX">$\lambda $ </tex-math></inline-formula> models, the optimal Lagrange multipliers are calculated for both IBV and NIBV. Finally, the largest coding unit (LCU) level rate control is performed by adaptively adjusting the Lagrange multiplier to avoid blocking artifacts and smooth the quality of coding. Experimental results demonstrate that the proposed method can achieve considerable BD-PSNR gains compared with the unified rate-quantization model and conventional R-<inline-formula> <tex-math notation="LaTeX">$\lambda $ </tex-math></inline-formula> model-based algorithms in terms of rendered virtual views quality.

[1]  Tihao Chiang,et al.  Scalable rate control for MPEG-4 video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[2]  Jianjun Lei,et al.  Motion and Structure Information Based Adaptive Weighted Depth Video Estimation , 2015, IEEE Transactions on Broadcasting.

[3]  Yo-Sung Ho,et al.  Depth Coding Using a Boundary Reconstruction Filter for 3-D Video Systems , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Wei Li,et al.  Region-Based Rate Control for H.264/AVC for Low Bit-Rate Applications , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Heiko Schwarz,et al.  3D High-Efficiency Video Coding for Multi-View Video and Depth Data , 2013, IEEE Transactions on Image Processing.

[6]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Wen Gao,et al.  A Novel Rate Control Technique for Multiview Video Plus Depth Based 3D Video Coding , 2011, IEEE Transactions on Broadcasting.

[8]  Thomas Wiegand,et al.  3-D Video Representation Using Depth Maps , 2011, Proceedings of the IEEE.

[9]  Jaejoon Lee,et al.  Depth Map Coding Based on Synthesized View Distortion Function , 2011, IEEE Journal of Selected Topics in Signal Processing.

[10]  Chang-Su Kim,et al.  Bit Allocation Algorithm With Novel View Synthesis Distortion Model for Multiview Video Plus Depth Coding , 2014, IEEE Transactions on Image Processing.

[11]  Shengxi Li,et al.  Region-of-Interest Based Conversational HEVC Coding with Hierarchical Perception Model of Face , 2014, IEEE Journal of Selected Topics in Signal Processing.

[12]  Christoph Fehn,et al.  Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV , 2004, IS&T/SPIE Electronic Imaging.

[13]  Truong Q. Nguyen,et al.  A Frame-Level Rate Control Scheme Based on Texture and Nontexture Rate Models for High Efficiency Video Coding , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  张云 Regional bit allocation and rate distortion optimization for multiview depth video coding with View synthesis distortion model , 2013 .

[15]  F. Bossen,et al.  Common test conditions and software reference configurations , 2010 .

[16]  Antonio Ortega,et al.  Depth map distortion analysis for view rendering and depth coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[17]  Zhaoyang Lu,et al.  Model-Based Joint Bit Allocation Between Texture Videos and Depth Maps for 3-D Video Coding , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Qianqian Hu,et al.  A 3D-HEVC Fast Mode Decision Algorithm for Real-Time Applications , 2015, ACM Trans. Multim. Comput. Commun. Appl..

[19]  Erhan Ekmekcioglu,et al.  Edge and motion-adaptive median filtering for multi-view depth map enhancement , 2009, 2009 Picture Coding Symposium.

[20]  Li Wang,et al.  Rate-Distortion Optimization for depth map coding with distortion estimation of synthesized view , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[21]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[22]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[23]  Carl J. Debono,et al.  An adaptive Lagrange multiplier technique for multi-view video plus depth coding , 2013, 2013 Picture Coding Symposium (PCS).

[24]  Peter Kauff,et al.  Three-Dimensional Video Postproduction and Processing , 2011, Proceedings of the IEEE.

[25]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[26]  Erhan Ekmekcioglu,et al.  Content Adaptive Enhancement of Multi-View Depth Maps for Free Viewpoint Video , 2011, IEEE Journal of Selected Topics in Signal Processing.

[27]  Sam Kwong,et al.  DCT Coefficient Distribution Modeling and Quality Dependency Analysis Based Frame-Level Bit Allocation for HEVC , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Wen Gao,et al.  Rate-distortion analysis for H.264/AVC video coding and its application to rate control , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Yücel Altunbasak,et al.  Frame bit allocation for the H.264/AVC video coder via Cauchy-density-based rate and distortion models , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[30]  Jianjun Lei,et al.  Fast Mode Decision Based on Grayscale Similarity and Inter-View Correlation for Depth Map Coding in 3D-HEVC , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Yo-Sung Ho,et al.  Depth Reconstruction Filter and Down/Up Sampling for Depth Coding in 3-D Video , 2009, IEEE Signal Processing Letters.

[32]  Antonio Ortega,et al.  Depth map coding with distortion estimation of rendered view , 2010, Electronic Imaging.

[33]  Jianjun Lei,et al.  Region-based bit allocation and rate control for depth video in HEVC , 2017, Multimedia Tools and Applications.