Adaptive rate-distortion optimization using perceptual hints

The paper proposes a novel video coding approach that performs adaptive rate-distortion optimization guided by perceptual hints. The key idea is to adjust adaptively the Lagrange multipliers of the RDO coder control module based on visual attention analysis. The observation is that human vision is sensitive to movement of well-structured objects while tolerating large distortion in moving areas with random structure (texture-wise and motion-wise). The proposed algorithm analyzes permissible perceptual distortions and, accordingly, assigns larger Lagrange multipliers to regions that are perceptually less sensitive to distortion so that rate reduction is weighted more than distortion reduction in these regions. Experiments show that this scheme achieves bit-rate saving of 5-7% with virtually the same perceptual quality and is very promising for practical systems

[1]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[2]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[3]  Angelo Marcelli,et al.  Foveated analysis of video , 2003, 12th International Conference on Image Analysis and Processing, 2003.Proceedings..

[4]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[5]  Oscar C. Au,et al.  Perceptual rate control for low-delay video communications , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[6]  Ja-Ling Wu,et al.  Content-based rate control scheme for very low bit-rate video coding , 1997 .

[7]  Stefan Winkler,et al.  Perceptual distortion metric for digital color video , 1999, Electronic Imaging.

[8]  Andrew B. Watson,et al.  DCTune: A TECHNIQUE FOR VISUAL OPTIMIZATION OF DCT QUANTIZATION MATRICES FOR INDIVIDUAL IMAGES. , 1993 .