Local visual perceptual clues and its use in videophone rate control

We present a method for extracting local visual perceptual clues and its application for rate control of videophone, in order to ensure the scarce bits to be assigned for maximum perceptual coding quality. The optimum quantization step is determined with the rate-distortion model considering the local perceptual clues in the visual signal. For extraction of the perceptual clues, luminance adaptation and texture masking are used as the stimulus-driven factors, while skin color serves as the cognition-driven factor in current implementation. Both objective and subjective quality evaluations are given by evaluating the proposed perceptual rate control (PRC) scheme in the H.263 platform, and the evaluations show that the proposed PRC scheme achieves significant quality improvement in the block-based coding for bandwidth-hungry applications.

[1]  Allen Allport,et al.  Visual attention , 1989 .

[2]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[4]  Laurent Itti,et al.  Modelling Primate Visual Attention , 2003 .

[5]  W.S. Lin,et al.  Just-noticeable-distortion profile with nonlinear additivity model for perceptual masking in color images , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[6]  Weisi Lin,et al.  Perceptual-quality significance map (PQSM) and its application on video quality distortion metrics , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[7]  King Ngi Ngan,et al.  Face segmentation using skin-color map in videophone applications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[8]  Hiroyuki Okada,et al.  Object-oriented H.263 compatible video coding platform for conferencing applications , 1998, IEEE J. Sel. Areas Commun..

[9]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[10]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Chun-Hsien Chou,et al.  A perceptually optimized 3-D subband codec for video communication over wireless channels , 1996, IEEE Trans. Circuits Syst. Video Technol..