Stereoscopic Perceptual Video Coding Based on Just-Noticeable-Distortion Profile

Stereoscopic video coding is a key technology for the development of three-dimensional television (3DTV). Nonetheless, the task remains highly challenging owing to the large amount of 3DTV. Traditional stereoscopic video coding is found to be ineffective in reducing the unnecessary stereoscopic perceptual redundancy. Thus better compression efficiency is highly desired in stereoscopic video coding. In this paper, we propose a foveation weight model based on auto-stereoscopic display, and incorporate it into a stereoscopic just-noticeable-distortion (JND) model to give more accurate estimation of the stereoscopic perceptual effect. In order to utilize this model to improve the stereoscopic video coding efficiency, we present a block-adaptive residue preprocessing method based on stereoscopic JND model. Extensive experiment results demonstrate that the proposed scheme can efficiently reduce the unnecessary perceptual redundancy without visual quality degradation.

[1]  Weisi Lin,et al.  Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile , 2005, IEEE Trans. Circuits Syst. Video Technol..

[2]  Weisi Lin,et al.  Estimating Just-Noticeable Distortion for Video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Liang-Gee Chen,et al.  Joint Prediction Algorithm and Architecture for Stereo Video Hybrid Coding Systems , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  Arun N. Netravali,et al.  Digital Pictures: Representation and Compression , 1988 .

[5]  R. J. Safranek,et al.  A perceptually tuned sub-band image coder with image dependent quantization and post-quantization data compression , 1989, International Conference on Acoustics, Speech, and Signal Processing,.

[6]  Robert J. Safranek,et al.  Signal compression based on models of human perception , 1993, Proc. IEEE.

[7]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[8]  Chun-Hsien Chou,et al.  A perceptually optimized 3-D subband codec for video communication over wireless channels , 1996, IEEE Trans. Circuits Syst. Video Technol..

[9]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[10]  Laurent Itti,et al.  Automatic foveation for video compression using a neurobiological model of visual attention , 2004, IEEE Transactions on Image Processing.

[11]  Weisi Lin,et al.  Improved estimation for just-noticeable visual distortion , 2005, Signal Process..

[12]  Toby Berger,et al.  A software-only videocodec using pixelwise conditional differential replenishment and perceptual enhancements , 1999, IEEE Trans. Circuits Syst. Video Technol..

[13]  Oscar C. Au,et al.  Perceptual rate control for low-delay video communications , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[14]  André Vincent,et al.  Stereo image quality: effects of mixed spatio-temporal resolution , 2000, IEEE Trans. Circuits Syst. Video Technol..

[15]  Hsueh-Ming Hang,et al.  Source model for transform video coder and its application. I. Fundamental theory , 1997, IEEE Trans. Circuits Syst. Video Technol..

[16]  King Ngi Ngan,et al.  Spatio-Temporal Just Noticeable Distortion Profile for Grey Scale Image/Video in DCT Domain , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Zhao Ren.  Research on Stereo Viewing Zone in Autostereoscopic Display Based on Parallax Barrier , 2008 .

[18]  Hojin Ha,et al.  Macroblock-Based Frequency Selective Weighting for Visual Scalable Video Coding of H.264/AVC , 2009, IEEE Transactions on Broadcasting.

[19]  Chun-Jen Tsai,et al.  Visual sensitivity guided bit allocation for video coding , 2006, IEEE Transactions on Multimedia.

[20]  Jianfei Cai,et al.  Three Dimensional Scalable Video Adaptation via User-End Perceptual Quality Assessment , 2008, IEEE Transactions on Broadcasting.

[21]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..

[22]  Zhou Wang,et al.  Foveation scalable video coding with automatic fixation selection , 2003, IEEE Trans. Image Process..

[23]  He Yun,et al.  Macroblock-Level Adaptive Frequency Weighting for Perceptual Video Coding , 2007 .

[24]  N A Dodgson,et al.  Analysis of the viewing zone of the Cambridge autostereoscopic display. , 1996, Applied optics.

[25]  Andrew P. Bradley,et al.  Perceptual quality metrics applied to still image compression , 1998, Signal Process..

[26]  T.Q. Nguyen,et al.  Perceptual Video Coding with H.264 , 2005, Conference Record of the Thirty-Ninth Asilomar Conference onSignals, Systems and Computers, 2005..