Quality improvement of H.264/AVC FRExt by incorporating perceptual models

This paper presents the quality improvement of the current video compression standard by incorporating Human Vision Models (HVS) into the standard coding structure. The advanced video coding (AVC) which is also called as H.264/MPEG-4 is the latest compression standard available for video compression. Fidelity Range Extension (FRExt) is the recent work done on the AVC which includes a number of enhanced capabilities relative to the base standards. FRExt aims at improving the quality of the reconstructed videos for some professional applications which require high resolution, such as video conferencing, video broadcast and studio quality videos. In this work a new codec incorporating HVS model has been proposed which gives improved visual quality compared to the MPEG 2, MPEG-4 AVC and FRExt. The proposed coder uses the Contrast Sensitivity Function (CSF) in the transform coding stage of the standard codec. To see the performance improvements of the proposed coder, AVC with FRExt features has been implemented first and the quality of the reconstructed video signals are evaluated using both subjective and objective measures such as MOS, PSNR, MSSIM, VIF and VSNR. The proposed coder shows a noticeable improvement in perceptual quality compared to the standard coders which promises scope for further improvements in the area of perceptual based video coders.

[1]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[2]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[3]  Henrique S. Malvar,et al.  Low-complexity transform and quantization in H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  J. Robson,et al.  Application of fourier analysis to the visibility of gratings , 1968, The Journal of physiology.

[5]  Christine Guillemot,et al.  Perceptually-Friendly H.264/AVC Video Coding Based on Foveated Just-Noticeable-Distortion Model , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[6]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..

[7]  Chun-Hsien Chou,et al.  A perceptually optimized 3-D subband codec for video communication over wireless channels , 1996, IEEE Trans. Circuits Syst. Video Technol..

[8]  Ajay Luthra,et al.  The H.264/AVC Advanced Video Coding standard: overview and introduction to the fidelity range extensions , 2004, SPIE Optics + Photonics.

[9]  D. Marpe,et al.  The H.264/MPEG4 advanced video coding standard and its applications , 2006, IEEE Communications Magazine.

[10]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[11]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[12]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .