Quality assessment metrics vs. PSNR under packet lossscenarios in manet wireless networks

It is well known that PSNR does not always rank quality of an image or video sequence in the same way that a human being. There are many other factors considered by the human visual system and the brain. So, a lot of efforts were required to find an objective video quality metric that is able to measure the quality distortion similarly to the one perceived by the destination user. We analyze the behaviour of some of the most relevant objective quality metrics when they are applied to video compressed by a H264/AVC codec at different bit-rates and with error resilience options enabled. Video data is transmitted in a wireless MANET environment and packet losses are modelled for different scenarios including variable congestion and mobility states. We take as reference the PSNR metric and try to find out if there is a more accurate metric in terms of human quality perception that could substitute PSNR in the performance evaluation of different coding proposals under packet loss scenarios.

[1]  Zhou Wang,et al.  Reduced-reference image quality assessment using a wavelet-domain natural image statistic model , 2005, IS&T/SPIE Electronic Imaging.

[2]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[3]  Zhou Wang,et al.  Translation insensitive image similarity in complex wavelet domain , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[4]  Jesús Malo,et al.  Subjective image fidelity metric based on bit allocation of the human visual system in the DCT domain , 1997, Image Vis. Comput..

[5]  Manuel P. Malumbres,et al.  A Study of Objective Quality Assessment Metrics for Video Codec Design and Evaluation , 2006, Eighth IEEE International Symposium on Multimedia (ISM'06).

[6]  Zhou Wang,et al.  An adaptive linear system framework for image distortion analysis , 2005, IEEE International Conference on Image Processing 2005.

[7]  Pietro Manzoni,et al.  Speeding up the evaluation of multimedia streaming applications in MANETs using HMMs , 2004, MSWiM '04.

[8]  James Hu,et al.  DVQ: A digital video quality metric based on human vision , 2001 .

[9]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[10]  Pietro Manzoni,et al.  Performance of H.264 compressed video streams over 802.11b based MANETs , 2004, 24th International Conference on Distributed Computing Systems Workshops, 2004. Proceedings..

[11]  Olivier Verscheure,et al.  Perceptual quality measure using a spatiotemporal model of the human visual system , 1996, Electronic Imaging.

[12]  Eero P. Simoncelli.  Modeling the joint statistics of images in the wavelet domain , 1999, Optics & Photonics.

[13]  Zhou Wang,et al.  Blind measurement of blocking artifacts in images , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[14]  Zhou Wang,et al.  Foveated wavelet image quality index , 2001, Optics + Photonics.

[15]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[16]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[17]  Zhou Wang,et al.  Video quality assessment using structural distortion measurement , 2002, Proceedings. International Conference on Image Processing.

[18]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[19]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[20]  Sheila S. Hemami,et al.  A scalable wavelet-based video distortion metric and applications , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[21]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.