Reduced-reference metric design for objective perceptual quality assessment in wireless imaging

The rapid growth of third and development of future generation mobile systems has led to an increase in the demand for image and video services. However, the hostile nature of the wireless channel makes the deployment of such services much more challenging, as in the case of a wireline system. In this context, the importance of taking care of user satisfaction with service provisioning as a whole has been recognized. The related user-oriented quality concepts cover end-to-end quality of service and subjective factors such as experiences with the service. To monitor quality and adapt system resources, performance indicators that represent service integrity have to be selected and related to objective measures that correlate well with the quality as perceived by humans. Such objective perceptual quality metrics can then be utilized to optimize quality perception associated with applications in technical systems. In this paper, we focus on the design of reduced-reference objective perceptual image quality metrics for use in wireless imaging. Specifically, the normalized hybrid image quality metric (NHIQM) and a perceptual relevance weighted L"p-norm are designed. The main idea behind both feature-based metrics relates to the fact that the human visual system (HVS) is trained to extract structural information from the viewing area. Accordingly, NHIQM and L"p-norm are designed to account for different structural artifacts that have been observed in our distortion model of a wireless link. The extent by which individual artifacts are present in a given image is obtained by measuring related image features. The overall quality measure is then computed as a weighting sum of the features with the respective perceptual relevance weight obtained from subjective experiments. The proposed metrics differ mainly in the pooling of the features and amount of reduced-reference produced. While NHIQM performs the pooling at the transmitter of the system to produce a single value as reduced-reference, the L"p-norm requires all involved feature values from the transmitted and received image to perform the pooling on the feature differences at the receiver. In addition, non-linear mapping functions are developed that relate the metric values to predicted mean opinion scores (MOS) and account for saturations in the HVS. The evaluation of prediction performance of NHIQM and the L"p-norm reveals their excellent correlation with human perception in terms of accuracy, monotonicity, and consistency. This holds not only for the prediction performance on images taken for the training of the metrics but also for the generalization to unknown images. In addition, it is shown that the NHIQM approach and the perceptual relevance weighted L"p-norm outperform other prominent objective quality metrics in prediction performance.

[1]  Andrew B. Watson,et al.  Digital images and human vision , 1993 .

[2]  Zhou Wang,et al.  Reduced-reference image quality assessment using a wavelet-domain natural image statistic model , 2005, IS&T/SPIE Electronic Imaging.

[3]  Zhou Wang,et al.  Quality-aware images , 2006, IEEE Transactions on Image Processing.

[4]  Sanjit K. Mitra,et al.  Perceptual analysis of video impairments that combine blocky, blurry, noisy, and ringing synthetic artifacts , 2005, IS&T/SPIE Electronic Imaging.

[5]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[6]  Ashraf A. Kassim,et al.  Digital Video Image Quality and Perceptual Coding , 2005, J. Electronic Imaging.

[7]  David Soldani,et al.  QoS and QoE Management in UMTS Cellular Systems: Soldani/QoS and QoE Management in UMTS Cellular Systems , 2006 .

[8]  Thrasyvoulos N. Pappas,et al.  Structural Similarity Quality Metrics in a Coding Context: Exploring the Space of Realistic Distortions , 2006, IEEE Transactions on Image Processing.

[9]  Jean-Bernard Martens,et al.  Multidimensional modeling of image quality , 2002, Proc. IEEE.

[10]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[11]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[12]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[13]  James Hu,et al.  DVQ: A digital video quality metric based on human vision , 2001 .

[14]  R. Vemuri,et al.  An analysis on the effect of image features on lossy coding performance , 2000, IEEE Signal Processing Letters.

[15]  B. Wandell Foundations of vision , 1995 .

[16]  Stefan Winkler,et al.  Digital Video Quality: Vision Models and Metrics , 2005 .

[17]  Andreas F. Molisch,et al.  Wireless Communications , 2005 .

[18]  K. R. Rao,et al.  Digital Video Image Quality and Perceptual Coding (Signal Processing and Communications) , 2005 .

[19]  Olivier Verscheure,et al.  Perceptual quality measure using a spatiotemporal model of the human visual system , 1996, Electronic Imaging.

[20]  H.-J. Zepernick,et al.  Quality Evaluation in Wireless Imaging Using Feature-Based Objective Metrics , 2007, 2007 2nd International Symposium on Wireless Pervasive Computing.

[21]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[22]  T. Vlachos,et al.  Detection of blocking artifacts in compressed video , 2000 .

[23]  Huib de Ridder Minkowski-metrics as a combination rule for digital-image-coding impairments , 1992 .

[24]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[25]  Bahram Honary,et al.  Signal processing for telecommunications and multimedia , 2005 .

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  Arthur R. Weeks Fundamentals of electronic image processing , 1996, SPIE/IEEE series on imaging science and engineering.

[28]  Jean-Bernard Martens,et al.  A single-ended blockiness measure for JPEG-coded images , 2002, Signal Process..

[29]  Zhou Wang,et al.  Why is image quality assessment so difficult? , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[30]  Jeffrey Lubin,et al.  A VISUAL DISCRIMINATION MODEL FOR IMAGING SYSTEM DESIGN AND EVALUATION , 1995 .

[31]  Z. L. Budrikis,et al.  Picture Quality Prediction Based on a Visual Model , 1982, IEEE Trans. Commun..

[32]  Keiichi Chono,et al.  Reduced-reference image quality assessment using distributed source coding , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[33]  Hans-Jurgen Zepernick,et al.  Objective Hybrid Image Quality Metric for In-Service Quality Assessment , 2005 .

[34]  M. P. Hollier,et al.  Models of Human Perception , 1999 .

[35]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[36]  Lina J. Karam,et al.  Human Visual System Based No-Reference Objective Image Sharpness Metric , 2006, 2006 International Conference on Image Processing.

[37]  Patrick Le Callet,et al.  Objective quality assessment of color images based on a generic perceptual reduced reference , 2008, Signal Process. Image Commun..

[38]  Sheila S. Hemami,et al.  Effects of spatial correlations and global precedence on the visual fidelity of distorted images , 2006, Electronic Imaging.

[39]  Lina J. Karam,et al.  A ROBUST IMAGE SHARPNESS METRIC BASED ON KURTOSIS MEASUREMENT OF WAVELET COEFFICIENTS , 2005 .

[40]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[41]  Jens-Rainer Ohm Multimedia Communication Technology: Representation,Transmission and Identification of Multimedia Signals , 2004 .

[42]  Sanjit K. Mitra,et al.  Perceptual contributions of blocky, blurry, and fuzzy impairments to overall annoyance , 2004, IS&T/SPIE Electronic Imaging.

[43]  Huib de Ridder,et al.  Percentage scaling: a new method for evaluating multiply impaired images , 2000, Electronic Imaging.

[44]  M. Serizawa,et al.  REDUCED-REFERENCE BASED VIDEO QUALITY-METRICS USING REPRESENTATIVE-LUMINANCE VALUES , 2007 .