Perceptual contributions of blocky, blurry, noisy, and ringing synthetic artifacts to overall annoyance

Abstract. To develop a no-reference video quality model, it is important to know how the perceived strengths of artifacts are related to their physical strengths and to the perceived annoyance. When more than one artifact is present, it is important to know whether and how its corresponding perceived strength depends on the presence of other artifacts and how perceived strengths combine to determine the overall annoyance. We study the characteristics of different types of artifacts commonly found in compressed videos. We create artifact signals predominantly perceived as blocky, blurry, ringing, and noisy and combine them in various proportions. Then, we perform two psychophysical experiments to independently measure the strength and overall annoyance of these artifact signals when presented alone or in combination. We analyze the data from these experiments and propose models for the overall annoyance based on combinations of the perceptual strengths of the individual artifact signals. We also test the interactions among different types of artifact signals. The results provide interesting information that may help the development of video quality models based on artifact measurements.

[1]  Martin Reisslein,et al.  Objective Video Quality Assessment Methods: A Classification, Review, and Performance Comparison , 2011, IEEE Transactions on Broadcasting.

[2]  H.R. Wu,et al.  A generalized block-edge impairment metric for video coding , 1997, IEEE Signal Processing Letters.

[3]  Stefan Winkler,et al.  Perceptual blur and ringing metrics: application to JPEG2000 , 2004, Signal Process. Image Commun..

[4]  Sheila S. Hemami,et al.  Effects of spatial correlations and global precedence on the visual fidelity of distorted images , 2006, Electronic Imaging.

[5]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[6]  Michael Yuen,et al.  Reconstruction artifacts in digital video compression , 1995, Electronic Imaging.

[7]  Margaret H. Pinson,et al.  An objective method for combining multiple subjective data sets , 2003, Visual Communications and Image Processing.

[8]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[9]  Margaret H. Pinson,et al.  Validating Objective Measures of MPEG Video Quality , 1998 .

[10]  Huib de Ridder Minkowski-metrics as a combination rule for digital-image-coding impairments , 1992 .

[11]  Zhou Wang,et al.  Blind measurement of blocking artifacts in images , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[12]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[13]  Sanjit K. Mitra,et al.  Perceptual contributions of blocky, blurry, and fuzzy impairments to overall annoyance , 2004, IS&T/SPIE Electronic Imaging.

[14]  John M. Libert,et al.  Simulation of graded video impairment by weighted summation: validation of the methodology , 1999, Optics East.

[15]  Sanjit K. Mitra,et al.  Detectability and Annoyance of Synthetic Blocky, Blurry, Noisy, and Ringing Artifacts , 2007, IEEE Transactions on Signal Processing.

[16]  Sanjit K. Mitra,et al.  Modeling subjectively perceived annoyance of H.264/AVC video as a function of perceived artifact strength , 2010, Signal Process..

[17]  Jorge E. Caviedes,et al.  Impairment metrics for digital video and their role in objective quality assessment , 2000, Visual Communications and Image Processing.

[18]  V. Kayargadde,et al.  Perceptual characterization of images degraded by blur and noise: model. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[19]  Sanjit K. Mitra,et al.  17.2: Detectability and Annoyance of Synthetic Blocky and Blurry Video Artifacts , 2002 .

[20]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..

[21]  Alan C. Bovik,et al.  Visual quality assessment algorithms: what does the future hold? , 2010, Multimedia Tools and Applications.

[22]  Michael Yuen,et al.  A survey of hybrid MC/DPCM/DCT video coding distortions , 1998, Signal Process..

[23]  Sanjit K. Mitra,et al.  No-reference video quality metric based on artifact measurements , 2005, IEEE International Conference on Image Processing 2005.

[24]  Sanjit K. Mitra,et al.  Defect visibility and content importance: effects on perceived impairment , 2004, Signal Process. Image Commun..