Image quality assessment based on matching pursuit

Abstract The objective assessment of image quality is an essential part of many visual processing systems. The challenge lies in evaluating the image quality consistently under subjective perceptions. In this paper, we propose a novel image quality metric based on the matching pursuit algorithm. Under the principle of structural information distortion, we assume that various structure data contributes differently to the single image quality score. Specifically, we decompose the reference image using matching pursuit with a separable 2D Gabor dictionary, thus obtaining structural information, and develop a characterization for this information and its importance. We then discuss the relationship between the structural distortion intensity and the subjective quality measurement on the energy scale. In experiments, we compare the performance of our algorithm with both subjective ratings and state-of-the-art objective methods on image datasets with multi-type distortions. The experimental results validate our proposed method.

[1]  Meng Wang,et al.  Video accessibility enhancement for hearing-impaired users , 2011, TOMCCAP.

[2]  Meng Wang,et al.  Movie2Comics: Towards a Lively Video Content Presentation , 2012, IEEE Transactions on Multimedia.

[3]  David J. Sakrison,et al.  The effects of a visual fidelity criterion of the encoding of images , 1974, IEEE Trans. Inf. Theory.

[4]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[5]  Yuukou Horita,et al.  Image Quality Evaluation Model Based on Local Features and Segmentation , 2006, 2006 International Conference on Image Processing.

[6]  Nick G. Kingsbury,et al.  A distortion measure for blocking artifacts in images based on human visual sensitivity , 1995, IEEE Trans. Image Process..

[7]  Meng Wang,et al.  Unified Video Annotation via Multigraph Learning , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..

[9]  Christophe De Vleeschouwer,et al.  New dictionaries for matching pursuits video coding , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[10]  Sheila S. Hemami,et al.  VSNR: A Wavelet-Based Visual Signal-to-Noise Ratio for Natural Images , 2007, IEEE Transactions on Image Processing.

[11]  Stéphane Mallat,et al.  Matching pursuits with time-frequency dictionaries , 1993, IEEE Trans. Signal Process..

[12]  Avideh Zakhor,et al.  Matching pursuit video coding .I. Dictionary approximation , 2002, IEEE Trans. Circuits Syst. Video Technol..

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[15]  David M. Booth,et al.  Image quality measurement using integer wavelet transformations , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[16]  Azeddine Beghdadi,et al.  A new image distortion measure based on wavelet decomposition , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[17]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[18]  David R. Bull,et al.  Video coding using a fast non-separable matching pursuits algorithm , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[19]  Bingbing Ni,et al.  Assistive tagging: A survey of multimedia tagging with human-computer joint exploration , 2012, CSUR.

[20]  Zhou Wang,et al.  Quality-aware images , 2006, IEEE Transactions on Image Processing.

[21]  Hung-Khoon Tan,et al.  Beyond search: Event-driven summarization for web videos , 2011, TOMCCAP.

[22]  Avideh Zakhor,et al.  Very low bit-rate video coding based on matching pursuits , 1997, IEEE Trans. Circuits Syst. Video Technol..

[23]  W. J. Tam,et al.  Image quality measurement by using digital watermarking , 2003, The 2nd IEEE Internatioal Workshop on Haptic, Audio and Visual Environments and Their Applications, 2003. HAVE 2003. Proceedings..

[24]  Hocine Cherifi,et al.  A comparison of image quality models and metrics based on human visual sensitivity , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[25]  L. Pratap Reddy,et al.  Image Quality Assessment Complemented with Visual Regions of Interest , 2007, 2007 International Conference on Computing: Theory and Applications (ICCTA'07).

[26]  Meng Wang,et al.  Beyond Distance Measurement: Constructing Neighborhood Similarity for Video Annotation , 2009, IEEE Transactions on Multimedia.

[27]  Michael W. Levine,et al.  Fundamentals of sensation and perception , 1981 .

[28]  Ahmet M. Eskicioglu,et al.  Quality measurement for monochrome compressed images in the past 25 years , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[29]  Meng Wang,et al.  Event Driven Web Video Summarization by Tag Localization and Key-Shot Identification , 2012, IEEE Transactions on Multimedia.

[30]  Patrick C. Teo,et al.  Perceptual image distortion , 1994, Electronic Imaging.

[31]  Ahmet M. Eskicioglu,et al.  An SVD-based grayscale image quality measure for local and global assessment , 2006, IEEE Transactions on Image Processing.