Statistical evaluation of image quality measures

In this work we comprehensively categorize image qual- ity measures, extend measures defined for gray scale images to their multispectral case, and propose novel image quality measures. They are categorized into pixel difference-based, correlation-based, edge-based, spectral-based, context-based and human visual sys- tem (HVS)-based measures. Furthermore we compare these mea- sures statistically for still image compression applications. The sta- tistical behavior of the measures and their sensitivity to coding artifacts are investigated via analysis of variance techniques. Their similarities or differences are illustrated by plotting their Kohonen maps. Measures that give consistent scores across an image class and that are sensitive to coding artifacts are pointed out. It was found that measures based on the phase spectrum, the multireso- lution distance or the HVS filtered mean square error are computa- tionally simple and are more responsive to coding artifacts. We also demonstrate the utility of combining selected quality metrics in build- ing a steganalysis tool. © 2002 SPIE and IS&T.

[1]  H H Barrett,et al.  Objective assessment of image quality: effects of quantum noise and object variability. , 1990, Journal of the Optical Society of America. A, Optics and image science.

[2]  Panos E. Trahanias,et al.  Vector order statistics operators as color edge detectors , 1996, IEEE Trans. Syst. Man Cybern. Part B.

[3]  Bülent Sankur,et al.  Generalized distance based matching of nonbinary images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[4]  V. Ralph Algazi,et al.  Objective picture quality scale (PQS) for image coding , 1998, IEEE Trans. Commun..

[5]  Brian Bouzas,et al.  Objective image quality measure derived from digital image power spectra , 1992 .

[6]  Nagato Narita,et al.  Method for the Subjective Assessment of the Quality of Television Pictures Recommended by CCIR Rec. 500-5. , 1993 .

[7]  William A. Pearlman,et al.  A new, fast, and efficient image codec based on set partitioning in hierarchical trees , 1996, IEEE Trans. Circuits Syst. Video Technol..

[8]  Harold Szu,et al.  Video compression quality metrics correlation with aided target recognition (ATR) applications , 1998, J. Electronic Imaging.

[9]  Pamela C. Cosman,et al.  Image quality in lossy compressed digital mammograms , 1997, Signal Process..

[10]  Alan M. McIvor,et al.  A comparison of local surface geometry estimation methods , 1997, Machine Vision and Applications.

[11]  M. Lipschutz.  Schaum's outline of theory and problems of differential geometry , 1969 .

[12]  A. C. Rencher.  Methods of multivariate analysis , 1995 .

[13]  Robert M. Haralick,et al.  A methodology for quantitative performance evaluation of detection algorithms , 1995, IEEE Trans. Image Process..

[14]  Nasir D. Memon,et al.  Steganalysis using image quality metrics , 2003, IEEE Trans. Image Process..

[15]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Scott Daly,et al.  Digital Images and Human Vision , 1993 .

[17]  Philip J. Corriveau,et al.  VQEG evaluation of objective methods of video quality assessment , 1999 .

[18]  Vito Di Gesù,et al.  Distance-based functions for image comparison , 1999, Pattern Recognit. Lett..

[19]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[20]  A. Martínez,et al.  The AR face databasae , 1998 .

[21]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[22]  Pasi Fränti.  Blockwise distortion measure for statistical and structural errors in digital images , 1998, Signal Process. Image Commun..

[23]  Norman B. Nill,et al.  A Visual Model Weighted Cosine Transform for Image Compression and Quality Assessment , 1985, IEEE Trans. Commun..

[24]  Kris Popat,et al.  Cluster-based probability model and its application to image and texture processing , 1997, IEEE Trans. Image Process..

[25]  Andrew B. Watson,et al.  DCTune: A TECHNIQUE FOR VISUAL OPTIMIZATION OF DCT QUANTIZATION MATRICES FOR INDIVIDUAL IMAGES. , 1993 .

[26]  R Repges,et al.  A comparison of similarity measures for digital subtraction radiography. , 1997, Computers in biology and medicine.

[27]  Aleix M. Martinez,et al.  The AR face database , 1998 .

[28]  Ahmet M. Eskicioglu.  Application of multidimensional quality measures to reconstructed medical images , 1996 .

[29]  A. Lohmann,et al.  SIGNIFICANCE OF PHASE AND AMPLITUDE IN THE FOURIER DOMAIN , 1997 .

[30]  Nasir D. Memon,et al.  Steganalysis based on image quality metrics , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[31]  Stefan Winkler,et al.  A perceptual distortion metric for digital color images , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[32]  R. F. Wagner,et al.  Objective assessment of image quality. II. Fisher information, Fourier crosstalk, and figures of merit for task performance. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[33]  Panos E. Trahanias,et al.  Directional processing of color images: theory and experimental results , 1996, IEEE Trans. Image Process..

[34]  E. Finnimore.  Objective Quality Assessment , 1986 .

[35]  Bernd Girod,et al.  What's wrong with mean-squared error? , 1993 .

[36]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[37]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[38]  F. Deravi,et al.  A multiresolution distance measure for images , 1998, IEEE Signal Processing Letters.

[39]  Josef Kittler,et al.  Error-sensitivity assessment of vision algorithms , 1998 .

[40]  No Value,et al.  IEEE International Conference on Image Processing , 2003 .

[41]  Scott J. Daly,et al.  Visible differences predictor: an algorithm for the assessment of image fidelity , 1992, Electronic Imaging.

[42]  Jean-Bernard Martens,et al.  Subjective quality assessment of compressed images , 1997, Signal Process..

[43]  Stefan Winkler,et al.  Video Quality Experts Group: current results and future directions , 2000, Visual Communications and Image Processing.

[44]  Thomas S. Huang,et al.  Color image edge detection using cluster analysis , 1997, Proceedings of International Conference on Image Processing.

[45]  Jan P. Allebach,et al.  Methodology for designing image similarity metrics based on human visual system models , 1997, Electronic Imaging.

[46]  Huib de Ridder.  Minkowski-metrics as a combination rule for digital-image-coding impairments , 1992 .

[47]  M. Basseville.  Distance measures for signal processing and pattern recognition , 1989 .

[48]  Terry Caelli,et al.  Region-Based Coding of Color Images Using Karhunen-Loeve Transform , 1997, CVGIP Graph. Model. Image Process..

[49]  Nasir D. Memon,et al.  Steganalysis of watermarking techniques using image quality metrics , 2001, IS&T/SPIE Electronic Imaging.

[50]  Bülent Sankur,et al.  Statistical analysis of image quality measures , 2000, 2000 10th European Signal Processing Conference.

[51]  Konstantinos N. Plataniotis,et al.  Distance measures for color image retrieval , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[52]  Robert M. Haralick,et al.  A methodology for quantitative performance evaluation of detection algorithms , 1995, IEEE Transactions on Image Processing.

[53]  Anil K. Jain,et al.  A modified Hausdorff distance for object matching , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[54]  Carl E. Halford,et al.  Developing operational performance metrics using image comparison metrics and the concept of degradation space , 1999 .

[55]  Bernhard Wegmann,et al.  The importance of intrinsically two-dimensional image features in biological vision and picture coding , 1993 .

[56]  P. K. Rajan,et al.  Evaluation of corner detection algorithms , 1989, [1989] Proceedings. The Twenty-First Southeastern Symposium on System Theory.