Comparison of Effective Coverage Calculation Methods for Image Quality Assessment Databases

This article provides a comparison of a three methods that can be used for calculating effective coverage of image quality assessment database. The aim of this metric is to show how well the database is filled with variety of images. For each image in the database the Spatial Information (SI) and Colorfulness (CF) metric is calculated. The area of convex hull containing all the points on SI x CF plane is indication of total coverage of the database, but it does not show how efficiently this area is utilized. For this purpose an effective coverage was introduced. An analysis is performed for 16 databases - 13 publicaly available and 3 artificial created for the purpose of showing advantages of the effective coverage.

[1]  Raimondo Schettini,et al.  No reference image quality classification for JPEG-distorted images , 2014, Digit. Signal Process..

[2]  C.-C. Jay Kuo,et al.  A GMM-based stair quality model for human perceived JPEG images , 2015, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Fei Zhou,et al.  MDID: A multiply distorted image database for image quality assessment , 2017, Pattern Recognit..

[4]  Alan C. Bovik,et al.  Objective quality assessment of multiply distorted images , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[5]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[6]  Alan C. Bovik,et al.  Massive Online Crowdsourced Study of Subjective and Objective Picture Quality , 2015, IEEE Transactions on Image Processing.

[7]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[8]  C.-C. Jay Kuo,et al.  Statistical Study on Perceived JPEG Image Quality via MCL-JCI Dataset Construction and Analysis , 2016, IQSP.

[9]  Mateusz Buczkowski,et al.  Effective coverage as a new metric for image quality assessment databases comparison , 2017, 2017 International Conference on Systems, Signals and Image Processing (IWSSIP).

[10]  Patrick Le Callet,et al.  Subjective quality assessment IRCCyN/IVC database , 2004 .

[11]  Mateusz Buczkowski Measuring the effective coverage of the image databases , 2017 .

[12]  C.-C. Jay Kuo,et al.  Experimental design and analysis of JND test on coded image/video , 2015, SPIE Optical Engineering + Applications.

[13]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[14]  Kede Ma,et al.  Waterloo Exploration Database: New Challenges for Image Quality Assessment Models. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[15]  Jon Y. Hardeberg,et al.  CID: IQ - A New Image Quality Database , 2014, ICISP.

[16]  Stefan Winkler,et al.  Analysis of Public Image and Video Databases for Quality Assessment , 2012, IEEE Journal of Selected Topics in Signal Processing.