Using Image Quality Assessment (IQA) Databases to Provide an Appraisal of the Ability of the Feature Selective Validation Method (FSV) to Compare Two-Dimensional Datasets

This paper investigates the strengths and drawbacks of the recently developed feature selective validation (FSV)-2D method. Considering that a subjective benchmark for the validation of two-dimensional computational electromagnetics data is not available, five datasets with subjective scores, commonly used in image quality assessment, are used. It is found that the FSV-2D prediction is influenced by image type and distortion type. Encouraged by the assessment results, eight parameters of the FSV-2D method are optimized by use of genetic algorithms. It is shown that the optimized FSV-2D method provides better correlation with subjective scores. Good agreement with theoretical analysis for computational electromagnetic data further validates the proposed approach.

[1]  Antonio Orlandi,et al.  Comparison of Three-Dimensional Datasets by Using the Generalized n-Dimensional ( n-D) Feature Selective Validation (FSV) Technique , 2017, IEEE Transactions on Electromagnetic Compatibility.

[2]  A. L. Drozd,et al.  Development of next generation FSV tools and standards , 2012, 2012 IEEE International Symposium on Electromagnetic Compatibility.

[3]  Patrick Le Callet,et al.  Pseudo no reference image quality metric using perceptual data hiding , 2006, Electronic Imaging.

[4]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[5]  A. Orlandi,et al.  Feature selective validation (FSV) for validation of computational electromagnetics (CEM). part I-the FSV method , 2006, IEEE Transactions on Electromagnetic Compatibility.

[6]  Gang Zhang,et al.  A Review on the Drawbacks and Enhancement Opportunities of the Feature Selective Validation , 2014, IEEE Transactions on Electromagnetic Compatibility.

[7]  Gang Zhang,et al.  Analyzing Transient Phenomena in the Time Domain Using the Feature Selective Validation (FSV) Method , 2014, IEEE Transactions on Electromagnetic Compatibility.

[8]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[9]  Anthony John Michael Martin,et al.  Quantitative data validation (automated visual evaluations). , 1999 .

[10]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[11]  Antonio Orlandi,et al.  Comparison of Data With Multiple Degrees of Freedom Utilizing the Feature Selective Validation Method , 2016, IEEE Transactions on Electromagnetic Compatibility.

[12]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[13]  Alistair Duffy,et al.  A visual interpretation rating scale for validation of numerical models , 2005 .

[14]  A. Orlandi,et al.  Feature selective validation (FSV) for validation of computational electromagnetics (CEM). part II- assessment of FSV performance , 2006, IEEE Transactions on Electromagnetic Compatibility.