Full-Reference Image Quality Assessment with Linear Combination of Genetically Selected Quality Measures

Information carried by an image can be distorted due to different image processing steps introduced by different electronic means of storage and communication. Therefore, development of algorithms which can automatically assess a quality of the image in a way that is consistent with human evaluation is important. In this paper, an approach to image quality assessment (IQA) is proposed in which the quality of a given image is evaluated jointly by several IQA approaches. At first, in order to obtain such joint models, an optimisation problem of IQA measures aggregation is defined, where a weighted sum of their outputs, i.e., objective scores, is used as the aggregation operator. Then, the weight of each measure is considered as a decision variable in a problem of minimisation of root mean square error between obtained objective scores and subjective scores. Subjective scores reflect ground-truth and involve evaluation of images by human observers. The optimisation problem is solved using a genetic algorithm, which also selects suitable measures used in aggregation. Obtained multimeasures are evaluated on four largest widely used image benchmarks and compared against state-of-the-art full-reference IQA approaches. Results of comparison reveal that the proposed approach outperforms other competing measures.

[1]  Fabio Roli,et al.  Multiple Classifier Systems, 9th International Workshop, MCS 2010, Cairo, Egypt, April 7-9, 2010. Proceedings , 2010, MCS.

[2]  D. Chandler Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[3]  Fei Zhou,et al.  Image Quality Assessment Based on Inter-Patch and Intra-Patch Similarity , 2015, PloS one.

[4]  Guangming Shi,et al.  Perceptual Quality Metric With Internal Generative Mechanism , 2013, IEEE Transactions on Image Processing.

[5]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[6]  Peng Peng,et al.  A Mixture of Experts Approach to Multi-strategy Image Quality Assessment , 2012, ICIAR.

[7]  Yu Huang,et al.  An Object-Distortion Based Image Quality Similarity , 2015, IEEE Signal Processing Letters.

[8]  Xin Yang,et al.  A New Image Quality Approach Based on Decision Fusion , 2008, 2008 Fifth International Conference on Fuzzy Systems and Knowledge Discovery.

[9]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[10]  C.-C. Jay Kuo,et al.  Perceptual image quality assessment using block-based multi-metric fusion (BMMF) , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[11]  Joydeep Ghosh,et al.  Multiclassifier Systems: Back to the Future , 2002, Multiple Classifier Systems.

[12]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[13]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[14]  Hua Yang,et al.  Sparse Feature Fidelity for Perceptual Image Quality Assessment , 2013, IEEE Transactions on Image Processing.

[15]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[16]  Guangming Shi,et al.  Image Quality Assessment with Degradation on Spatial Structure , 2014, IEEE Signal Processing Letters.

[17]  Yong Gan,et al.  Perceptual image quality assessment by independent feature detector , 2015, Neurocomputing.

[18]  Ann Dooms,et al.  A Locally Adaptive System for the Fusion of Objective Quality Measures , 2014, IEEE Transactions on Image Processing.

[19]  Wilson S. Geisler,et al.  Image quality assessment based on a degradation model , 2000, IEEE Trans. Image Process..

[20]  Lakhmi C. Jain,et al.  Designing classifier fusion systems by genetic algorithms , 2000, IEEE Trans. Evol. Comput..

[21]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[23]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[24]  Azeddine Beghdadi,et al.  Selecting Low-level Features for Image Quality Assessment by Statistical Methods , 2010, J. Comput. Inf. Technol..

[25]  Lei Zhang,et al.  RFSIM: A feature based image quality assessment metric using Riesz transforms , 2010, 2010 IEEE International Conference on Image Processing.

[26]  Soo-Chang Pei,et al.  Image Quality Assessment Using Human Visual DOG Model Fused With Random Forest , 2015, IEEE Transactions on Image Processing.

[27]  Mariusz Oszust,et al.  Decision Fusion for Image Quality Assessment using an Optimization Approach , 2016, IEEE Signal Processing Letters.

[28]  Peng Peng,et al.  Regularization of the structural similarity index based on preservation of edge direction , 2012, 2012 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[29]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[30]  Jacek M. Zurada,et al.  Artificial Intelligence and Soft Computing, 10th International Conference, ICAISC 2010, Zakopane, Poland, June 13-17, 2010, Part I , 2010, International Conference on Artificial Intelligence and Soft Computing.

[31]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[32]  Weisi Lin,et al.  Image Quality Assessment Using Multi-Method Fusion , 2013, IEEE Transactions on Image Processing.

[33]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[34]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[35]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[36]  Krzysztof Okarma,et al.  Extended Hybrid Image Similarity – Combined Full-Reference Image Quality Metric Linearly Correlated with Subjective Scores , 2013 .

[37]  Krzysztof Okarma,et al.  Combined Full-Reference Image Quality Metric Linearly Correlated with Subjective Assessment , 2010, ICAISC.

[38]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[39]  Hongyu Li,et al.  SR-SIM: A fast and high performance IQA index based on spectral residual , 2012, 2012 19th IEEE International Conference on Image Processing.

[40]  Q. M. Jonathan Wu,et al.  Full-reference image quality assessment by combining global and local distortion measures , 2014, Signal Process..

[41]  Fan Zhang,et al.  Image Quality Assessment by Separately Evaluating Detail Losses and Additive Impairments , 2011, IEEE Transactions on Multimedia.

[42]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.