No-reference image quality assessment metric by combining free energy theory and structural degradation model

In the research of image quality assessment (IQA), no-reference approaches are usually thought of as a big challenge since none of original image information is available. To tackle this problem, we propose a new no-reference image quality metric through combining two recently proposed reduced-reference IQA models, namely the free energy based distortion metric (FEDM) and the structural degradation model (SDM). In this work, it will be shown that there exists an approximate linear relationship between the original image information of the free energy feature and the structural degradation information. Based on this observation and the application of support vector machine (SVM) that is widely used in the current study of IQA, our newly developed No-reference Free energy and Structural degradation based Distortion Metric (NFSDM) is found to alleviate the dependance of original images, and has achieved remarkably well prediction accuracy, outperforming the most two full-reference IQA approaches PSNR/SSIM and several mainstream no-reference image quality metrics.

[1]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[2]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[3]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[4]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[5]  Alan C. Bovik,et al.  No-reference quality assessment using natural scene statistics: JPEG2000 , 2005, IEEE Transactions on Image Processing.

[6]  Karl J. Friston,et al.  A free energy principle for the brain , 2006, Journal of Physiology-Paris.

[7]  Yair Weiss,et al.  Scale invariance and noise in natural images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Karl J. Friston The free-energy principle: a unified brain theory? , 2010, Nature Reviews Neuroscience.

[9]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[10]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[11]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[12]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[13]  Christophe Charrier,et al.  DCT statistics model-based blind image quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[14]  Wenjun Zhang,et al.  An improved full-reference image quality metric based on structure compensation , 2012, Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference.

[15]  Li Chen,et al.  Nonlinear additive model based saliency map weighting strategy for image quality assessment , 2012, 2012 IEEE 14th International Workshop on Multimedia Signal Processing (MMSP).

[16]  Weisi Lin,et al.  A Psychovisual Quality Metric in Free-Energy Principle , 2012, IEEE Transactions on Image Processing.

[17]  Wenjun Zhang,et al.  Self-adaptive scale transform for IQA metric , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[18]  Wenjun Zhang,et al.  A new psychovisual paradigm for image quality assessment: from differentiating distortion types to discriminating quality conditions , 2013, Signal Image Video Process..

[19]  Wenjun Zhang,et al.  A new reduced-reference image quality assessment using structural degradation model , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).