Blind image quality assessment in the contourlet domain

Abstract No-reference/blind image quality assessment (NR-IQA/BIQA) algorithms play an important role in image evaluation, as they can assess the quality of an image automatically, only using the distorted image whose quality is being assessed. Among the existing NR-IQA/BIQA methods, natural scene statistic (NSS) models which can be expressed in different bandpass domains show good consistency with human subjective judgments of quality. In this paper, we create new ‘quality-aware’ features: the energy differences of the sub-band coefficients across scales via contourlet transform, and propose a new NR-IQA/BIQA model that operates on natural scene statistics in the contourlet domain. Prior to applying the contourlet transform, we apply two preprocessing steps that help to create more information-dense, low-entropy representations. Specifically, we transform the picture into the CIELAB color space and gradient magnitude map. Then, a number of ‘quality-aware’ features are discovered in the contourlet transform domain: the energy of the sub-band coefficients within scales, and the energy differences between scales, as well as measurements of the statistical relationships of pixels across scales. A detailed analysis is conducted to show how different distortions affect the statistical characteristics of these features, and then features are fed to a support vector regression (SVR) model which learns to predict image quality. Experimental results show that the proposed method has high linearity against human subjective perception, and outperforms the state-of-the-art NR-IQA models.

[1]  Kwan-Yee Lin,et al.  Hallucinated-IQA: No-Reference Image Quality Assessment via Adversarial Learning , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[2]  Xiaojun Wu,et al.  Blind Image Quality Assessment Using a General Regression Neural Network , 2011, IEEE Transactions on Neural Networks.

[3]  Weisi Lin,et al.  Deep Dual-Channel Neural Network for Image-Based Smoke Detection , 2020, IEEE Transactions on Multimedia.

[4]  Ke Gu,et al.  Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Yuan Zhang,et al.  Blind Predicting Similar Quality Map for Image Quality Assessment , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Xinbo Gao,et al.  No-reference image quality assessment in contourlet domain , 2010, Neurocomputing.

[7]  Chaofeng Li,et al.  Content-partitioned structural similarity index for image quality assessment , 2010, Signal Process. Image Commun..

[8]  Ashish Kapoor,et al.  Learning a blind measure of perceptual image quality , 2011, CVPR 2011.

[9]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[10]  Xuelong Li,et al.  Blind Image Quality Assessment via Deep Learning , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[11]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[12]  Alan C. Bovik,et al.  Massive Online Crowdsourced Study of Subjective and Objective Picture Quality , 2015, IEEE Transactions on Image Processing.

[13]  Damon M. Chandler,et al.  No-reference image quality assessment based on log-derivative statistics of natural scenes , 2013, J. Electronic Imaging.

[14]  Francesco Banterle,et al.  Efficient Evaluation of Image Quality via Deep-Learning Approximation of Perceptual Metrics , 2020, IEEE Transactions on Image Processing.

[15]  Mariusz Oszust,et al.  No-Reference Image Quality Assessment Using Image Statistics and Robust Feature Descriptors , 2017, IEEE Signal Processing Letters.

[16]  Nikolay N. Ponomarenko,et al.  Image database TID2013: Peculiarities, results and perspectives , 2015, Signal Process. Image Commun..

[17]  Daniel L. Ruderman,et al.  Origins of scaling in natural images , 1996, Vision Research.

[18]  Junfei Qiao,et al.  Stacked Selective Ensemble for PM2.5 Forecast , 2020, IEEE Transactions on Instrumentation and Measurement.

[19]  Hua Huang,et al.  No-reference image quality assessment in curvelet domain , 2014, Signal Process. Image Commun..

[20]  Sos S. Agaian,et al.  Human Visual System-Based Image Enhancement and Logarithmic Contrast Measure , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[21]  Gaofeng Meng,et al.  Blind Image Quality Assessment via Vector Regression and Object Oriented Pooling , 2018, IEEE Transactions on Multimedia.

[22]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[23]  D. Ruderman The statistics of natural images , 1994 .

[24]  Wei Tang,et al.  Ensembling neural networks: Many could be better than all , 2002, Artif. Intell..

[25]  Alberto Leon-Garcia,et al.  Estimation of shape parameter for generalized Gaussian distributions in subband decompositions of video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[26]  Brian C. Lovell,et al.  Face Recognition from Still Images to Video Sequences: A Local-Feature-Based Framework , 2011, EURASIP J. Image Video Process..

[27]  Qiguang Miao,et al.  Image Quality Assessment Using Image Description in Information Theory , 2018, IEEE Access.

[28]  Weisi Lin,et al.  No-Reference Image Sharpness Assessment in Autoregressive Parameter Space , 2015, IEEE Transactions on Image Processing.

[29]  Xin Yang,et al.  Image quality assessment using contourlet transform , 2009 .

[30]  Zhou Wang,et al.  Perceptual quality assessment of color images using adaptive signal representation , 2010, Electronic Imaging.

[31]  Praful Gupta,et al.  Generalized Gaussian scale mixtures: A model for wavelet coefficients of natural images , 2018, Signal Process. Image Commun..

[32]  Yanning Zhang,et al.  Two-Stream Convolutional Networks for Blind Image Quality Assessment , 2019, IEEE Transactions on Image Processing.

[33]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[34]  Weisi Lin,et al.  Learning a Unified Blind Image Quality Metric via On-Line and Off-Line Big Training Instances , 2020, IEEE Transactions on Big Data.

[35]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[36]  Xuelong Li,et al.  An image quality assessment metric based contourlet , 2008, 2008 15th IEEE International Conference on Image Processing.

[37]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[38]  Yi Li,et al.  Convolutional Neural Networks for No-Reference Image Quality Assessment , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Sebastian Bosse,et al.  Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment , 2016, IEEE Transactions on Image Processing.

[40]  Guangming Shi,et al.  Blind image quality assessment with hierarchy: Degradation from local structure to deep semantics , 2019, J. Vis. Commun. Image Represent..

[41]  Xuelong Li,et al.  Universal Blind Image Quality Assessment Metrics Via Natural Scene Statistics and Multiple Kernel Learning , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[42]  Qingjie Zhao,et al.  Blind image quality assessment by relative gradient statistics and adaboosting neural network , 2016, Signal Process. Image Commun..

[43]  Lixiong Liu,et al.  Pre-Attention and Spatial Dependency Driven No-Reference Image Quality Assessment , 2019, IEEE Transactions on Multimedia.

[44]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.