Opinion-Unaware Blind Quality Assessment of Multiply and Singly Distorted Images via Distortion Parameter Estimation

Over the past couple of decades, numerous image quality assessment (IQA) algorithms have been developed to estimate the quality of images that contain a single type of distortion. Although in practice, images can be contaminated by multiple distortions, previous research on the quality assessment of multiply distorted images is very limited. In this paper, we propose an efficient algorithm to blindly assess the quality of both multiply and singly distorted images based on predicting the distortion parameters using a bag of natural scene statistics (NSS) features. Our method, called MUltiply and Singly distorted Image QUality Estimator (MUSIQUE), operates via three main stages. In the first stage, a two-layer classification model is employed to identify the distortion types (i.e., Gaussian blur, JPEG compression, and white noise) that may exist in an image. In the second stage, specific regression models are employed to predict the three distortion parameters (i.e., <inline-formula> <tex-math notation="LaTeX">$\sigma _{G}$ </tex-math></inline-formula> for Gaussian blur, <inline-formula> <tex-math notation="LaTeX">$Q$ </tex-math></inline-formula> for JPEG compression, and <inline-formula> <tex-math notation="LaTeX">$\bar {\sigma }_{N}$ </tex-math></inline-formula> for white noise) by learning the different NSS features for different distortion types and combinations. In the final stage, the three estimated distortion parameter values are mapped and combined into an overall quality estimate based on quality-mapping curves and the most-apparent-distortion strategy. Experimental results tested on three multiply distorted and seven singly distorted image quality databases demonstrate that the proposed MUSIQUE algorithm can achieve better/competitive performance as compared with other state-of-the-art FR/NR IQA algorithms.

[1]  Lai-Man Po,et al.  No-reference image quality assessment with shearlet transform and deep neural networks , 2015, Neurocomputing.

[2]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Eric C. Larson,et al.  Most apparent distortion: full-reference image quality assessment and the role of strategy , 2010, J. Electronic Imaging.

[4]  Jie Fu,et al.  Blind image quality assessment for multiply distorted images via convolutional neural networks , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Xin Li,et al.  Blind image quality assessment , 2002, Proceedings. International Conference on Image Processing.

[6]  Zhou Wang,et al.  No-reference perceptual quality assessment of JPEG compressed images , 2002, Proceedings. International Conference on Image Processing.

[7]  Xuelong Li,et al.  Sparse representation for blind image quality assessment , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Jon Y. Hardeberg,et al.  CID: IQ - A New Image Quality Database , 2014, ICISP.

[9]  Nikolay N. Ponomarenko,et al.  Color image database TID2013: Peculiarities and preliminary results , 2013, European Workshop on Visual Information Processing (EUVIP).

[10]  Qionghai Dai,et al.  Learning Sparse Representation for No-Reference Quality Assessment of Multiply Distorted Stereoscopic Images , 2017, IEEE Transactions on Multimedia.

[11]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[12]  Christophe Charrier,et al.  DCT statistics model-based blind image quality assessment , 2011, 2011 18th IEEE International Conference on Image Processing.

[13]  Zhiguo Jiang,et al.  No Reference Quality Assessment for Multiply-Distorted Images Based on an Improved Bag-of-Words Model , 2015, IEEE Signal Processing Letters.

[14]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[15]  Wenjun Zhang,et al.  FISBLIM: A FIve-Step BLInd Metric for quality assessment of multiply distorted images , 2013, SiPS 2013 Proceedings.

[16]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[17]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[18]  Alan C. Bovik,et al.  C-DIIVINE: No-reference image quality assessment based on local magnitude and phase statistics of natural scenes , 2014, Signal Process. Image Commun..

[19]  Luo-yu Zhou,et al.  No-reference image quality assessment based on noise, blurring and blocking effect , 2014 .

[20]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[21]  Damon M. Chandler,et al.  No-reference image quality assessment based on log-derivative statistics of natural scenes , 2013, J. Electronic Imaging.

[22]  V Kayargadde,et al.  Perceptual characterization of images degraded by blur and noise: experiments. , 1996, Journal of the Optical Society of America. A, Optics, image science, and vision.

[23]  Min Liu,et al.  Blind image quality assessment for noise , 2014, 2014 IEEE International Symposium on Broadband Multimedia Systems and Broadcasting.

[24]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.

[25]  Qionghai Dai,et al.  Learning Receptive Fields and Quality Lookups for Blind Quality Assessment of Stereoscopic Images , 2016, IEEE Transactions on Cybernetics.

[26]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[27]  Zhou Wang,et al.  Reduced-reference image quality assessment using a wavelet-domain natural image statistic model , 2005, IS&T/SPIE Electronic Imaging.

[28]  Damon M. Chandler,et al.  On the perception of band-limited phase distortion in natural scenes , 2011, Electronic Imaging.

[29]  Yair Weiss,et al.  Scale invariance and noise in natural images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[30]  Joydeep Ghosh,et al.  Blind Image Quality Assessment Without Human Training Using Latent Quality Factors , 2012, IEEE Signal Processing Letters.

[31]  Akshay Gore,et al.  Local Standard Deviation Based Image Quality Metrics for JPEG Compressed Images , 2014 .

[32]  Weisi Lin,et al.  No-Reference Quality Assessment for Multiply-Distorted Images in Gradient Domain , 2016, IEEE Signal Processing Letters.

[33]  Gangyi Jiang,et al.  Optimizing Multistage Discriminative Dictionaries for Blind Image Quality Assessment , 2018, IEEE Transactions on Multimedia.

[34]  Stefan Winkler,et al.  A no-reference perceptual blur metric , 2002, Proceedings. International Conference on Image Processing.

[35]  Xin Wang,et al.  Blind Image Quality Assessment for Measuring Image Blur , 2008, 2008 Congress on Image and Signal Processing.

[36]  Christophe Charrier,et al.  Blind Image Quality Assessment: A Natural Scene Statistics Approach in the DCT Domain , 2012, IEEE Transactions on Image Processing.

[37]  Alan C. Bovik,et al.  Making image quality assessment robust , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[38]  Lei Zhang,et al.  Learning without Human Scores for Blind Image Quality Assessment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[39]  Alan C. Bovik,et al.  A Two-Step Framework for Constructing Blind Image Quality Indices , 2010, IEEE Signal Processing Letters.

[40]  Patrick Le Callet,et al.  Subjective quality assessment IRCCyN/IVC database , 2004 .

[41]  Weisi Lin,et al.  A no-reference quality metric for measuring image blur , 2003, Seventh International Symposium on Signal Processing and Its Applications, 2003. Proceedings..

[42]  Alan C. Bovik,et al.  Objective quality assessment of multiply distorted images , 2012, 2012 Conference Record of the Forty Sixth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[43]  Nikolay N. Ponomarenko,et al.  TID2008 – A database for evaluation of full-reference visual quality assessment metrics , 2004 .

[44]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[45]  Fei Zhou,et al.  MDID: A multiply distorted image database for image quality assessment , 2017, Pattern Recognit..

[46]  Phong V. Vu,et al.  A Fast Wavelet-Based Algorithm for Global and Local Image Sharpness Estimation , 2012, IEEE Signal Processing Letters.

[47]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[48]  Xiaojun Wu,et al.  Blind Image Quality Assessment Using a General Regression Neural Network , 2011, IEEE Transactions on Neural Networks.

[49]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[50]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[51]  D. Chandler Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[52]  Yitzhak Yitzhaky,et al.  Blind image quality assessment considering blur, noise, and JPEG compression distortions , 2007, SPIE Optical Engineering + Applications.

[53]  Yitzhak Yitzhaky,et al.  No-reference assessment of blur and noise impacts on image quality , 2010, Signal Image Video Process..

[54]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[55]  D. Ruderman The statistics of natural images , 1994 .

[56]  Wenjun Zhang,et al.  Hybrid No-Reference Quality Metric for Singly and Multiply Distorted Images , 2014, IEEE Transactions on Broadcasting.