Blind quality assessment for screen content images by orientation selectivity mechanism

Abstract Currently, most objective image quality assessment (IQA) methods designed for screen content images (SCIs) require reference information, and existing blind IQA metrics cannot obtain consistent results with subjective scores. In this study, we propose a novel blind IQA method for SCIs based on orientation selectivity mechanism. First, we extract orientation features to compute the visual distortion of degraded SCIs by orientation selectivity mechanism. The statistical orientation features are further obtained by the histogram of orientation features. Second, the statistical structure features are calculated as the complementary information of orientation features for quality prediction of degraded SCIs. Finally, we employ support vector regression (SVR) as the mapping function from these extracted statistical features to quality scores. Experimental results show that the proposed method can obtain better performance of visual quality prediction for SCIs than other existing related methods.

[1]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[2]  Wenjun Zhang,et al.  Structural similarity weighting for image quality assessment , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[3]  Weisi Lin,et al.  BSD: Blind image quality assessment based on structural degradation , 2017, Neurocomputing.

[4]  Rik Van de Walle,et al.  Adaptive guided image filtering for screen content coding , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[5]  Gangyi Jiang,et al.  Toward a Blind Quality Predictor for Screen Content Images , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  Wen Gao,et al.  Reduced-Reference Quality Assessment of Screen Content Images , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  F. Campbell,et al.  Orientational selectivity of the human visual system , 1966, The Journal of physiology.

[8]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[10]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[11]  Zhou Wang,et al.  A Patch-Structure Representation Method for Quality Assessment of Contrast Changed Images , 2015, IEEE Signal Processing Letters.

[12]  Weisi Lin,et al.  Saliency-Guided Quality Assessment of Screen Content Images , 2016, IEEE Transactions on Multimedia.

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Shervin Minaee,et al.  Screen Content Image Segmentation Using Robust Regression and Sparse Decomposition , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[15]  Abdul Rehman,et al.  Reduced-Reference Image Quality Assessment by Structural Similarity Estimation , 2012, IEEE Transactions on Image Processing.

[16]  Lei Zhang,et al.  Blind Image Quality Assessment Using Joint Statistics of Gradient Magnitude and Laplacian Features , 2014, IEEE Transactions on Image Processing.

[17]  Kai-Kuang Ma,et al.  Screen content image quality assessment using edge model , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[18]  Weisi Lin,et al.  Screen image quality assessment incorporating structural degradation measurement , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[19]  Guangming Shi,et al.  Perceptual Quality Metric With Internal Generative Mechanism , 2013, IEEE Transactions on Image Processing.

[20]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[21]  Weisi Lin,et al.  Scale and Orientation Invariant Text Segmentation for Born-Digital Compound Images , 2015, IEEE Transactions on Cybernetics.

[22]  H. Nothdurft Sensitivity for structure gradient in texture discrimination tasks , 1985, Vision Research.

[23]  Hua Huang,et al.  Image Quality Assessment Using Directional Anisotropy Structure Measurement , 2017, IEEE Transactions on Image Processing.

[24]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[25]  Songlin Du,et al.  Blind image quality assessment with the histogram sequences of high-order local derivative patterns , 2016, Digit. Signal Process..

[26]  Liming Chen,et al.  HSOG: A Novel Local Image Descriptor Based on Histograms of the Second-Order Gradients , 2014, IEEE Transactions on Image Processing.

[27]  Kai-Kuang Ma,et al.  Gradient Direction for Screen Content Image Quality Assessment , 2016, IEEE Signal Processing Letters.

[28]  Zhou Wang,et al.  No-Reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics , 2015, IEEE Signal Processing Letters.

[29]  Yuming Fang,et al.  No reference quality assessment for stereoscopic images by statistical features , 2017, 2017 Ninth International Conference on Quality of Multimedia Experience (QoMEX).

[30]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[31]  Jizheng Xu,et al.  Overview of the Emerging HEVC Screen Content Coding Extension , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Alan C. Bovik,et al.  Image information and visual quality , 2006, IEEE Trans. Image Process..

[33]  Weisi Lin,et al.  No-reference image quality assessment based on high order derivatives , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[34]  Wen Gao,et al.  Subjective and Objective Quality Assessment of Compressed Screen Content Images , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[35]  Kai Zeng,et al.  Objective Quality Assessment and Perceptual Compression of Screen Content Images , 2018, IEEE Computer Graphics and Applications.

[36]  Guangming Shi,et al.  Orientation selectivity based visual pattern for reduced-reference image quality assessment , 2016, Inf. Sci..

[37]  Shibao Zheng,et al.  Image quality assessment based on local edge direction histogram , 2011, 2011 International Conference on Image Analysis and Signal Processing.

[38]  Joydeep Ghosh,et al.  Blind Image Quality Assessment Without Human Training Using Latent Quality Factors , 2012, IEEE Signal Processing Letters.

[39]  Lei Zhang,et al.  Learning without Human Scores for Blind Image Quality Assessment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[40]  Weisi Lin,et al.  Perceptual Quality Assessment of Screen Content Images , 2015, IEEE Transactions on Image Processing.

[41]  Shiqi Wang,et al.  Objective Quality Assessment of Screen Content Images by Structure Information , 2016, PCM.

[42]  Zhou Wang,et al.  Spatial Pooling Strategies for Perceptual Image Quality Assessment , 2006, 2006 International Conference on Image Processing.

[43]  Zhou Wang,et al.  Subjective quality assessment of Screen Content Images , 2014, 2014 Sixth International Workshop on Quality of Multimedia Experience (QoMEX).

[44]  Weisi Lin,et al.  Learning a blind quality evaluation engine of screen content images , 2016, Neurocomputing.

[45]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[46]  Weisi Lin,et al.  No-Reference Image Sharpness Assessment in Autoregressive Parameter Space , 2015, IEEE Transactions on Image Processing.

[47]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[48]  Jiaying Liu,et al.  Objective Quality Assessment of Screen Content Images by Uncertainty Weighting , 2017, IEEE Transactions on Image Processing.

[49]  Yong Xu,et al.  Fractal Analysis for Reduced Reference Image Quality Assessment , 2015, IEEE Transactions on Image Processing.

[50]  Shiqi Wang,et al.  Study on subjective quality assessment of Screen Content Images , 2015, 2015 Picture Coding Symposium (PCS).

[51]  Guangming Shi,et al.  Visual Orientation Selectivity Based Structure Description , 2015, IEEE Transactions on Image Processing.

[52]  Wen Gao,et al.  Joint Chroma Downsampling and Upsampling for Screen Content Image , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[53]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[54]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[55]  Lei Zhang,et al.  Gradient Magnitude Similarity Deviation: A Highly Efficient Perceptual Image Quality Index , 2013, IEEE Transactions on Image Processing.