Screen Content Picture Quality Evaluation by Colorful Sparse Reference Information

With the rapid development of multimedia interactive applications, the processing volume of the screen content (SC) images is increasing day by day. The research on image quality assessment is the basis of many other applications. The focus of general image quality assessment (QA) research is natural scene (NS) images, now for the quality assessment research of SC images becomes very urgent and has received more and more attention. Accurate quality assessment of SC images helps improve the user experience. Based on these, this paper proposes an improved method using very sparse reference information for accurate quality assessment of SC images. Specifically, the proposed method extracts macroscopic, microscopic structure and color information respectively, and measures the differences in terms of macroscopic, microscopic features and color information between the original SC image and its distorted version, and finally calculates the overall quality score of the distorted SC image. The quality assessment model we built uses a dimension reduction histogram and only needs to transmit very sparse reference information. Experiments show that the proposed method has obvious superiority over the state-of-the-art relevant quality metrics in the visual quality assessment of SC images.

[1]  Wenjun Zhang,et al.  No-Reference Quality Metric of Contrast-Distorted Images Based on Information Maximization , 2017, IEEE Transactions on Cybernetics.

[2]  Chunping Hou,et al.  Biologically Inspired Blind Quality Assessment of Tone-Mapped Images , 2018, IEEE Transactions on Industrial Electronics.

[3]  Weisi Lin,et al.  The Analysis of Image Contrast: From Quality Assessment to Automatic Enhancement , 2016, IEEE Transactions on Cybernetics.

[4]  Susu Yao,et al.  Just noticeable distortion model and its applications in video coding , 2005, Signal Process. Image Commun..

[5]  Weisi Lin,et al.  A Psychovisual Quality Metric in Free-Energy Principle , 2012, IEEE Transactions on Image Processing.

[6]  Weisi Lin,et al.  Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile , 2005, IEEE Trans. Circuits Syst. Video Technol..

[7]  Xiang Zhu,et al.  Automatic Parameter Selection for Denoising Algorithms Using a No-Reference Measure of Image Content , 2010, IEEE Transactions on Image Processing.

[8]  Weisi Lin,et al.  A Fast Reliable Image Quality Predictor by Fusing Micro- and Macro-Structures , 2017, IEEE Transactions on Industrial Electronics.

[9]  Sunil Prasad Jaiswal,et al.  A Prediction Backed Model for Quality Assessment of Screen Content and 3-D Synthesized Images , 2018, IEEE Transactions on Industrial Informatics.

[10]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[11]  Weisi Lin,et al.  Saliency-Guided Quality Assessment of Screen Content Images , 2016, IEEE Transactions on Multimedia.

[12]  Zhou Wang,et al.  Reduced-reference image quality assessment using a wavelet-domain natural image statistic model , 2005, IS&T/SPIE Electronic Imaging.

[13]  Weisi Lin,et al.  Efficient Image Deblocking Based on Postfiltering in Shifted Windows , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Wen Gao,et al.  Subjective and Objective Quality Assessment of Compressed Screen Content Images , 2016, IEEE Journal on Emerging and Selected Topics in Circuits and Systems.

[15]  Weisi Lin,et al.  Perceptual Visual Signal Compression and Transmission , 2013, Proceedings of the IEEE.

[16]  Yutao Liu,et al.  Blind Image Quality Estimation via Distortion Aggravation , 2018, IEEE Transactions on Broadcasting.

[17]  Weisi Lin,et al.  Fourier Transform-Based Scalable Image Quality Measure , 2012, IEEE Transactions on Image Processing.

[18]  Xiongkuo Min,et al.  Blind Quality Assessment Based on Pseudo-Reference Image , 2018, IEEE Transactions on Multimedia.

[19]  Baocai Yin,et al.  Screen Content Coding Based on HEVC Framework , 2014, IEEE Transactions on Multimedia.

[20]  Ke Gu,et al.  Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Kai-Kuang Ma,et al.  Gradient Direction for Screen Content Image Quality Assessment , 2016, IEEE Signal Processing Letters.

[22]  Wenjun Zhang,et al.  Using Free Energy Principle For Blind Image Quality Assessment , 2015, IEEE Transactions on Multimedia.

[23]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[24]  Wenjun Zhang,et al.  Automatic Contrast Enhancement Technology With Saliency Preservation , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Chang Wen Chen,et al.  Editorial: On Building a Stronger Multimedia Community , 2016, IEEE Trans. Multim..

[26]  Hongyu Li,et al.  VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment , 2014, IEEE Transactions on Image Processing.

[27]  Wenjun Zhang,et al.  A new reduced-reference image quality assessment using structural degradation model , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[28]  Weisi Lin,et al.  Perceptual Quality Assessment of Screen Content Images , 2015, IEEE Transactions on Image Processing.

[29]  Xiongkuo Min,et al.  Objective Quality Evaluation of Dehazed Images , 2019, IEEE Transactions on Intelligent Transportation Systems.

[30]  Sam Kwong,et al.  Toward Accurate Quality Estimation of Screen Content Pictures With Very Sparse Reference Information , 2020, IEEE Transactions on Industrial Electronics.

[31]  Wen Gao,et al.  Reduced-Reference Quality Assessment of Screen Content Images , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Guangming Shi,et al.  Reduced-Reference Image Quality Assessment With Visual Information Fidelity , 2013, IEEE Transactions on Multimedia.

[33]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[34]  Jianfei Cai,et al.  Cross-Dimensional Perceptual Quality Assessment for Low Bit-Rate Videos , 2008, IEEE Transactions on Multimedia.

[35]  Zhou Wang,et al.  Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[36]  Ke Gu,et al.  No-Reference Quality Assessment of Screen Content Pictures , 2017, IEEE Transactions on Image Processing.