Texture Smoothing Quality Assessment via Information Entropy

Image texture smoothing (ITS) aims at completely removing textures while preserving as much as possible different-scale structures of an image. However, few quality assessment metrics have been formulated to objectively evaluate the ITS results, due to the lack of ground-truth texture-free images. Considering both the smoothness of textures and the preservation of structures, we make the debut of objective evaluation of ITS results, and design an intuitive Texture Smoothness and Structural Similarity Index (T3SI) based on human perception. Specifically, we first intuitively select some patches which contain relatively more texture/structure information. We then employ the Edge Preservation Index and the Structural Similarity Index Measure to evaluate the texture smoothness and the structure similarity on the selected patches, respectively. We finally formulate the novel exponential entropy function to balance the texture smoothness and the structure similarity for the quality assessment of ITS. T3SI is objective, easy to use, simple to implement, and stable. An independent User Study is performed to verify our proposed T3SI, and large experiments show that T3SI competes successfully to the state-of-the-art metrics. Our code is publicly available.

[1]  Mohammed Ghanbari,et al.  Scope of validity of PSNR in image/video quality assessment , 2008 .

[2]  Seungyong Lee,et al.  Bilateral texture filtering , 2014, ACM Trans. Graph..

[3]  Zhou Wang,et al.  A highly efficient method for blind image quality assessment , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[4]  S. Gambhir,et al.  Preclinical safety evaluation of 18F-FHBG: a PET reporter probe for imaging herpes simplex virus type 1 thymidine kinase (HSV1-tk) or mutant HSV1-sr39tk's expression. , 2006, Journal of nuclear medicine : official publication, Society of Nuclear Medicine.

[5]  Zhou Wang,et al.  Information Content Weighting for Perceptual Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[6]  Alan C. Bovik,et al.  No-Reference Quality Assessment of Natural Stereopairs , 2013, IEEE Transactions on Image Processing.

[7]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  Hua Yang,et al.  Sparse Feature Fidelity for Perceptual Image Quality Assessment , 2013, IEEE Transactions on Image Processing.

[9]  Raúl San José Estépar,et al.  Image Quality Assessment based on Local Variance , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[11]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[12]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[13]  Sumohana S. Channappayya,et al.  Blind image quality evaluation using perception based features , 2015, 2015 Twenty First National Conference on Communications (NCC).

[14]  Guangtao Zhai,et al.  Free Energy Adjusted Peak Signal to Noise Ratio (FEA-PSNR) for Image Quality Assessment , 2017 .

[15]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[16]  Ke Gu,et al.  Content-weighted mean-squared error for quality assessment of compressed images , 2016, Signal Image Video Process..

[17]  Göran Salomonsson,et al.  Image enhancement based on a nonlinear multiscale method , 1997, IEEE Trans. Image Process..

[18]  Laurence W. Cahill,et al.  A new criterion for the evaluation of image restoration quality , 1992, TENCON'92 - Technology Enabling Tomorrow.

[19]  Yong Gan,et al.  Perceptual image quality assessment by independent feature detector , 2015, Neurocomputing.

[20]  Qionghai Dai,et al.  Learning Blind Quality Evaluator for Stereoscopic Images Using Joint Sparse Representation , 2016, IEEE Transactions on Multimedia.

[21]  Roushain Akhter,et al.  No-reference stereoscopic image quality assessment , 2010, Electronic Imaging.

[22]  Alan C. Bovik,et al.  Subjective evaluation of stereoscopic image quality , 2013, Signal Process. Image Commun..

[23]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[24]  Kai Zeng,et al.  Quality prediction of asymmetrically distorted stereoscopic images from single views , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[25]  Yanqing Li,et al.  No-Reference Stereoscopic Image Quality Assessment Using Natural Scene Statistics , 2017, 2017 2nd International Conference on Multimedia and Image Processing (ICMIP).

[26]  Zhuo Chen,et al.  Unified No-Reference Quality Assessment of Singly and Multiply Distorted Stereoscopic Images , 2019, IEEE Transactions on Image Processing.

[27]  Tony F. Chan,et al.  Total Variation Denoising and Enhancement of Color Images Based on the CB and HSV Color Models , 2001, J. Vis. Commun. Image Represent..

[28]  Oleksiy B. Pogrebnyak,et al.  Efficiency of texture image enhancement by DCT-based filtering , 2016, Neurocomputing.

[29]  Xiangmin Xu,et al.  Edge/structure preserving smoothing via relativity-of-Gaussian , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[30]  Lei Zhang,et al.  Perceptual Fidelity Aware Mean Squared Error , 2013, 2013 IEEE International Conference on Computer Vision.

[31]  Lei Zhang,et al.  RFSIM: A feature based image quality assessment metric using Riesz transforms , 2010, 2010 IEEE International Conference on Image Processing.

[32]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[33]  Qi Zhang,et al.  Rolling Guidance Filter , 2014, ECCV.

[34]  Alan C. Bovik,et al.  A Statistical Evaluation of Recent Full Reference Image Quality Assessment Algorithms , 2006, IEEE Transactions on Image Processing.

[35]  Wufan Chen,et al.  Texture-Preserving Image Deblurring , 2010, IEEE Signal Processing Letters.

[36]  Ezzedine Ben Braiek,et al.  Efficient image texture and structure preservation via a Rapid diffusion function with accelerator , 2018, 2018 4th International Conference on Advanced Technologies for Signal and Image Processing (ATSIP).

[37]  Jing Li,et al.  Structure-preserving texture filtering for adaptive image smoothing , 2018, J. Vis. Lang. Comput..

[38]  Li Xu,et al.  Structure extraction from texture via relative total variation , 2012, ACM Trans. Graph..