Synthesized Texture Quality Assessment via Multi-scale Spatial and Statistical Texture Attributes of Image and Gradient Magnitude Coefficients

Perceptual quality assessment for synthesized textures is a challenging task. In this paper, we propose a trainingfree reduced-reference (RR) objective quality assessment method that quantifies the perceived quality of synthesized textures. The proposed reduced-reference synthesized texture quality assessment metric is based on measuring the spatial and statistical attributes of the texture image using both image- and gradient-based wavelet coefficients at multiple scales. Performance evaluations on two synthesized texture databases demonstrate that our proposed RR synthesized texture quality metric significantly outperforms both full-reference and RR state-of-the-art quality metrics in predicting the perceived visual quality of the synthesized textures.

[1]  S. Kamel,et al.  Moving object removal in video sequence and background restoration using kalman filter , 2008, 2008 International Symposium on Telecommunications.

[2]  Weisi Lin,et al.  Image Quality Assessment Based on Gradient Similarity , 2012, IEEE Transactions on Image Processing.

[3]  Jens-Rainer Ohm,et al.  Models for Static and Dynamic Texture Synthesis in Image and Video Compression , 2011, IEEE Journal of Selected Topics in Signal Processing.

[4]  Hans-Peter Seidel,et al.  Image restoration using multiresolution texture synthesis and image inpainting , 2003, Proceedings Computer Graphics International 2003.

[5]  Alan C. Bovik,et al.  RRED Indices: Reduced Reference Entropic Differencing for Image Quality Assessment , 2012, IEEE Transactions on Image Processing.

[6]  Dmitry Chetverikov,et al.  A Brief Survey of Dynamic Texture Description and Recognition , 2005, CORES.

[7]  Lina J. Karam,et al.  Wavelet-based adaptive image denoising with edge preservation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[8]  Borko Furht,et al.  Video and Image Processing in Multimedia Systems , 1995 .

[9]  King Ngi Ngan,et al.  An efficient framework for image/video inpainting , 2013, Signal Process. Image Commun..

[10]  A. Bovik,et al.  OBJECTIVE VIDEO QUALITY ASSESSMENT , 2003 .

[11]  Alan C. Bovik,et al.  No-Reference Image Quality Assessment in the Spatial Domain , 2012, IEEE Transactions on Image Processing.

[12]  Zhou Wang,et al.  Reduced-Reference Image Quality Assessment Using Divisive Normalization-Based Image Representation , 2009, IEEE Journal of Selected Topics in Signal Processing.

[13]  Lina J. Karam,et al.  Reduced-reference synthesized-texture quality assessment based on multi-scale spatial and statistical texture attributes , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[14]  Bidyut Baran Chaudhuri,et al.  Texture Segmentation Using Fractal Dimension , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  David L. Neuhoff,et al.  Structural Texture Similarity Metrics for Image Analysis and Retrieval , 2013, IEEE Transactions on Image Processing.

[16]  Eero P. Simoncelli,et al.  A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients , 2000, International Journal of Computer Vision.

[17]  Subhransu Maji,et al.  Deep filter banks for texture recognition and segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Stefano Soatto,et al.  Texture representations for image and video synthesis , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Abdul Rehman,et al.  Reduced-reference SSIM estimation , 2010, 2010 IEEE International Conference on Image Processing.

[20]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[21]  Lina J. Karam,et al.  A reduced-reference perceptual quality metric for texture synthesis , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[22]  Lei Zhang,et al.  A Feature-Enriched Completely Blind Image Quality Evaluator , 2015, IEEE Transactions on Image Processing.

[23]  Yoshua Bengio,et al.  Texture Modeling with Convolutional Spike-and-Slab RBMs and Deep Extensions , 2012, AISTATS.

[24]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[25]  Lina J. Karam,et al.  A no reference texture granularity index and application to visual media compression , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[26]  Alan C. Bovik,et al.  Blind Image Quality Assessment: From Natural Scene Statistics to Perceptual Quality , 2011, IEEE Transactions on Image Processing.

[27]  David L. Neuhoff,et al.  Image analysis and compression: renewed focus on texture , 2010, Electronic Imaging.

[28]  E. Adelson,et al.  Early vision and texture perception , 1988, Nature.

[29]  Chao Yang,et al.  Realistic Dynamic Facial Textures from a Single Image Using GANs , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[30]  Lina J. Karam,et al.  A no-reference perceptual texture regularity metric , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[31]  Edward J. Delp,et al.  Overview of image security techniques with applications in multimedia systems , 1998, Other Conferences.

[32]  Lina J. Karam,et al.  The effect of texture granularity on texture synthesis quality , 2015, SPIE Optical Engineering + Applications.

[33]  Zhou Wang,et al.  Translation insensitive image similarity in complex wavelet domain , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[34]  Tom Minka,et al.  Vision texture for annotation , 1995, Multimedia Systems.

[35]  Lina J. Karam,et al.  Reduced-reference quality assessment based on the entropy of DNT coefficients of locally weighted gradients , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[36]  Wufeng Xue,et al.  Reduced reference image quality assessment based on Weibull statistics , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[37]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[38]  A. R. Rao,et al.  A Taxonomy for Texture Description and Identification , 1990, Springer Series in Perception Engineering.

[39]  Ezzatollah Salari,et al.  Texture segmentation using hierarchical wavelet decomposition , 1995, Pattern Recognit..

[40]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[41]  Andrea Vedaldi,et al.  Texture Networks: Feed-forward Synthesis of Textures and Stylized Images , 2016, ICML.

[42]  Sheila S. Hemami,et al.  Parametric quality assessment of synthesized textures , 2011, Electronic Imaging.

[43]  Takashi Matsuyama,et al.  Generation, visualization, and editing of 3D video , 2002, Proceedings. First International Symposium on 3D Data Processing Visualization and Transmission.

[44]  Sergei Nirenburg,et al.  Generation , 2004, Machine Translation.

[45]  James M. Keller,et al.  Texture description and segmentation through fractal geometry , 1989, Comput. Vis. Graph. Image Process..

[46]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[47]  Zhou Wang,et al.  Multiscale structural similarity for image quality assessment , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[48]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[49]  Alan C. Bovik,et al.  Making a “Completely Blind” Image Quality Analyzer , 2013, IEEE Signal Processing Letters.

[50]  Chih-Yi Chiu,et al.  Finding textures by textual descriptions, visual examples, and relevance feedbacks , 2003, Pattern Recognit. Lett..

[51]  David Zhang,et al.  FSIM: A Feature Similarity Index for Image Quality Assessment , 2011, IEEE Transactions on Image Processing.

[52]  Ronald R. Coifman,et al.  Entropy-based algorithms for best basis selection , 1992, IEEE Trans. Inf. Theory.

[53]  Matthew G. Reyes,et al.  Structural texture similarity metrics for retrieval applications , 2008, 2008 15th IEEE International Conference on Image Processing.