Fast Texture Synthesis for Discrete Example-Based Elements

Considering the problem of discrete texture synthesis and the time for texturing, this paper proposes a novel framework for synthesizing texture images based on discrete example-based elements. We start with extracting texture feature distribution from exemplars and then produce discrete elements based on the cluster algorithm. After initializing a texture image, we propose a texture optimization algorithm based on heuristic searching to improve the quality of the texture image. Final, we use a texture transfer method based on Convolutional Neural Network (CNN) to stylize the optimized texture image. Our results show that the proposed texture synthesis method can significantly improve the quality of discrete texture synthesis and effectively shorten the time for texture generation.

[1]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[2]  M. Nouri,et al.  Non-destructive Evaluation of Bread Staling Using Gray Level Co-occurrence Matrices , 2018, Food Analytical Methods.

[3]  Andrea Vedaldi,et al.  Improved Texture Networks: Maximizing Quality and Diversity in Feed-Forward Stylization and Texture Synthesis , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  S. Avidan,et al.  Seam carving for content-aware image resizing , 2007, SIGGRAPH 2007.

[5]  Wesley Nunes Gonçalves,et al.  Texture Analysis by Bag-Of-Visual-Words of Complex Networks , 2015, CIARP.

[6]  Adam Finkelstein,et al.  Lapped textures , 2000, SIGGRAPH.

[7]  Yee-Hong Yang,et al.  Noise robust rotation invariant features for texture classification , 2013, Pattern Recognit..

[8]  Kuo-Lung Wu,et al.  Mean shift-based clustering , 2007, Pattern Recognit..

[9]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[10]  Anne Humeau-Heurtier,et al.  Texture Feature Extraction Methods: A Survey , 2019, IEEE Access.

[11]  Nipun Kwatra,et al.  Texture optimization for example-based synthesis , 2005, ACM Trans. Graph..

[12]  P. Sathyanarayana,et al.  Image Texture Feature Extraction Using GLCM Approach , 2013 .

[13]  Hiranmay Ghosh,et al.  Histogram of gradient magnitudes: A rotation invariant texture-descriptor , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[14]  Leon A. Gatys,et al.  A Neural Algorithm of Artistic Style , 2015, ArXiv.

[15]  Paul Merrell,et al.  Example-based model synthesis , 2007, SI3D.

[16]  Gui-Song Xia,et al.  Conditional Generative ConvNets for Exemplar-based Texture Synthesis , 2021, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[17]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[18]  Bin Song,et al.  Exemplar based regular texture synthesis using LSTM , 2019, Pattern Recognit. Lett..

[19]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[20]  Li-Yi Wei,et al.  Discrete element textures , 2011, ACM Trans. Graph..

[21]  T. Mattfeldt.  Stochastic Geometry and Its Applications , 1996 .

[22]  Yuanyuan Huang,et al.  Deep Decomposition of Circularly Symmetric Gabor Wavelet for rotation-invariant texture image classification , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[23]  S. Thewsuwan,et al.  TEXTURE CLASSIFICATION BY LOCAL SPATIAL PATTERN MAPPING BASED ON COMPLEX NETWORK MODEL , 2018 .

[24]  Yang Liu,et al.  Discrete texture elements synthesis on surfaces using elements distribution , 2020 .

[25]  Luc Van Gool,et al.  Example-Based Facade Texture Synthesis , 2013, 2013 IEEE International Conference on Computer Vision.

[26]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[27]  James McCann,et al.  Painting with CATS: Camera-Aided Texture Synthesis , 2019, CHI.

[28]  André Ricardo Backes,et al.  A simplified gravitational model to analyze texture roughness , 2012, Pattern Recognit..

[29]  R. Mohebian,et al.  Detection of channel by seismic texture analysis using Grey Level Co-occurrence Matrix based attributes , 2018, Journal of Geophysics and Engineering.

[30]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[31]  Marc Levoy,et al.  Order-Independent Texture Synthesis , 2014, ArXiv.

[32]  Zhezhou Yu,et al.  Histogram of Oriented Gradient Based Gist Feature for Building Recognition , 2016, Comput. Intell. Neurosci..

[33]  Jean-Michel Dischler,et al.  Texture Particles , 2002, Comput. Graph. Forum.

[34]  Hujun Yin,et al.  Markov Random Field Based Convolutional Neural Networks for Image Classification , 2017, IDEAL.

[35]  Jun Zhang,et al.  Scale invariant texture representation based on frequency decomposition and gradient orientation , 2015, Pattern Recognit. Lett..

[36]  Ming-Hsuan Yang,et al.  Diversified Texture Synthesis with Feed-Forward Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).