Feature Guided Texture Synthesis (FGTS) for artistic style transfer

Artistic images and paintings can be regarded as a composition of content and style. The aim of artistic style transfer is to synthesize a stylized image with content of source image but novel style from style example. Based on texture synthesis, a novel Feature Guided Texture Synthesis (FGTS) algorithm for artistic style transfer is proposed in this paper. Compared with existing example-based methods, the content of a source image is better defined in FGTS with a feature field generated from the source image. Though the style is modelled with low-level statistical features, the style transfer process is guided with the feature field which incorporates style and content during synthesis process. Moreover, a modified L neighborhood distance metric is developed to provide better measures of perceptual similarity. Results and comparisons are given to demonstrate that FGTS is an effective method for artistic style transfer.

[1]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[2]  Marie-Paule Cani,et al.  Hierarchical pattern mapping , 2002, ACM Trans. Graph..

[3]  John W. Buchanan,et al.  Texture‐based Dither Matrices , 2000, Comput. Graph. Forum.

[4]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[5]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[6]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[7]  Oleg Veryovka.  Animation with Threshold Textures , 2002, Graphics Interface.

[8]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[9]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[11]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[12]  Roger D. Hersch,et al.  Artistic screening , 1995, SIGGRAPH.

[13]  Yizhou Yu,et al.  Feature matching and deformation for texture synthesis , 2004, SIGGRAPH 2004.

[14]  John W. Buchanan,et al.  Comprehensive Halftoning of 3D Scenes , 1999, Comput. Graph. Forum.

[15]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[16]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[17]  Max Mignotte.  Bayesian rendering with non-parametric multiscale prior model , 2002, Object recognition supported by user interaction for service robots.