Style-learning with feature-based texture synthesis

The objective of artistic style learning is to synthesize a new image from a source image with the style learnt from example images. Existing example-based texture synthesis (EBTS) techniques model style with low-level statistical properties. These methods work well with some artistic styles such as oil painting, but have difficulties in preserving image details and features for other styles, such as pencil hatching. In this article, an improved artistic style-learning algorithm with feature-based texture synthesis (FBTS) is introduced. Compared with existing EBTS methods, in our FBTS algorithm, image details and features are better defined with a feature field generated from the source image. Also, an improved L2 neighborhood distance metric which provides better measures of perceptual similarity is proposed. Results and comparisons are given to demonstrate the effectiveness of the FBTS algorithm with applications in the areas of stylized shading and artistic style transfer.

[1]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[2]  Max Mignotte Bayesian rendering with non-parametric multiscale prior model , 2002, Object recognition supported by user interaction for service robots.

[3]  Hong Qin,et al.  An Effective Illustrative Visualization Framework Based on Photic Extremum Lines (PELs) , 2007, IEEE Transactions on Visualization and Computer Graphics.

[4]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[5]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[6]  Gunilla Borgefors,et al.  Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[8]  William T. Freeman,et al.  Example-Based Super-Resolution , 2002, IEEE Computer Graphics and Applications.

[9]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[10]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[11]  Marie-Paule Cani,et al.  Hierarchical pattern mapping , 2002, ACM Trans. Graph..

[12]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[13]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[14]  Yizhou Yu,et al.  Feature matching and deformation for texture synthesis , 2004, SIGGRAPH 2004.