Feature-aware natural texture synthesis

This article presents a framework for natural texture synthesis and processing. This framework is motivated by the observation that given examples captured in natural scene, texture synthesis addresses a critical problem, namely, that synthesis quality can be affected adversely if the texture elements in an example display spatially varied patterns, such as perspective distortion, the composition of different sub-textures, and variations in global color pattern as a result of complex illumination. This issue is common in natural textures and is a fundamental challenge for previously developed methods. Thus, we address it from a feature point of view and propose a feature-aware approach to synthesize natural textures. The synthesis process is guided by a feature map that represents the visual characteristics of the input texture. Moreover, we present a novel adaptive initialization algorithm that can effectively avoid the repeat and verbatim copying artifacts. Our approach improves texture synthesis in many images that cannot be handled effectively with traditional technologies.

[1]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[2]  Yizhou Yu,et al.  Feature matching and deformation for texture synthesis , 2004, SIGGRAPH 2004.

[3]  Dani Lischinski,et al.  Layered shape synthesis: automatic generation of control maps for non-stationary textures , 2009, SIGGRAPH 2009.

[4]  Li-yi Wei,et al.  Discrete element textures , 2011, SIGGRAPH 2011.

[5]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[6]  Dong-Ming Yan,et al.  Gap processing for adaptive maximal poisson-disk sampling , 2012, TOGS.

[7]  Chang-Hun Kim,et al.  Multi-exemplar inhomogeneous texture synthesis , 2013, Comput. Graph..

[8]  Arnold W. M. Smeulders,et al.  Color texture measurement and segmentation , 2005, Signal Process..

[9]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[10]  Sylvain Lefebvre,et al.  State of the Art in Example-based Texture Synthesis , 2009, Eurographics.

[11]  Sylvain Lefebvre,et al.  Parallel controllable texture synthesis , 2005, ACM Trans. Graph..

[12]  Luc Van Gool,et al.  Composite Texture Synthesis , 2005, International Journal of Computer Vision.

[13]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[14]  Dani Lischinski,et al.  Layered shape synthesis: automatic generation of control maps for non-stationary textures , 2009, ACM Trans. Graph..

[15]  Leonidas J. Guibas,et al.  The Earth Mover's Distance as a Metric for Image Retrieval , 2000, International Journal of Computer Vision.

[16]  Sylvain Lefebvre,et al.  Texture Synthesis From Photographs , 2008, Comput. Graph. Forum.

[17]  Irfan Essa,et al.  Texture optimization for example-based synthesis , 2005, SIGGRAPH 2005.

[18]  Eitan Grinspun,et al.  Multiscale texture synthesis , 2008, SIGGRAPH 2008.

[19]  Yanxi Liu,et al.  Near-regular texture analysis and manipulation , 2004, SIGGRAPH 2004.

[20]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[21]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[22]  Weiming Dong,et al.  Perspective-aware texture analysis and synthesis , 2008, The Visual Computer.

[23]  Li-Yi Wei Multi-class blue noise sampling , 2010, ACM Trans. Graph..

[24]  Weiming Dong,et al.  Interactive Example-Based Natural Scene Synthesis , 2009, 2009 Third International Symposium on Plant Growth Modeling, Simulation, Visualization and Applications.

[25]  Sylvain Lefebvre,et al.  Appearance-space texture synthesis , 2006, ACM Trans. Graph..

[26]  Sylvain Lefebvre,et al.  Dynamic element textures , 2013, ACM Trans. Graph..

[27]  Vladimir G. Kim,et al.  Symmetry-guided texture synthesis and manipulation , 2012, TOGS.

[28]  Lei Li,et al.  Unsupervised color-texture segmentation based on multiscale quaternion Gabor filters and splitting strategy , 2013, Signal Process..

[29]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[30]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[31]  Bobby Bodenheimer,et al.  Synthesis and evaluation of linear motion transitions , 2008, TOGS.