Jump map-based interactive texture synthesis

We present techniques for accelerated texture synthesis from example images. The key idea of our approach is to divide the task into two phases: analysis, and synthesis. During the analysis phase, which is performed once per sample texture, we generate a jump map. Using the jump map, the synthesis phase is capable of synthesizing texture similar to the analyzed example at interactive rates. We describe two such synthesis phase algorithms: one for creating images, and one for directly texturing manifold surfaces. We produce texture images at rates comparable to the fastest alternative algorithms, and produce textured surfaces an order of magnitude faster than current alternative approaches. We further develop a new, faster patch-based algorithm for image synthesis, which improves the quality of our results on ordered textures. We show how controls used for specifying texture synthesis on surfaces may be used on images as well, allowing interesting new image-based effects, and highlight modelling applications enabled by the speed of our approach.

[1]  Dan Piponi,et al.  Seamless texture mapping of subdivision surfaces by model pelting and texture blending , 2000, SIGGRAPH.

[2]  Klaus Mueller,et al.  Transferring color to greyscale images , 2002, ACM Trans. Graph..

[3]  Marc Levoy,et al.  Fast texture synthesis using tree-structured vector quantization , 2000, SIGGRAPH.

[4]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[5]  Baining Guo,et al.  Chaos Mosaic: Fast and Memory Efficient Texture Synthesis , 2000 .

[6]  Adam Finkelstein,et al.  Lapped textures , 2000, SIGGRAPH.

[7]  John C. Hart,et al.  Meshed atlases for real-time procedural solid texturing , 2002, TOGS.

[8]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[9]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[10]  Michael Ashikhmin,et al.  Fast Texture Transfer , 2003, IEEE Computer Graphics and Applications.

[11]  Marie-Paule Cani,et al.  Pattern-based texturing revisited , 1999, SIGGRAPH.

[12]  Baining Guo,et al.  Synthesis of bidirectional texture functions on arbitrary surfaces , 2002, SIGGRAPH.

[13]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[14]  Marie-Paule Cani,et al.  Hierarchical pattern mapping , 2002, ACM Trans. Graph..

[15]  Patrick Pérez,et al.  Object removal by exemplar-based inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[16]  I. Jolliffe Principal Component Analysis , 2002 .

[17]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[18]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[19]  Craig Gotsman,et al.  Universal Rendering Sequences for Transparent Vertex Caching of Progressive Meshes , 2002, Comput. Graph. Forum.

[20]  John C. Hart,et al.  Seamster: inconspicuous low-distortion texture seam layout , 2002, IEEE Visualization, 2002. VIS 2002..

[21]  Pedro V. Sander,et al.  Signal-Specialized Parametrization , 2002, Rendering Techniques.

[22]  Marc Levoy,et al.  Texture synthesis over arbitrary manifold surfaces , 2001, SIGGRAPH.

[23]  John M. Snyder,et al.  Signal-Specialized Parameterization , 2002 .

[24]  Greg Turk,et al.  Texture synthesis on surfaces , 2001, SIGGRAPH.

[25]  Richard Szeliski,et al.  Video textures , 2000, SIGGRAPH.

[26]  Harry Shum,et al.  A two-step approach to hallucinating faces: global parametric model and local nonparametric model , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[27]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[28]  Okan Arikan,et al.  Interactive motion generation from examples , 2002, ACM Trans. Graph..

[29]  Steven M. Seitz,et al.  Shape and materials by example: a photometric stereo approach , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[30]  David S. Ebert,et al.  Texturing and Modeling , 1998 .

[31]  Henning Biermann,et al.  Texture and Shape Synthesis on Surfaces , 2001, Rendering Techniques.

[32]  Jean-Michel Dischler,et al.  Texture Particles , 2002, Comput. Graph. Forum.

[33]  Anton Alstes Wang Tiles for Image and Texture Generation , 2004 .

[34]  David Salesin,et al.  Image Analogies , 2001, SIGGRAPH.

[35]  D. Mount ANN Programming Manual , 1998 .

[36]  David H. Laidlaw,et al.  Cellular texture generation , 1995, SIGGRAPH.

[37]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[38]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[39]  ZhouKun,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003 .

[40]  Michael Garland,et al.  Towards Real-Time Texture Synthesis with the Jump Map , 2002, Rendering Techniques.

[41]  Chi-Keung Tang,et al.  Image repairing: robust image synthesis by adaptive ND tensor voting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[42]  David J. Kriegman,et al.  Fast texture synthesis on arbitrary meshes , 2003, SIGGRAPH 2003.

[43]  Steven J. Gortler,et al.  Feature-based cellular texturing for architectural models , 2001, SIGGRAPH.

[44]  Jessica K. Hodgins,et al.  Interactive control of avatars animated with human motion data , 2002, SIGGRAPH.

[45]  Jitendra Malik,et al.  Recognizing surfaces using three-dimensional textons , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[46]  David S. Ebert,et al.  Texturing and Modeling: A Procedural Approach , 1994 .

[47]  Alexei A. Efros,et al.  Texture synthesis by non-parametric sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[48]  Paul Harrison,et al.  A Non-Hierarchical Procedure for Re-Synthesis of Complex Textures , 2001, WSCG.

[49]  Kun Zhou,et al.  Synthesis of progressively-variant textures on arbitrary surfaces , 2003, ACM Trans. Graph..

[50]  Marc Alexa,et al.  Hybrid Texture Synthesis , 2003, Rendering Techniques.

[51]  Michael Garland,et al.  Interactive Texture Synthesis on Surfaces using Jump Maps , 2003, Rendering Techniques.