Multiple Texture Stitching and Blending on 3D Objects

In this paper we propose a new approach for mapping and blending textures on 3D geometries. The system starts from a 3D mesh which represents a real object and improves this model with pictorial detail. Texture detail is acquired via a common photographic process directly from the real object. These images are then registered and stitched on the 3D mesh, by integrating them into a single standard texture map. An optimal correspondence between regions of the 3D mesh and sections of the acquired images is built. Then, a new approach is proposed to produce a smooth join between different images that map on adjacent sections of the surface, based on texture blending. For each mesh face which is on the adjacency border between different observed images, a corresponding triangular texture patch is resampled as a weighted blend of the corresponding adjacent images sections. The accuracy of the resampling and blending process is improved by computing an accurate piecewise local registration of the original images with respect to the current face vertices. Examples of the results obtained with sample Cultural Heritage objects are presented and discussed.

[1]  Edward H. Adelson,et al.  A multiresolution spline with application to image mosaics , 1983, TOGS.

[2]  John E. Beasley,et al.  An Exact Two-Dimensional Non-Guillotine Cutting Tree Search Procedure , 1985, Oper. Res..

[3]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[4]  Mohan S. Kankanhalli,et al.  Efficiency of Uniform Grids for Intersection Detection on Serial and Parallel Machines , 1988 .

[5]  Marc Rioux,et al.  Color Reflectance Modeling Using a Polychromatic Laser Range Sensor , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[7]  Bob Francis,et al.  Silicon Graphics Inc. , 1993 .

[8]  T. Caelli,et al.  Inverting an illumination model from range and intensity maps , 1994 .

[9]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[10]  James J. Little,et al.  Reflectance function estimation and shape recovery from image sequence of a rotating object , 1995, Proceedings of IEEE International Conference on Computer Vision.

[11]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[12]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[13]  Katsushi Ikeuchi,et al.  Reflectance Analysis for 3D Computer Graphics Model Generation , 1996, CVGIP Graph. Model. Image Process..

[14]  Marc Rioux,et al.  Sensors and algorithms for the construction of digital 3-D colour models of real objects , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[15]  Paolo Cignoni,et al.  Multiresolution decimation based on global error , 1996, The Visual Computer.

[16]  Katsushi Ikeuchi,et al.  Object shape and reflectance modeling from observation , 1997, SIGGRAPH.

[17]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[18]  Linda G. Shapiro,et al.  View-base Rendering: Visualizing Real Objects from Scanned Range and Color Data , 1997, Rendering Techniques.

[19]  Gabriel Taubin,et al.  Appying Shape from Lighting Variation to Bump Map Capture , 1997, Rendering Techniques.

[20]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[21]  Michael Petrov,et al.  Optical 3D Digitizers: Bringing Life to the Virtual World , 1998, IEEE Computer Graphics and Applications.

[22]  Gabriel Taubin,et al.  Acquiring Input for Rendering at Appropriate Levels of Detail: Digitizing a Tietà , 1998, Rendering Techniques.

[23]  Harry Shum,et al.  Construction and refinement of panoramic mosaics with global and local alignment , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[24]  Stephen Robert Marschner,et al.  Inverse Rendering for Computer Graphics All Rights Reserved Inverse Rendering for Computer Graphics , 1998 .

[25]  S. Marschner,et al.  Inverse Rendering for Computer Graphics , 1998 .

[26]  Jitendra Malik,et al.  Recovering photometric properties of architectural scenes from photographs , 1998, SIGGRAPH.

[27]  Paolo Cignoni,et al.  Preserving attribute values on simplified meshes by resampling detail textures , 1998, The Visual Computer.