MaskedPhotoBlending:mappingdensephotographicdataset onhigh-resolutionsampled3Dmodels

The technological advance of sensors is producing an exponential size growth of the data coming from 3D scanning and digital photography. The production of digital 3D models consisting of tens or even hundreds of millions of triangles is quite easy nowadays; at the same time, using high-resolution digital cameras it is also straightforward to produce a set of pictures of the same real object totalling more than 50M Pixel. The problem is how to manage all this data to produce 3D models that could fit the interactive rendering constraints. A common approach is to go for mesh parametrization and texture synthesis, but finding a parametrization for such large meshes and managing such large textures can be prohibitive. Moreover, digital photo sampling produces highly redundant data; this redundancy should be eliminated while mapping to the 3D model but, at the same time, should also be efficiently used to improve the sampled data coherence and the appearance representation accuracy. In this paper we present an approach where a multivariate blending function weights all the available pixel data with respect to geometric, topological and colorimetric criteria. The blending approach proposed is efficient, since it mostly works independently on each image, and can be easily extended to include other image quality estimators. The resulting weighted pixels are then selectively mapped on the geometry, preferably by adopting a multiresolution per-vertex encoding to make profitable use of all the data available and to avoid the texture size bottleneck. Some practical examples on complex datasets are presented.

[1]  Hans-Peter Seidel,et al.  Automated texture registration and stitching for real world models , 2000, Proceedings the Eighth Pacific Conference on Computer Graphics and Applications.

[2]  H. Shum,et al.  TextureMontage: Seamless Texturing of Arbitrary Surfaces From Multiple Images , 2005, SIGGRAPH 2005.

[3]  Robert B. Fisher,et al.  Colour texture fusion of multiple range images , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[4]  Hans-Peter Seidel,et al.  Image restoration using multiresolution texture synthesis and image inpainting , 2003, Proceedings Computer Graphics International 2003.

[5]  Sébastien Roy,et al.  Automatic relighting of overlapping textures of a 3D model , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Robert B. Fisher,et al.  Fusing multiple color images for texturing models , 2004 .

[7]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[8]  Holly E. Rushmeier,et al.  High-Quality Texture Reconstruction from Multiple Scans , 2001, IEEE Trans. Vis. Comput. Graph..

[9]  Paolo Cignoni,et al.  Reconstructing Textured Meshes from Multiple Range RGB Maps , 2002, VMV.

[10]  Francois Blais,et al.  GoLD: Interactive Display of Huge Colored and Textured Models Louis Borgeat Guy Godin Franc ‚ois Blais Philippe Massicotte National Research Council of Canada , 2005, SIGGRAPH 2005.

[11]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[12]  Linda G. Shapiro,et al.  Acquisition and visualization of colored 3D objects , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[13]  Paul Debevec,et al.  Inverse global illumination: Recovering re?ectance models of real scenes from photographs , 1998 .

[14]  Adam Baumberg,et al.  Blending Images for Texturing 3D Models , 2002, BMVC.

[15]  Katsushi Ikeuchi,et al.  Illumination from Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Paolo Cignoni,et al.  Minimizing user intervention in registering 2D images to 3D models , 2005, The Visual Computer.

[17]  Borivoj Vojnovic,et al.  An Algorithm for image stitching and blending , 2005, SPIE BiOS.

[18]  Paolo Cignoni,et al.  Multiple Texture Stitching and Blending on 3D Objects , 1999, Rendering Techniques.

[19]  Theo Gevers Reflectance-based classification of color edges , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[20]  Paolo Cignoni,et al.  Batched multi triangulation , 2005, VIS 05. IEEE Visualization, 2005..

[21]  Fadi Dornaika,et al.  Robust camera calibration using 2D-to-3D feature correspondences , 1997, Optics & Photonics.

[22]  Touradj Ebrahimi,et al.  Cast shadow segmentation using invariant color features , 2004, Comput. Vis. Image Underst..

[23]  Paolo Cignoni,et al.  Exploiting the scanning sequence for automatic registration of large sets of range maps , 2005, Comput. Graph. Forum.

[24]  Joachim Bauer,et al.  High-quality texture reconstruction from multiple views , 2001, Comput. Animat. Virtual Worlds.