A Shadow Based Method for Image to Model Registration

This paper presents a novel method for 2D to 3D texture mapping using shadows as cues. This work is part of a larger set of methods that address the entire 3D modeling pipeline to create geometrically and photometrically accurate models using a variety of data sources. The focus is on building models of large outdoor, urban, historic and archaeological sites. We pose registration of 2D images with the 3D model as an optimization problem that uses knowledge of the Sun's position to estimate shadows in a scene, and use the shadows produced as a cue to refine the registration parameters. Results are presented for registration where ground truth is known and also for a large scale model consisting of 14 3D scans and 10 images on a large archaeological site in Sicily.

[1]  Ioannis Stamos,et al.  Automatic registration of 2-D with 3-D imagery in urban environments , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Ioannis Stamos,et al.  New Methods for Digital Modeling of Historic Sites , 2003, IEEE Computer Graphics and Applications.

[3]  R. Bruce Irvin,et al.  Methods for exploiting the relationship between buildings and their shadows in aerial imagery , 1989, IEEE Trans. Syst. Man Cybern..

[4]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[5]  Atsushi Nakazawa,et al.  Creating Virtual Buddha Statues through Observation , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[6]  Gabriel Taubin,et al.  Building a Digital Model of Michelangelo's Florentine Pietà , 2002, IEEE Computer Graphics and Applications.

[7]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[8]  Paolo Cignoni,et al.  Multiple Texture Stitching and Blending on 3D Objects , 1999, Rendering Techniques.

[9]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[10]  Holly E. Rushmeier,et al.  The 3D Model Acquisition Pipeline , 2002, Comput. Graph. Forum.

[11]  Hans-Peter Seidel,et al.  A Silhouette-Based Algorithm for Texture Registration and Stitching , 2001, Graph. Model..

[12]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[13]  I. Reda,et al.  Solar position algorithm for solar radiation applications , 2004 .

[14]  L. Ingber.  Very fast simulated re-annealing , 1989 .

[15]  Linda G. Shapiro,et al.  View-base Rendering: Visualizing Real Objects from Scanned Range and Color Data , 1997, Rendering Techniques.

[16]  Mark Segal,et al.  Fast shadows and lighting effects using texture mapping , 1992, SIGGRAPH.