Combining texture and shape for automatic crude patch registration

Building complete three-dimensional models often requires the registration and integration of multiple partial reconstructions. Registration is usually performed using a coarse-to-fine approach. We present a novel method for the crude registration of many partial three-dimensional reconstructions (patches). Our method combines the 3D measurements with the texture. Registration with methods that use only geometry will fail if the shape is too simple or symmetric. In such cases one has to use texture to resolve the ambiguities. But even then, knowledge of the shape greatly simplifies the task. The strategy we use is to intersect the surface with small spheres centered at feature points. The intersection line between such a sampling sphere and the surface defines an invariant region in the texture image. The surface texture inside these regions is used for matching regions between different patches.

[1]  Maarten Vergauwen,et al.  3D modeling and registration under wide baseline conditions , 2002 .

[2]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[3]  Gerhard Roth.  Registering two overlapping range images , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[4]  Gérard G. Medioni,et al.  Object modeling by registration of multiple range images , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[5]  Kari Pulli,et al.  Multiview registration for large data sets , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[6]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Luc Van Gool,et al.  Wide Baseline Stereo Matching based on Local, Affinely Invariant Regions , 2000, BMVC.

[8]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[9]  Luc Van Gool,et al.  Comparing Intensity Transformations and Their Invariants in the Context of Color Pattern Recognition , 2002, ECCV.

[10]  Nicholas Ayache,et al.  3D-2D Projective Registration of Free-Form Curves and Surfaces , 1997, Comput. Vis. Image Underst..

[11]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[12]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[13]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Cordelia Schmid,et al.  Local Grayvalue Invariants for Image Retrieval , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[16]  GoolLuc Van,et al.  Automatic crude patch registration , 2002 .

[17]  Dinesh Manocha,et al.  OBBTree: a hierarchical structure for rapid interference detection , 1996, SIGGRAPH.

[18]  Martial Hebert,et al.  Fully automatic registration of multiple 3D data sets , 2003, Image Vis. Comput..

[19]  Luc Van Gool,et al.  Automatic Crude Patch Registration: Toward Automatic 3D Model Building , 2002, Comput. Vis. Image Underst..

[20]  Andrew E. Johnson,et al.  Recognizing objects by matching oriented points , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[21]  Sebastian Weik,et al.  Registration of 3-D partial surface models using luminance and depth information , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[22]  Sing Bing Kang,et al.  Registration and integration of textured 3-D data , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).