3-D model construction using range and image data

This paper deals with the automated creation of geometric and photometric correct 3-D models of the world. Those models can be used for virtual reality, tele-presence, digital cinematography and urban planning applications. The combination of range (dense depth estimates) and image sensing (color information) provides data-sets which allow us to create geometrically correct, photorealistic models of high quality. The 3-D models are first built from range data using a volumetric set intersection method previously developed by us. Photometry can be napped onto these models by registering features from both the 3-D and 2-D data sets. Range data segmentation algorithms have been developed to identify planar regions, determine linear features from planar intersections that can serve as features for registration with 2-D imagery lines, and reduce the overall complexity of the models. Results are shown for building models of large buildings on our campus using real data acquired from multiple sensors.

[1]  Ioannis Stamos,et al.  Automated model acquisition from range images with view planning , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Peter K. Allen,et al.  Design, architecture and control of a mobile site-modeling robot , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[3]  Peter K. Allen,et al.  Constraint-Based Sensor Planning for Scene Modeling , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Vladimir J. Lumelsky,et al.  On Fast Computation of Distance Between Line Segments , 1985, Information Processing Letters.

[5]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[6]  Peter K. Allen,et al.  3-D Modeling from Range Imagery: An Incremental Method with a Planning Component , 1999, Image Vis. Comput..

[7]  Andrew W. Fitzgibbon,et al.  Automatic 3D model acquisition and generation of new images from video sequences , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[8]  Francois Blais,et al.  A system for indoor 3-D mapping and virtual environments , 1997 .

[9]  Mei Han,et al.  Interactive construction of 3D models from panoramic mosaics , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[10]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[11]  Seth J. Teller,et al.  Extracting textured vertical facades from controlled close-range imagery , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[12]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[14]  V. Bove,et al.  Semiautomatic 3D-model extraction from uncalibrated 2D-camera views , 1995 .

[15]  V. Michael Bove,et al.  Vision-assisted modeling for model-based video representations , 1997 .

[16]  Rachid Deriche,et al.  3D edge detection using recursive filtering: Application to scanner images , 1991, CVGIP Image Underst..

[17]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Horst Bunke,et al.  Edge Detection in Range Images Based on Scan Line Approximation , 1999, Comput. Vis. Image Underst..

[19]  Satyan R. Coorg,et al.  Pose imagery and automated three-dimensional modeling of urban environments , 1998 .

[20]  Seth J. Teller,et al.  Acquisition of a large pose-mosaic dataset , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[21]  Marc Rioux,et al.  Object model creation from multiple range images: acquisition, calibration, model building and verification , 1997, Proceedings. International Conference on Recent Advances in 3-D Digital Imaging and Modeling (Cat. No.97TB100134).

[22]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[23]  Ruzena Bajcsy,et al.  Solution to the next best view problem for automated CAD model acquisiton of free-form objects using range cameras , 1995, Optics East.

[24]  Allen R. Hanson,et al.  Robust methods for estimating pose and a sensitivity analysis , 1994 .