VR modeler: from image sequences to 3D models

In this paper we present a novel interactive modeling system, called <i>VR Modeler,</i> to create 3D geometric models from a set of photographs. In our approach standard automatic reconstruction techniques are assisted by a human operator. The modeling system is efficient and easy to use because the user can concentrate on the 2D segmentation and interpretation of the scene whereas our system is responsible for the corresponding 3D information. Therefore we developed the user interface of VR Modeler as a monocular 3D modeling system. Additionally, we are able to obtain coarse as well as high resolution models from architectural scenes. Finally, we tested the modeling system on different types of datasets to demonstrate the usability of our approach.

[1]  Paul Debevec,et al.  Modeling and Rendering Architecture from Photographs , 1996, SIGGRAPH 1996.

[2]  Konrad Schindler,et al.  MetropoGIS: A semi-automatic city documentation system , 2002 .

[3]  J. Mundy,et al.  Driving vision by topology , 1995, Proceedings of International Symposium on Computer Vision - ISCV.

[4]  Takeo Kanade,et al.  Image-consistent surface triangulation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  B. Schneirdeman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[6]  Ben Shneiderman,et al.  Designing the User Interface: Strategies for Effective Human-Computer Interaction , 1998 .

[7]  Berthold K. P. Horn.  Relative orientation , 1987, International Journal of Computer Vision.

[8]  Reinhard Koch,et al.  Three-dimensional scene reconstruction from images , 2000, Electronic Imaging.

[9]  Jan J. Koenderink,et al.  REALISE: reconstruction of REALity from Image SEquences , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[10]  Cordelia Schmid,et al.  AUTOMATIC LINE MATCHING AND 3D RECONSTRUCTION OF BUILDINGS FROM MULTIPLE VIEWS , 1999 .

[11]  Ben Shneiderman,et al.  Designing the user interface (2nd ed.): strategies for effective human-computer interaction , 1992 .

[12]  Konrad Schindler,et al.  METROPOGIS: A FEATURE BASED CITY MODELING SYSTEM , 2002 .

[13]  Cordelia Schmid,et al.  The Geometry and Matching of Lines and Curves Over Multiple Views , 2000, International Journal of Computer Vision.

[14]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[15]  Andrew Zisserman,et al.  From Images to Virtual and Augmented Reality , 2000, Confluence of Computer Vision and Computer Graphics.

[16]  Joachim Bauer,et al.  High-quality texture reconstruction from multiple views , 2001, Comput. Animat. Virtual Worlds.

[17]  Jirí Zára,et al.  Cultural heritage presentation in virtual environment: Czech experience , 2003, 14th International Workshop on Database and Expert Systems Applications, 2003. Proceedings..

[18]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[19]  J. Biemond,et al.  Correspondence estimation in image pairs , 1999, IEEE Signal Process. Mag..

[20]  Darius Burschka,et al.  Advances in Computational Stereo , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[22]  Andrew Zisserman,et al.  Planar grouping for automatic detection of vanishing lines and points , 2000, Image Vis. Comput..