Interactive construction of 3D models from panoramic mosaics

This paper presents an interactive modeling system that constructs 3D models from a collection of panoramic image mosaics. A panoramic mosaic consists of a set of images taken around the same viewpoint, and a transformation matrix associated with each input image. Our system first recovers the camera pose for each mosaic from known line directions and points, and then constructs the 3D model using all available geometrical constraints. We partition constraints into soft and hard linear constraints so that the modeling process can be formulated as a linearly-constrained least-squares problem, which can be solved efficiently using QR factorization. The results of extracting wire frame and texture-mapped 3D models from single and multiple panoramas are presented.

[1]  Martin Herman,et al.  Geometric Reasoning for Constructing 3D Scene Descriptions from Images , 1988, Artif. Intell..

[2]  Robert M. Haralick,et al.  Determining camera parameters from the perspective projection of a rectangle , 1989, Pattern Recognit..

[3]  Robert T. Collins,et al.  Vanishing point calculation as a statistical inference on the unit sphere , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Gideon P. Stein.  Accurate internal camera calibration using rotation, with analysis of sources of error , 1995, Proceedings of IEEE International Conference on Computer Vision.

[5]  V. Michael Bove,et al.  Semiautomatic 3-D model extraction from uncalibrated 2-D camera views , 1995 .

[6]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[7]  V. Bove,et al.  Semiautomatic 3D-model extraction from uncalibrated 2D-camera views , 1995 .

[8]  O. Faugeras,et al.  3-D Reconstruction of Urban Scenes from Sequences of Images , 1995 .

[9]  Jitendra Malik,et al.  Reconstructing Polyhedral Models of Architectural Scenes from Photographs , 1996, ECCV.

[10]  Harpreet S. Sawhney,et al.  True multi-image alignment and its application to mosaicing and lens distortion correction , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[11]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and texture-mapped models , 1997, International Conference on Computer Graphics and Interactive Techniques.

[12]  Sing Bing Kang,et al.  Characterization of errors in compositing panoramic images , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.