Construction and Rendering of Concentric Mosaics from a Handheld Camera

Concentric mosaics are low-dimensional lightfields. Yet capturing concentric mosaics requires a motor-controlled device and it is not practical for real outdoor scenes. In this paper, we propose a new concentric mosaic construction method by hand rotating an outward-looking camera. The geometry of such a capturing system is formulated as an outward-looking circular motion with unknown rotation angles. Then, a new and practical method of analyzing the motion and structure of a very long sequence of images is developed. The method needs to compute one fundamental matrix for a typical sequence of 3000 frames and track one point in three frames to propagate the recovery of the rotation angles to the whole sequence. We will demonstrate the superior performance of mosaics construction and rendering results by using the new algorithm.

[1]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Stephen J. Maybank,et al.  On plane-based camera calibration: A general algorithm, singularities, applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[3]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[4]  Heung-Yeung Shum,et al.  Rendering with Non-uniform Concentric Mosaics , 2000 .

[5]  Long Quan,et al.  Single Axis Geometry by Fitting Conics , 2002, ECCV.

[6]  Olivier D. Faugeras,et al.  Self-Calibration of a 1D Projective Camera and Its Application to the Self-Calibration of a 2D Projective Camera , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[8]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[10]  Andrew Zisserman,et al.  Self-Calibration from Image Triplets , 1996, ECCV.

[11]  Olivier D. Faugeras,et al.  The fundamental matrix: Theory, algorithms, and stability analysis , 2004, International Journal of Computer Vision.

[12]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and environment maps , 1997, SIGGRAPH.

[13]  Long Quan,et al.  Cencentric Mosaics, Planar Motions and 1D Cameras , 2001, ICCV 2001.

[14]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[15]  Andrew W. Fitzgibbon,et al.  Automatic 3D Model Construction for Turn-Table Sequences , 1998, SMILE.

[16]  Shmuel Peleg,et al.  Panoramic mosaics by manifold projection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[18]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[19]  J. G. Semple,et al.  Algebraic Projective Geometry , 1953 .