Automatic 3D Model Construction for Turn-Table Sequences

As virtual worlds demand ever more realistic 3D models, attention is being focussed on systems that can acquire graphical models from real objects. This paper describes a system which, given a sequence of images of an object rotating about a single axis, generates a textured 3D model fully automatically. In contrast to previous approaches, the technique described here requires no prior information about the cameras or scene, and does not require that the turntable angles be known (or even constant through the sequence). From an analysis ofthe projective geometry of the situation, it is shown that the rotation angles may be determined unambiguously, and that camera calibration, camera positions and 3D structure may be determined to within a two parameter family. An algorithm has been implemented to compute this reconstruction fully automatically. The two parameter reconstruction ambiguity may be removed by specifying, for example, camera aspect ratio and parallel scene lines. Examples are presented on four turn-table sequences.

[1]  Joseph L. Mundy,et al.  Repeated Structures: Image Correspondence Constraints and 3D Structure Recovery , 1993, Applications of Invariance in Computer Vision.

[2]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  David Sinclair.  Europe-China Workshop on Geometrical Modelling and Invariants for Computer Vision, 1995 , 1995 .

[4]  Edmond Boyer,et al.  Object Models from Contour Sequences , 1996, ECCV.

[5]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[6]  I. Reid,et al.  Metric calibration of a stereo rig , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[7]  Jean Ponce,et al.  Automatic model construction, pose estimation, and object recognition from photographs using triangular splines , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[8]  S. B. Kang,et al.  Recovering 3 D Shape and Motion from Image Streams using Non-Linear Least Squares , 1993 .

[9]  A D Marshall,et al.  Geometric Modelling for Computer Vision , 1992 .

[10]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[11]  KanadeTakeo,et al.  Shape and motion from image streams under orthography , 1992 .

[12]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[13]  Andrew Zisserman,et al.  Applications of Invariance in Computer Vision , 1993, Lecture Notes in Computer Science.

[14]  Richard Szeliski,et al.  Recovering 3D shape and motion from image streams using nonlinear least squares , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Richard Szeliski,et al.  Shape from rotation , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Christopher G. Harris,et al.  Structure-from-motion under orthographic projection , 1990, Image Vis. Comput..

[17]  Rajiv Gupta,et al.  Stereo from uncalibrated cameras , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Richard I. Hartley,et al.  Euclidean Reconstruction from Uncalibrated Views , 1993, Applications of Invariance in Computer Vision.

[19]  Andrew W. Fitzgibbon,et al.  Automatic Camera Recovery for Closed or Open Image Sequences , 1998, ECCV.

[20]  Andrew Zisserman,et al.  Self-Calibration from Image Triplets , 1996, ECCV.

[21]  Thierry Viéville,et al.  Using Singular Displacements for Uncalibrated Monocular Visual Systems , 1996, ECCV.

[22]  Andrew Zisserman,et al.  Resolving ambiguities in auto–calibration , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[23]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[24]  W. Niem,et al.  Automatic Modelling of 3D Natural Objects from Multiple Views , 1995 .

[25]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[27]  Bruce G. Baumgart,et al.  Geometric modeling for computer vision. , 1974 .