Euclidean 3D Reconstruction from Image Sequences with Variable Focal Lenghts

One of the main problems to obtain a Euclidean 3D reconstruction from multiple views is the calibration of the camera. Explicit calibration is not always practical and has to be repeated regularly. Sometimes it is even impossible (i.e. for pictures taken by an unknown camera of an unknown scene). The second possibility is to do auto-calibration. Here the rigidity of the scene is used to obtain constraints on the camera parameters. Existing approaches of this second strand impose that the camera parameters stay exactly the same between different views. This can be very limiting since it excludes changing the focal length to zoom or focus. The paper describes a reconstruction method that allows to vary the focal length. Instead of using one camera one can also use a stereo rig following similar principles, and in which case also reconstruction from a moving rig becomes possible even for pure translation. Synthetic data were used to see how resistant the algorithm is to noise. The results are satisfactory. Also results for a real scene were convincing.

[1]  Olivier D. Faugeras,et al.  What can be seen in three dimensions with an uncalibrated stereo rig , 1992, ECCV.

[2]  Luc Van Gool,et al.  Euclidean 3D Reconstruction from Stereo Sequences with Variable Focal Lengths , 1995, ACCV.

[3]  Roger Mohr,et al.  Epipole and fundamental matrix estimation using virtual parallax , 1995, Proceedings of IEEE International Conference on Computer Vision.

[4]  Rachid Deriche,et al.  Robust Recovery of the Epipolar Geometry for an Uncalibrated Stereo Rig , 1994, ECCV.

[5]  Thierry Viéville,et al.  Canonic Representations for the Geometries of Multiple Projective Views , 1994, ECCV.

[6]  Richard I. Hartley,et al.  Euclidean Reconstruction from Uncalibrated Views , 1993, Applications of Invariance in Computer Vision.

[7]  Michel Dhome,et al.  Three-dimensional reconstruction by zooming , 1993, IEEE Trans. Robotics Autom..

[8]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[9]  Olivier D. Faugeras,et al.  A comparison of projective reconstruction methods for pairs of views , 1995, Proceedings of IEEE International Conference on Computer Vision.

[10]  I. Reid,et al.  Metric calibration of a stereo rig , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[11]  Richard I. Hartley,et al.  Estimation of Relative Camera Positions for Uncalibrated Cameras , 1992, ECCV.

[12]  Olivier D. Faugeras,et al.  From projective to Euclidean reconstruction , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Paul A. Beardsley,et al.  Euclidean Structure from Uncalibrated Images , 1994, BMVC.

[14]  Mengxiang Li.  Camera Calibration of a Head-Eye System for Active Vision , 1994, ECCV.

[15]  Andrew Zisserman,et al.  Applications of Invariance in Computer Vision , 1993, Lecture Notes in Computer Science.

[16]  Luc Van Gool,et al.  Affine Reconstruction from Perspective Image Pairs Obtained by a Translating Camera , 1993, Applications of Invariance in Computer Vision.

[17]  Luc Van Gool,et al.  Determination of Optical Flow and its Discontinuities using Non-Linear Diffusion , 1994, ECCV.