Parallel projections for stereo reconstruction

This paper proposes a novel technique to computing geometric information from images captured under parallel projections. Parallel images are desirable for stereo reconstruction because parallel projection significantly reduces foreshortening. As a result, correlation based matching becomes more effective. Since parallel projection cameras are not commonly available, we construct parallel images by rebinning a large sequence of perspective images. Epipolar geometry, depth recovery and projective invariant for both 1D and 2D parallel stereos are studied. From the uncertainty analysis of depth reconstruction, it is shown that parallel stereo is superior to both conventional perspective stereo and the recently developed multiperspective stereo for vision reconstruction, in that uniform reconstruction error is obtained in parallel stereo. Traditional stereo reconstruction techniques, e.g. multi-baseline stereo, can still be applicable to parallel stereo without any modifications because epipolar lines in a parallel stereo are perfectly straight. Experimental results further confirm the performance of our approach.

[1]  Gang Xu,et al.  Epipolar Geometry in Stereo, Motion and Object Recognition , 1996, Computational Imaging and Vision.

[2]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.

[3]  Harry Shum,et al.  Stereo reconstruction from multiperspective panoramas , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  Nelson L. Max,et al.  Hierarchical Rendering of Trees from Precomputed Multi-Layer Z-Buffers , 1996, Rendering Techniques.

[5]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[6]  Shmuel Peleg,et al.  Panoramic mosaics by manifold projection , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Enhua Wu,et al.  Plane-Parallel Radiance Transport for Global Illumination in Vegetation , 1997, Rendering Techniques.

[8]  David Salesin,et al.  Multiperspective panoramas for cel animation , 1997, SIGGRAPH.

[9]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[10]  Dani Lischinski,et al.  Image-Based Rendering for Non-Diffuse Synthetic Scenes , 1998, Rendering Techniques.

[11]  Takeo Kanade,et al.  A multiple-baseline stereo , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Shmuel Peleg,et al.  Stereo panorama with a single camera , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[13]  Paul Rademacher,et al.  Multiple-center-of-projection images , 1998, SIGGRAPH.

[14]  Steven A. Shafer,et al.  Modeling foreshortening in stereo vision using local spatial frequency , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[15]  Robert T. Collins,et al.  A space-sweep approach to true multi-image matching , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Larry H. Matthies,et al.  Error analysis of a real-time stereo system , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.