Reliable 3D reconstruction from a few catadioptric images

This paper proposes a scheme for the reliable reconstruction of indoor scenes from a few catadioptric images. A set of hand-detected correspondences are established across (but not necessarily all) images. Our improved method is used for the estimation of the essential matrix from appropriately normalized point coordinates. Motion parameters are computed by using the Hartley's (1993) decomposition. A heuristic method is suggested for selecting the point pairs which are most reliable for 3D reconstruction. The known mid-point method is applied for computing the 3D model of a real scene. The parameters of the catadioptric sensor are approximately known but no precise self-calibration method is performed. The experiments show that a reliable 3D reconstruction is possible even without complicated non-linear self-calibration and/or reconstruction methods.

[1]  T. L. H.,et al.  The Geometry of René Descartes , 1926, Nature.

[2]  Narendra Ahuja,et al.  Motion and Structure From Two Perspective Views: Algorithms, Error Analysis, and Error Estimation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Hiroshi Ishiguro,et al.  Omni-Directional Stereo , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Thomas S. Huang,et al.  Motion and Structure from Image Sequences , 1992 .

[5]  Richard I. Hartley,et al.  Euclidean Reconstruction from Uncalibrated Views , 1993, Applications of Invariance in Computer Vision.

[6]  Yasushi Yagi,et al.  Obstacle detection with omnidirectional image sensor HyperOmni Vision , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[7]  Richard Szeliski,et al.  3-D Scene Data Recovery Using Omnidirectional Multibaseline Stereo , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Shree K. Nayar,et al.  Catadioptric omnidirectional camera , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  M. Srinivasan,et al.  Range estimation with a panoramic visual sensor , 1997 .

[10]  Václav Hlaváč,et al.  MOTION ESTIMATION USING CENTRAL PANORAMIC CAMERAS , 1998 .

[11]  Martin Urban,et al.  Practice of 3D Reconstruction from Multiple Uncalibrated Unorganized Images , 2000 .

[12]  M. Hebert,et al.  Omni-directional structure from motion , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[13]  Tomás Svoboda,et al.  Matching in Catadioptric Images with Appropriate Windows, and Outliers Removal , 2001, CAIP.

[14]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[15]  Václav Hlaváč,et al.  Epipolar geometry of central panoramic catadioptric cameras , 2001 .

[16]  Olivier D. Faugeras,et al.  The geometry of multiple images - the laws that govern the formation of multiple images of a scene and some of their applications , 2001 .

[17]  Mohan M. Trivedi,et al.  N-Ocular stereo for real-time human tracking , 2001 .

[18]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[19]  S. B. Kang,et al.  Panoramic vision : sensors, theory, and applications , 2001 .

[20]  Sanjiv Singh,et al.  Extending shape-from-motion to noncentral onmidirectional cameras , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[21]  Kostas Daniilidis,et al.  Structure and motion from uncalibrated catadioptric views , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[22]  Ben J. A. Kröse,et al.  3D scene reconstruction from cylindrical panoramic images , 2002, Robotics Auton. Syst..

[23]  Jon Rigelsford,et al.  Panoramic Vision: Sensors, Theory and Applications , 2002 .

[24]  Yiannis Aloimonos,et al.  Directions of Motion Fields are Hardly Ever Ambiguous , 2004, International Journal of Computer Vision.

[25]  Kostas Daniilidis,et al.  Catadioptric Projective Geometry , 2001, International Journal of Computer Vision.