Reconstructing a 3D Line from a Single Catadioptric Image

This paper demonstrates that, for axial non-central optical systems, the equation of a 3D line can be estimated using only four points extracted from a single image of the line. This result, which is a direct consequence of the lack of vantage point, follows from a classic result in enumerative geometry: there are exactly two lines in 3-space which intersect four given lines in general position. We present a simple algorithm to reconstruct the equation of a 3D line from four image points. This algorithm is based on computing the Singular Value Decomposition (SVD) of the matrix of Plucker coordinates of the four corresponding rays. We evaluate the conditions for which the reconstruction fails, such as when the four rays are nearly coplanar. Preliminary experimental results using a spherical catadioptric camera are presented. We conclude by discussing the limitations imposed by poor calibration and numerical errors on the proposed reconstruction algorithm.

[1]  Kostas Daniilidis,et al.  Paracatadioptric Camera Calibration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  J. Stolfi Primitives for computational geometry , 1988 .

[3]  Shree K. Nayar,et al.  A general imaging model and a method for finding its parameters , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Shree K. Nayar,et al.  Stereo with mirrors , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[5]  Jorge Stolfi,et al.  Oriented projective geometry , 1987, SCG '87.

[6]  Xianghua Ying,et al.  Catadioptric camera calibration using geometric invariants , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Kostas Daniilidis,et al.  Properties of the Catadioptric Fundamental Matrix , 2002, ECCV.

[8]  K. Sphereo : Determining Depth using Two Specular Spheres and a Single Camera , 1988 .

[9]  Douglas Lanman,et al.  Spherical Catadioptric Arrays: Construction, Multi-View Geometry, and Calibration , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[10]  Vincenzo Caglioti,et al.  Localization of 3 D lines from single images using off-axis catadioptric cameras , 2005 .

[11]  Helder Araújo,et al.  Geometric Properties of Central Catadioptric Line Images , 2002, ECCV.

[12]  Peter F. Sturm,et al.  Multi-view geometry for general camera models , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[13]  Kostas Daniilidis,et al.  Catadioptric camera calibration , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[15]  Sing Bing Kang,et al.  Catadioptric self-calibration , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[16]  Seth J. Teller,et al.  Determining the Lines Through Four Lines , 1999, J. Graphics, GPU, & Game Tools.

[17]  Kostas Daniilidis,et al.  Catadioptric Projective Geometry , 2001, International Journal of Computer Vision.

[18]  Leonidas J. Guibas,et al.  Lines in space-combinators, algorithms and applications , 1989, STOC '89.

[19]  Shree K. Nayar,et al.  Caustics of catadioptric cameras , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[20]  Simone Gasparini,et al.  Localization of straight lines from single images using off-axis catadioptric cameras , 2005, ICCV 2005.