Self-Calibration of Catadioptric Camera with Two Planar Mirrors from Silhouettes

If an object is interreflected between two planar mirrors, we may take an image containing both the object and its multiple reflections, i.e., simultaneously imaging multiple views of an object by a single pinhole camera. This paper emphasizes the problem of recovering both the intrinsic and extrinsic parameters of the camera using multiple silhouettes from one single image. View pairs among views in a single image can be divided into two kinds by the relationship between the two views in the pair: reflected by some mirror (real or virtual) and in a circular motion. Epipoles in the first kind of pairs can be easily determined from intersections of common tangent lines of silhouettes. Based on the projective properties of these epipoles, efficient methods are proposed to recover both the imaged circular points and the included angle between two mirrors. Epipoles in the second kind of pairs can be recovered simultaneously with the projection of intersection line between two mirrors by solving a simple 1D optimization problem using the consistency constraint of epipolar tangent lines. Fundamental matrices among views in a single image are all recovered. Using the estimated intrinsic and extrinsic parameters of the camera, a euclidean reconstruction can be obtained. Experiments validate the proposed approach.

[1]  H.-H. P. Wu Rectification of Stereoscopic Video for Planar Catadioptric Stereo Systems , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  J. H. Rieger Three-dimensional motion from fixed points of a deforming profile curve. , 1986, Optics letters.

[3]  Paulo R. S. Mendonça,et al.  Epipolar geometry from profiles under circular motion , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Hui Zhang,et al.  Self-Calibration of Turntable Sequences from Silhouettes , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  John Porrill,et al.  Curve matching and stereo calibration , 1991, Image and Vision Computing.

[6]  Hongbin Zha,et al.  Geometric properties of multiple reflections in catadioptric camera with two planar mirrors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Shang-Hong Lai,et al.  Contour-Based Structure from Reflection , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[8]  Jun-Sik Kim,et al.  Geometric and algebraic constraints of projected concentric circles and their applications to camera calibration , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Domenico Prattichizzo,et al.  Planar Catadioptric Stereo: Single and multi-view geometry for calibration and localization , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Roberto Cipolla,et al.  Generalised Epipolar Constraints , 1996, International Journal of Computer Vision.

[11]  Long Quan,et al.  Single Axis Geometry by Fitting Conics , 2002, ECCV.

[12]  Keith Forbes,et al.  Shape-from-Silhouette with Two Mirrors and an Uncalibrated Camera , 2006, ECCV.

[13]  Roberto Cipolla,et al.  Reconstruction of sculpture from its profiles with unknown camera positions , 2004, IEEE Transactions on Image Processing.

[14]  Shang-Hong Lai,et al.  Silhouette-based camera calibration from sparse views under circular motion , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Yutaka Fukui,et al.  3-D Reconstruction Using Mirror Images Based on a Plane Symmetry Recovering Method , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Fumihiko Sakaue,et al.  Multiple View Geometries for Mirrors and Cameras , 2010, 2010 20th International Conference on Pattern Recognition.

[17]  Yeung Sam Hung,et al.  Reconstruction from Plane Mirror Reflection , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[18]  Pierre Gurdjos,et al.  Euclidean Structure from N geq 2 Parallel Circles: Theory and Algorithms , 2006, ECCV.

[19]  Roberto Cipolla,et al.  Motion from the frontier of curved surfaces , 1995, Proceedings of IEEE International Conference on Computer Vision.

[20]  Narendra Ahuja,et al.  Structure and Motion Estimation from Dynamic Silhouettes under Perspective Projection , 1999, International Journal of Computer Vision.

[21]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[22]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[23]  Narendra Ahuja,et al.  Multiview panoramic cameras using mirror pyramids , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  B. Caprile,et al.  Using vanishing points for camera calibration , 1990, International Journal of Computer Vision.

[25]  Long Quan,et al.  Circular motion geometry using minimal data , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Thierry Viéville,et al.  Using Singular Displacements for Uncalibrated Monocular Visual Systems , 1996, ECCV.

[27]  Peter F. Sturm,et al.  How to Compute the Pose of an Object Without a Direct View? , 2006, ACCV.

[28]  Roberto Cipolla,et al.  Silhouette Coherence for Camera Calibration under Circular Motion , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Shree K. Nayar,et al.  Rectified catadioptric stereo sensors , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[30]  Rui Rodrigues,et al.  Camera Pose Estimation Using Images of Planar Mirror Reflections , 2010, ECCV.

[31]  Andrew W. Fitzgibbon,et al.  Automatic 3D Model Construction for Turn-Table Sequences , 1998, SMILE.

[32]  Roberto Cipolla,et al.  Generalised Epipolar Constraints , 1996, ECCV.

[33]  Marc Pollefeys,et al.  Camera network calibration from dynamic silhouettes , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[34]  Chen Liang,et al.  1D Camera Geometry and Its Application to the Self-Calibration of Circular Motion Sequences , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Douglas Lanman,et al.  Surround structured lighting: 3-D scanning with orthographic illumination , 2009, Comput. Vis. Image Underst..

[36]  Jan-Michael Frahm,et al.  Simple calibration of non-overlapping cameras with a mirror , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.