Simultaneously calibrating catadioptric camera and detecting line features using Hough transform

A line in space is projected to a conic in a central catadioptric image, and such a conic is called a line image. This paper proposes a novel approach to calibrating catadioptric camera and detecting line images simultaneously by using Hough transform. Previous approaches to catadioptric cameras calibration employ the traditional conic detecting or fitting methods for line images, and then use these recovered conies to estimate the intrinsic parameters based on some properties of line images. However, the type of a line image can be line, circle, ellipse, hyperbola or parabola, and in general only a small arc of the conic is visible in the image, which brings novel challenges for conic detection and fitting where traditional conic detecting and fitting methods may fail. As we know, the accuracy of the estimated intrinsic parameters highly depends on the accuracy of the extracted conies. The main contribution of this work is we show that all line images from catadioptric cameras with the same intrinsic parameters must belong to a family of conies with only two degree-of-freedom, and such a family is called a line image family. Therefore, we present a novel special Hough transform for line image detection which ensures that all detected conies must belong to a line image family related to certain intrinsic parameters. For all possible values of the unknown intrinsic parameters, the line image special Hough transform are performed. The one with the highest confidence is chosen as the estimated values for these unknown intrinsic parameters, and the corresponding results of line image detection are chosen as the estimated values for line images. In order to make the searching process more efficient, the hierarchical approaches are employed in this paper. The validity of our proposed approach is illustrated by experiments.

[1]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Kostas Daniilidis,et al.  Catadioptric camera calibration , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[3]  Daniel G. Aliaga.  Accurate catadioptric calibration for real-time pose estimation in room-size environments , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[4]  Nirwan Ansari,et al.  Steering a robot with vanishing points , 1993, IEEE Trans. Robotics Autom..

[5]  P. Sturm.  A method for 3D reconstruction of piecewise planar objects from single panoramic images , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[6]  Avinash C. Kak,et al.  Fast Vision-guided Mobile Robot Navigation Using Model-based Reasoning And Prediction Of Uncertainties , 1992, Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Kostas Daniilidis,et al.  Catadioptric Projective Geometry , 2001, International Journal of Computer Vision.

[8]  Shree K. Nayar,et al.  A theory of catadioptric image formation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[9]  Daniel G. Aliaga.  Accurate Catadioptric Calibration for Real-time Pose Estimation of Room-size Environments , 2001, ICCV.

[10]  Minas E. Spetsakis,et al.  Structure from motion using line correspondences , 1990, International Journal of Computer Vision.

[11]  Kostas Daniilidis,et al.  Paracatadioptric Camera Calibration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Andrew W. Fitzgibbon,et al.  Direct least squares fitting of ellipses , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[13]  Zhengyou Zhang,et al.  Parameter estimation techniques: a tutorial with application to conic fitting , 1997, Image Vis. Comput..

[14]  Xianghua Ying,et al.  Catadioptric camera calibration using geometric invariants , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[15]  Sing Bing Kang,et al.  Catadioptric self-calibration , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[16]  Helder Araújo,et al.  Geometric Properties of Central Catadioptric Line Images , 2002, ECCV.

[17]  Helder Araújo,et al.  Paracatadioptric camera calibration using lines , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  Avinash C. Kak,et al.  Fast vision-guided mobile robot navigation using model-based reasoning and prediction of uncertainties , 1992, CVGIP Image Underst..

[19]  Long Quan,et al.  Determining perspective structures using hierarchical Hough transform , 1989, Pattern Recognit. Lett..

[20]  Josef Kittler,et al.  A survey of the hough transform , 1988, Comput. Vis. Graph. Image Process..

[21]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.