Central catadioptric line matching for robotic applications

This paper presents a method for catadioptric line matching across multiple images. While most of previous works deals with vertical lines and planar motion, our approach is able to match any kind of lines between two views separated by a rigid transformation without any prior knowledge of the epipolar geometry. Catadioptric lines are represented by their normals in sphere space and we use only these normals and their relative positions in order to perform the matching. A geometric hashing approach allows in the first image to construct hashing tables based on bases defined by every possible couples of normals. In the second image, a voting scheme permits to select the best corresponding bases and subsequently to match catadioptric lines.We show that the proposed representation is invariant in the case of a pure rotation and quasi-invariant for a combination of rotation and translation. We also propose different experimental results obtained in real time on real outdoor sequences.

[1]  Philippe Martinet,et al.  Catadioptric Visual Servoing From 3-D Straight Lines , 2008, IEEE Transactions on Robotics.

[2]  Michael Bosse,et al.  Vanishing points and three-dimensional lines from omni-directional video , 2003, The Visual Computer.

[3]  Ezio Malis,et al.  Fast central catadioptric line extraction, estimation, tracking and structure from motion , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Helder Araújo,et al.  Geometric Properties of Central Catadioptric Line Images , 2002, ECCV.

[5]  Manolis I. A. Lourakis,et al.  Matching disparate views of planar surfaces using projective invariants , 2000, Image Vis. Comput..

[6]  Xianghua Ying,et al.  Catadioptric line features detection using Hough transform , 2004, ICPR 2004.

[7]  Zhanyi Hu,et al.  MSLD: A robust descriptor for line matching , 2009, Pattern Recognit..

[8]  Roland Siegwart,et al.  Performance evaluation of a vertical line descriptor for omnidirectional images , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Jezekiel Ben-Arie.  The Probabilistic Peaking Effect of Viewed Angles and Distances with Application to 3-D Object Recognition , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Kostas Daniilidis,et al.  Catadioptric Projective Geometry , 2001, International Journal of Computer Vision.

[11]  Pascal Vasseur,et al.  UAV Attitude Computation by Omnidirectional Vision in Urban Environment , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  Luc Van Gool,et al.  Fast wide baseline matching for visual navigation , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[13]  Yehezkel Lamdan,et al.  Geometric Hashing: A General And Efficient Model-based Recognition Scheme , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[14]  Pascal Vasseur,et al.  Fast Central Catadioptric Line Extraction , 2007, IbPRIA.

[15]  Nicholas Ayache,et al.  Efficient registration of stereo images by matching graph descriptions of edge segments , 1987, International Journal of Computer Vision.

[16]  Josechu J. Guerrero,et al.  Computing Homographies from Three Lines or Points in an Image Pair , 2005, ICIAP.

[17]  Yasushi Yagi,et al.  Real-time generation of environmental map and obstacle avoidance using omnidirectional image sensor with conic mirror , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Zhengyou Zhang,et al.  Token tracking in a cluttered scene , 1994, Image Vis. Comput..

[19]  Michael Milford,et al.  Experiments in outdoor operation of RatSLAM , 2004 .

[20]  Maxime Lhuillier,et al.  Automatic scene structure and camera motion using a catadioptric system , 2008, Comput. Vis. Image Underst..

[21]  Zhengyou Zhang.  Estimating Motion and Structure from Correspondences of Line Segments between Two Perspective Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[23]  Cordelia Schmid,et al.  Automatic line matching across views , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[24]  Adrien Bartoli,et al.  Structure-from-motion using lines: Representation, triangulation, and bundle adjustment , 2005, Comput. Vis. Image Underst..

[25]  Patrick Gros,et al.  Using Local Planar Geometric Invariants to Match and Model Images of Line Segments , 1998, Comput. Vis. Image Underst..

[26]  Ramakant Nevatia,et al.  Segment-based stereo matching , 1985, Comput. Vis. Graph. Image Process..

[27]  Simon Lacroix,et al.  SLAM with Panoramic Vision , 2007, J. Field Robotics.

[28]  L. Delahoche,et al.  Experimental results got with the omnidirectional vision sensor: SYCLOP , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[29]  Richard I. Hartley,et al.  A linear method for reconstruction from lines and points , 1995, Proceedings of IEEE International Conference on Computer Vision.

[30]  Roland Siegwart,et al.  Robust Feature Extraction and Matching for Omnidirectional Images , 2007, FSR.

[31]  Richard I. Hartley,et al.  Projective Reconstruction and Invariants from Multiple Images , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Se-Young Oh,et al.  SLAM in Indoor Environments using Omni-directional Vertical and Horizontal Line Features , 2008, J. Intell. Robotic Syst..

[33]  Pascal Vasseur,et al.  Central Catadioptric Line Detection , 2004, BMVC.

[34]  Nicholas Ayache,et al.  Artificial vision for mobile robots - stereo vision and multisensory perception , 1991 .