Vanishing points and three-dimensional lines from omni-directional video

This paper describes a system for structure from motion using vanishing points and three-dimensional lines extracted from omni-directional video sequences. To track lines, we use a novel dynamic programming approach to improve ambiguity resolution, and we use delayed states to aid in the initialization of landmarks. By reobserving vanishing points we get direct measurements of the robot’s three-dimensional attitude that are independent of its position. Using vanishing points simplifies the representation since parallel lines share the same direction states. We show the performance of the system in various indoor and outdoor environments and include comparisons with independent two-dimensional reference maps for each experiment .

[1]  Philip F. McLauchlan,et al.  A batch/recursive algorithm for 3D scene reconstruction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[2]  Sebastian Thrun,et al.  A Probabilistic On-Line Mapping Algorithm for Teams of Mobile Robots , 2001, Int. J. Robotics Res..

[3]  Sebastian Thrun,et al.  An Online Mapping Algorithm for Teams of Mobile Robots , 2000 .

[4]  Eduardo Mario Nebot,et al.  Optimization of the simultaneous localization and map-building algorithm for real-time implementation , 2001, IEEE Trans. Robotics Autom..

[5]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Michael Bosse,et al.  Mapping Partially Observable Features from Multiple Uncertain Vantage Points , 2002, Int. J. Robotics Res..

[7]  Andrew J. Davison,et al.  Mobile Robot Navigation Using Active Vision , 1998 .

[8]  Raja Chatila,et al.  Stochastic multisensory data fusion for mobile robot location and environment modeling , 1989 .

[9]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[10]  S. M. Steve.  SUSAN - a new approach to low level image processing , 1997 .

[11]  Michael Bosse,et al.  An Atlas framework for scalable mapping , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[12]  Ronald L. Rivest,et al.  Introduction to Algorithms , 1990 .

[13]  Matthew E. Antone.  Robust camera pose recovery using stochastic geometry , 2001 .

[14]  Peter C. Cheeseman,et al.  Estimating uncertain spatial relationships in robotics , 1986, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[15]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[16]  Seth J. Teller,et al.  Automatic recovery of relative camera rotations for urban scenes , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[17]  Raja Chatila,et al.  An Experimental System for Incremental Environment Modelling by an Autonomous Mobile Robot , 1989, ISER.

[18]  Michael Bosse,et al.  Calibrated, Registered Images of an Extended Urban Area , 2003, International Journal of Computer Vision.

[19]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[20]  J. M. M. Montiel,et al.  The SPmap: a probabilistic framework for simultaneous localization and map building , 1999, IEEE Trans. Robotics Autom..

[21]  Stefano Soatto,et al.  3-D Motion and Structure from 2-D Motion Causally Integrated over Time: Implementation , 2000, ECCV.

[22]  Peter Cheeseman,et al.  A stochastic map for uncertain spatial relationships , 1988 .

[23]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[24]  Ingemar J. Cox,et al.  Autonomous Robot Vehicles , 1990, Springer New York.

[25]  Camillo J. Taylor,et al.  VideoPlus: A Method for Capturing the Structure and Appearance of Immersive Environments , 2000, IEEE Trans. Vis. Comput. Graph..

[26]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[27]  Stefano Soatto,et al.  Structure from Motion Causally Integrated Over Time , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Hugh F. Durrant-Whyte,et al.  An Experimental and Theoretical Investigation into Simultaneous Localisation and Map Building , 1999, ISER.

[29]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.