Vanishing points and 3D lines from omnidirectional video

The paper describes a system for structure-from-motion using vanishing points and three-dimensional lines extracted from omnidirectional video sequences. Two novel aspects of this work are its deferred initialization of features using noisy observations from multiple, uncertain vantage points, and its use of dynamic programming for efficient 3D line tracking. We show preliminary results from the system for both indoor and outdoor sequences.

[1]  Ingemar J. Cox,et al.  Autonomous Robot Vehicles , 1990, Springer New York.

[2]  John J. Leonard,et al.  Incorporation of Delayed Decision Making into Stochastic Mapping , 2000, ISER.

[3]  B J Frost,et al.  A Bird's-Eye View. , 1994, Science.

[4]  Matthew E. Antone.  Robust camera pose recovery using stochastic geometry , 2001 .

[5]  Kurt Konolige,et al.  Incremental mapping of large cyclic environments , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[6]  Seth J. Teller,et al.  Automatic recovery of relative camera rotations for urban scenes , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[7]  O. Faugeras,et al.  The Geometry of Multiple Images , 1999 .

[8]  Raja Chatila,et al.  An Experimental System for Incremental Environment Modelling by an Autonomous Mobile Robot , 1989, ISER.

[9]  Michael Bosse,et al.  Calibrated, Registered Images of an Extended Urban Area , 2003, International Journal of Computer Vision.

[10]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[11]  Richard Szeliski,et al.  Vision algorithms : theory and practice : International Workshop on Vision Algorithms, Corfu, Greece, September 21-22, 1999 : proceedings , 2000 .

[12]  Sebastian Thrun,et al.  An Online Mapping Algorithm for Teams of Mobile Robots , 2000 .

[13]  Refractor.  Vision , 2000, The Lancet.

[14]  Hugh F. Durrant-Whyte,et al.  An Experimental and Theoretical Investigation into Simultaneous Localisation and Map Building , 1999, ISER.

[15]  Philip F. McLauchlan,et al.  A batch/recursive algorithm for 3D scene reconstruction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[16]  Sebastian Thrun,et al.  A Probabilistic On-Line Mapping Algorithm for Teams of Mobile Robots , 2001, Int. J. Robotics Res..

[17]  Camillo J. Taylor,et al.  VideoPlus: A Method for Capturing the Structure and Appearance of Immersive Environments , 2000, IEEE Trans. Vis. Comput. Graph..

[18]  Raja Chatila,et al.  Stochastic multisensory data fusion for mobile robot location and environment modeling , 1989 .

[19]  Stephen M. Smith,et al.  SUSAN—A New Approach to Low Level Image Processing , 1997, International Journal of Computer Vision.

[20]  Y. Bar-Shalom.  Tracking and data association , 1988 .

[21]  Stefano Soatto,et al.  Optimal Structure from Motion: Local Ambiguities and Global Estimates , 2004, International Journal of Computer Vision.

[22]  J. M. M. Montiel,et al.  The SPmap: a probabilistic framework for simultaneous localization and map building , 1999, IEEE Trans. Robotics Autom..

[23]  Stefano Soatto,et al.  3-D Motion and Structure from 2-D Motion Causally Integrated over Time: Implementation , 2000, ECCV.

[24]  Peter Cheeseman,et al.  A stochastic map for uncertain spatial relationships , 1988 .

[25]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[26]  Michael Bosse,et al.  Mapping Partially Observable Features from Multiple Uncertain Vantage Points , 2002, Int. J. Robotics Res..

[27]  Andrew J. Davison,et al.  Mobile Robot Navigation Using Active Vision , 1998 .

[28]  Eduardo Mario Nebot,et al.  Optimization of the simultaneous localization and map-building algorithm for real-time implementation , 2001, IEEE Trans. Robotics Autom..

[29]  David J. Kriegman,et al.  Structure and Motion from Line Segments in Multiple Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Michael Bosse,et al.  An Atlas framework for scalable mapping , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).