SLAM with Panoramic Vision

This article presents an approach to SLAM that takes advantage of panoramic images. Landmarks are interest points detected and matched in the images and mapped according to a bearings-only SLAM approach. As they are acquired and processed, the panoramic images are also indexed and stored into a database. A database query procedure, independent of the robot and landmark position estimates, is able to detect loop closures by retrieving memorized images that are close to the current robot position. The bearings-only estimation process is described, and results over a trajectory of a few hundreds of meters are presented and discussed.

[1]  Cordelia Schmid,et al.  Scale & Affine Invariant Interest Point Detectors , 2004, International Journal of Computer Vision.

[2]  Simon Lacroix,et al.  Position estimation in outdoor environments using pixel tracking and stereovision , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[3]  Wolfram Burgard,et al.  Towards Lazy Data Association in SLAM , 2003, ISRR.

[4]  R. Chellappa,et al.  Recursive 3-D motion estimation from a monocular image sequence , 1990 .

[5]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Eduardo Nebot,et al.  Localization and map building using laser range sensors in outdoor applications , 2000, J. Field Robotics.

[7]  Sanjiv Singh,et al.  Motion Estimation from Image and Inertial Measurements , 2004, Int. J. Robotics Res..

[8]  Simon Lacroix,et al.  Rover localization in natural environments by indexing panoramic images , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[9]  A. Leonardis,et al.  Robust localization using eigenspace of spinning-images , 2000, Proceedings IEEE Workshop on Omnidirectional Vision (Cat. No.PR00704).

[10]  J. Barreto.  General central projection systems: modeling, calibration and visual servoing , 2004 .

[11]  Cordelia Schmid,et al.  Image matching with scale adjustment , 2004, Comput. Vis. Image Underst..

[12]  Yolanda González Cid,et al.  Real-time 3d SLAM with wide-angle vision , 2004 .

[13]  Wolfram Burgard,et al.  An efficient fastSLAM algorithm for generating maps of large-scale cyclic environments from raw laser range measurements , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[14]  Philip F. McLauchlan,et al.  A batch/recursive algorithm for 3D scene reconstruction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[15]  Michel Dhome,et al.  3D reconstruction of complex structures with bundle adjustment: an incremental approach , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[16]  Kurt Konolige,et al.  SLAM via Variable Reduction from Constraint Maps , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[17]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  Tim Bailey.  Constrained initialisation for bearing-only SLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[19]  David W. Murray,et al.  A unifying framework for structure and motion recovery from image sequences , 1995, Proceedings of IEEE International Conference on Computer Vision.

[20]  David Nistér,et al.  Preemptive RANSAC for live structure and motion estimation , 2005, Machine Vision and Applications.

[21]  Gamini Dissanayake,et al.  An efficient multiple hypothesis filter for bearing-only SLAM , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[22]  Cordelia Schmid,et al.  A performance evaluation of local descriptors , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Tim D. Barfoot,et al.  Online visual motion estimation using FastSLAM with SIFT features , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Simon Lacroix,et al.  Monocular-vision based SLAM using Line Segments , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[25]  Cordelia Schmid,et al.  Comparing and evaluating interest points , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[26]  Ales Leonardis,et al.  Incremental PCA for on-line visual learning and recognition , 2002, Object recognition supported by user interaction for service robots.

[27]  Hiroshi Ishiguro,et al.  Image-based memory of environment , 1996, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems. IROS '96.

[28]  Sanjiv Singh,et al.  Online Motion Estimation from Image and Inertial Measurements , 2003 .

[29]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..

[30]  J. Leonard,et al.  Decoupled Stochastic Mapping , 2001 .

[31]  Paul Newman,et al.  SLAM-Loop Closing with Visually Salient Features , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[32]  Simon Lacroix,et al.  A practical 3D bearing-only SLAM algorithm , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization and Mapping with Sparse Extended Information Filters , 2004, Int. J. Robotics Res..

[34]  John J. Leonard,et al.  Decoupled stochastic mapping [for mobile robot & AUV navigation] , 2001 .

[35]  S. Thompson,et al.  Mobile robot localization using circular correlations of panoramic images , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[36]  Clark F. Olson,et al.  Robust stereo ego-motion for long distance navigation , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[37]  Eduardo Mario Nebot,et al.  Optimization of the simultaneous localization and map-building algorithm for real-time implementation , 2001, IEEE Trans. Robotics Autom..

[38]  Roland Siegwart,et al.  Deriving and matching image fingerprint sequences for mobile robot localization , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[39]  Simon Lacroix,et al.  Simultaneous Localization and Mapping with Stereovision , 2003, ISRR.

[40]  James J. Little,et al.  Vision-based global localization and mapping for mobile robots , 2005, IEEE Transactions on Robotics.

[41]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[42]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[43]  Favio R. Masson,et al.  Navigation and Mapping in Large Unstructured Environments , 2004, Int. J. Robotics Res..

[44]  E. Nebot,et al.  Autonomous Navigation and Map building Using Laser Range Sensors in Outdoor Applications , 2000 .

[45]  Juan D. Tardós,et al.  Hierarchical SLAM: real-time accurate mapping of large environments , 2005, IEEE Transactions on Robotics.

[46]  José Santos-Victor,et al.  Information Sampling for Optimal Image Data Selection , 2001 .

[47]  Gamini Dissanayake,et al.  Bearing-only SLAM Using a SPRT Based Gaussian Sum Filter , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[48]  Shigang Li,et al.  Qualitative representation of outdoor environment along route , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[49]  Michel Devy,et al.  Undelayed initialization in bearing only SLAM , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[50]  Wolfram Burgard,et al.  An Autonomous Robotic System for Mapping Abandoned Mines , 2003, NIPS.

[51]  Michael Bosse,et al.  Mapping Partially Observable Features from Multiple Uncertain Vantage Points , 2002, Int. J. Robotics Res..

[52]  N. Peach,et al.  Bearings-only tracking using a set of range-parameterised extended Kalman filters , 1995 .

[53]  Martial Hebert,et al.  Experimental Comparison of Techniques for Localization and Mapping Using a Bearing-Only Sensor , 2000, ISER.