Vision-based navigation with efficient scene recognition

In this paper, we propose an efficient feature matching method for scene recognition and global localization. The proposed method enables mobile robots to autonomously navigate through the dynamic environment where the robot frequently encounters visual occlusion and kidnapping. For this purpose, we present a scale optimization method to enhance the matching performance with the combination of the FAST detector and integral image-based SIFT descriptors that are computationally efficient. The scale optimization method is required because the FAST detector does not provide scale information to compute descriptors for matching. We evaluate the performance of feature matching using various indoor image sequences and demonstrate the robustness of our navigation system under various conditions.

[1]  Wan Kyun Chung,et al.  An exploration strategy using sonar sensors in corridor environments , 2010, Intell. Serv. Robotics.

[2]  James J. Little,et al.  Mobile Robot Localization and Mapping with Uncertainty using Scale-Invariant Visual Landmarks , 2002, Int. J. Robotics Res..

[3]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Sebastian Thrun,et al.  Online simultaneous localization and mapping with detection and tracking of moving objects: theory and results from a ground vehicle in crowded urban areas , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[5]  Wan Kyun Chung,et al.  Robust mobile robot localization in highly non-static environments , 2010, Auton. Robots.

[6]  Charles E. Thorpe,et al.  Simultaneous localization and mapping with detection and tracking of moving objects , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[7]  Keinosuke Fukunaga,et al.  Introduction to statistical pattern recognition (2nd ed.) , 1990 .

[8]  José Santos-Victor,et al.  Vision-based navigation and environmental representations with an omnidirectional camera , 2000, IEEE Trans. Robotics Autom..

[9]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[10]  Gaurav S. Sukhatme,et al.  Mobile Robot Simultaneous Localization and Mapping in Dynamic Environments , 2005, Auton. Robots.

[11]  Horst Bischof,et al.  Fast Approximated SIFT , 2006, ACCV.

[12]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[13]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[14]  In-So Kweon,et al.  Vision-based navigation with pose recovery under visual occlusion and kidnapping , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  Ian D. Reid,et al.  Real-Time SLAM Relocalisation , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[16]  Robert M. Haralick,et al.  Review and analysis of solutions of the three point perspective pose estimation problem , 1994, International Journal of Computer Vision.

[17]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[18]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[19]  Ehud Rivlin,et al.  Visual Homing: Surfing on the Epipoles , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[20]  Ville Kyrki,et al.  Localization in ambiguous environments using multiple weak cues , 2008, Intell. Serv. Robotics.

[21]  Yasushi Yagi,et al.  Iconic memory-based omnidirectional route panorama navigation , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[23]  William H. Press,et al.  Numerical recipes in C , 2002 .

[24]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[25]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[26]  Sinisa Segvic,et al.  Large scale vision-based navigation without an accurate global reconstruction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[28]  Sebastian Thrun,et al.  Learning Metric-Topological Maps for Indoor Mobile Robot Navigation , 1998, Artif. Intell..

[29]  Timothy D. Barfoot,et al.  Visual teach and repeat for long-range rover autonomy , 2010 .

[30]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[31]  Walterio W. Mayol-Cuevas,et al.  Robust Real-Time Visual SLAM Using Scale Prediction and Exemplar Based Feature Description , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[33]  William H. Press,et al.  Numerical Recipes in C, 2nd Edition , 1992 .

[34]  Keinosuke Fukunaga,et al.  Introduction to Statistical Pattern Recognition , 1972 .

[35]  Ben J. A. Kröse,et al.  Navigation using an appearance based topological map , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[36]  Friedrich Fraundorfer,et al.  Topological mapping, localization and navigation using image collections , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[38]  Yoshio Yamamoto,et al.  Path planning of wheeled mobile robot with simultaneous free space locating capability , 2009, Intell. Serv. Robotics.

[39]  Zhichao Chen,et al.  Qualitative vision-based mobile robot navigation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[40]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..