Hybrid visual natural landmark–based localization for indoor mobile robots

Localization is a crucial part of autonomous moving for the indoor mobile robot. The natural features of the ceiling and surrounding environment can serve for position estimation. Based on these natural features, a hybrid visual natural landmarks–based localization method is proposed. We combine the landmarks-based positioning with ceiling-based visual odometry. During the visual odometry, the orientation is computed from the parallel features between the adjacent frames. The position is calculated from the corresponding point features in the two consecutive images using the perspective-n-point method. During the natural landmarks–based localization, the orientation filter is utilized to obtain the global orientation. Then, the feature points are determined by the Compute Unified Device Architecture–based scale-invariant feature transform algorithm. Finally, the position is estimated based on the computed orientation and point features. Various experiments have been conducted to evaluate the effectiveness of the proposed method. The experimental results show that the proposed localization method outperforms other methods in accuracy and efficiency.

[1]  Tao Wu,et al.  Observability analysis of rotation estimation by fusing inertial and line-based visual information: A revisit , 2006, Autom..

[2]  Sebastian Thrun,et al.  Bayesian Landmark Learning for Mobile Robot Localization , 1998, Machine Learning.

[3]  Nathan S. Netanyahu,et al.  An Efficient SIFT-Based Mode-Seeking Algorithm for Sub-Pixel Registration of Remotely Sensed Images , 2015, IEEE Geoscience and Remote Sensing Letters.

[4]  Yuichi Taguchi,et al.  MonoRGBD-SLAM: Simultaneous localization and mapping using both monocular and RGBD cameras , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Marc Pollefeys,et al.  Self-calibration and visual SLAM with a multi-camera system on a micro aerial vehicle , 2014, Auton. Robots.

[6]  Young Soo Suh Orientation Estimation Using a Quaternion-Based Indirect Kalman Filter With Adaptive Estimation of External Acceleration , 2010, IEEE Transactions on Instrumentation and Measurement.

[7]  Danping Zou,et al.  StructSLAM: Visual SLAM With Building Structure Lines , 2015, IEEE Transactions on Vehicular Technology.

[8]  Jörg Stückler,et al.  Large-scale direct SLAM with stereo cameras , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[9]  Takeo Kanade,et al.  Vision-guided humanoid footstep planning for dynamic environments , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[10]  Viktoria Fodor,et al.  Characterization of SURF and BRISK Interest Point Distribution for Distributed Feature Extraction in Visual Sensor Networks , 2015, IEEE Transactions on Multimedia.

[11]  Jae-Bok Song,et al.  Monocular Vision-Based SLAM in Indoor Environment Using Corner, Lamp, and Door Features From Upward-Looking Camera , 2011, IEEE Transactions on Industrial Electronics.

[12]  Wei-Ping Zhu,et al.  Unsupervized Image Clustering With SIFT-Based Soft-Matching Affinity Propagation , 2017, IEEE Signal Processing Letters.

[13]  Kai-Tai Song,et al.  Self-localization and control of an omni-directional mobile robot based on an omni-directional camera , 2009, 2009 7th Asian Control Conference.

[14]  De Xu,et al.  A general recursive linear method and unique solution pattern design for the perspective-n-point problem , 2008, Image Vis. Comput..

[15]  Michael Bosse,et al.  Keyframe-based visual–inertial odometry using nonlinear optimization , 2015, Int. J. Robotics Res..

[16]  Jenq-Neng Hwang,et al.  Ground-Moving-Platform-Based Human Tracking Using Visual SLAM and Constrained Multiple Kernels , 2016, IEEE Transactions on Intelligent Transportation Systems.

[17]  Ren C. Luo,et al.  Multilevel Multisensor-Based Intelligent Recharging System for Mobile Robot , 2008, IEEE Transactions on Industrial Electronics.

[18]  In-So Kweon,et al.  Bayesian filtering for keyframe-based visual SLAM , 2015, Int. J. Robotics Res..

[19]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[20]  Sukhan Lee,et al.  Embedded Visual SLAM: Applications for Low-Cost Consumer Robots , 2013, IEEE Robotics & Automation Magazine.

[21]  Khalid M. Hosny,et al.  Fast computation of accurate Gaussian-Hermite moments for image processing applications , 2012, Digit. Signal Process..

[22]  De Xu,et al.  Ceiling-Based Visual Positioning for an Indoor Mobile Robot With Monocular Vision , 2009, IEEE Transactions on Industrial Electronics.

[23]  Maoguo Gong,et al.  A Novel Coarse-to-Fine Scheme for Automatic Image Registration Based on SIFT and Mutual Information , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Kyoung Mu Lee,et al.  Visual SLAM with Line and Corner Features , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Azzedine Boukerche,et al.  Real-Time Vehicle Make and Model Recognition Based on a Bag of SURF Features , 2016, IEEE Transactions on Intelligent Transportation Systems.

[26]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[27]  Guoyou Wang,et al.  Robust Scale-Invariant Feature Matching for Remote Sensing Image Registration , 2009, IEEE Geoscience and Remote Sensing Letters.

[28]  Shiqian Wu,et al.  Weighted Guided Image Filtering , 2016, IEEE Transactions on Image Processing.

[29]  Edouard Ivanjko,et al.  Robust and accurate global vision system for real time tracking of multiple mobile robots , 2008, Robotics Auton. Syst..

[30]  José Santos-Victor,et al.  Vision-based navigation and environmental representations with an omnidirectional camera , 2000, IEEE Trans. Robotics Autom..

[31]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Peter Hubinský,et al.  Visual Localization of Mobile Robot Using Artificial Markers , 2014 .

[33]  Mo Dai,et al.  Image analysis by Gaussian-Hermite moments , 2011, Signal Process..

[34]  David A. Clausi,et al.  ARRSI: Automatic Registration of Remote-Sensing Images , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[35]  Dongquan Liu,et al.  Conditional simultaneous localization and mapping: A robust visual SLAM system , 2014, Neurocomputing.

[36]  Maoguo Gong,et al.  Remote Sensing Image Registration With Modified SIFT and Enhanced Feature Matching , 2017, IEEE Geoscience and Remote Sensing Letters.

[37]  Michael Gassner,et al.  SVO: Semidirect Visual Odometry for Monocular and Multicamera Systems , 2017, IEEE Transactions on Robotics.

[38]  Jon Atli Benediktsson,et al.  Accurate point matching based on multi-objective Genetic Algorithm for multi-sensor satellite imagery , 2014, Appl. Math. Comput..

[39]  Rozenn Dahyot Statistical Hough Transform , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[41]  M.C. Batouche,et al.  Particle swam optimization for image registration , 2004, Proceedings. 2004 International Conference on Information and Communication Technologies: From Theory to Applications, 2004..