A Simple and Parallel Algorithm for Real-Time Robot Localization by Fusing Monocular Vision and Odometry/AHRS Sensors

Vision and odometry/attitude and heading reference system (AHRS, three-axial gyroscopes, accelerometers, and magnetometers) sensors fusion strategy is prevalent in the recent years for the robot localization, due to its low cost and effectiveness in global positioning system (GPS)-denied environments. In this paper, a new adaptive estimation algorithm is proposed to estimate the robot position by fusing the monocular vision and odometry/AHRS sensors, and utilizing the properties of perspective projection. By the new method, the robot can be localized in real time in the GPS-denied and mapless environments, and the localization results can be theoretically proved convergent to their real values. Compared to other methods, our algorithm is simple to implement and suitable for parallel processing. To achieve the real-time performance, the algorithm is implemented in parallel using graphics processing unit (GPU), and therefore, it can be easily integrated into mobile robots' tasks like navigation and motion control, which need the real-time localization information. Simulations and experiments were conducted to validate the good convergence and longtime robustness performances of the proposed real-time localization algorithm.

[1]  Yunhui Liu,et al.  Asymptotic trajectory tracking of manipulators using uncalibrated visual feedback , 2003 .

[2]  W MurrayDavid,et al.  Simultaneous Localization and Map-Building Using Active Vision , 2002 .

[3]  Giovanni Ulivi,et al.  An outdoor navigation system using GPS and inertial platform , 2001, 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556).

[4]  Hong Zhang,et al.  Performance evaluation of visual SLAM using several feature extractors , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Joseph G. Loomis,et al.  PERFORMANCE DEVELOPMENT OF A REAL-TIME VISION SYSTEM , 2003 .

[6]  R. Husson,et al.  The dead reckoning localization system of the wheeled mobile robot ROMANE , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[7]  Jie Yang,et al.  Localization for Multirobot Formations in Indoor Environment , 2010, IEEE/ASME Transactions on Mechatronics.

[8]  Frank Dellaert,et al.  Probabilistic structure matching for visual SLAM with a multi-camera rig , 2010, Comput. Vis. Image Underst..

[9]  Yunhui Liu,et al.  Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera , 2008, IEEE Transactions on Robotics.

[10]  Scott M. Sawyer,et al.  Cluster-based 3D reconstruction of aerial video , 2012, 2012 IEEE Conference on High Performance Extreme Computing.

[11]  X. Cufi,et al.  Integrating visual odometry and dead-reckoning for robot localization and obstacle detection , 2010, 2010 IEEE International Conference on Automation, Quality and Testing, Robotics (AQTR).

[12]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[13]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[14]  Hauke Strasdat,et al.  Real-time monocular SLAM: Why filter? , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  Wolfram Burgard,et al.  Map-Based Precision Vehicle Localization in Urban Environments , 2008 .

[16]  Yunhui Liu,et al.  Uncalibrated visual servoing of robots using a depth-independent interaction matrix , 2006, IEEE Transactions on Robotics.

[17]  M. Bozorg,et al.  A Decentralized Architecture for Simultaneous Localization and Mapping , 2009, IEEE/ASME Transactions on Mechatronics.

[18]  Michel Dhome,et al.  Monocular Vision Based SLAM for Mobile Robots , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[19]  Katsuhiko Sakaue,et al.  Real-time camera parameter estimation from images for a mixed reality system , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[20]  De Xu,et al.  Ceiling-Based Visual Positioning for an Indoor Mobile Robot With Monocular Vision , 2009, IEEE Transactions on Industrial Electronics.

[21]  Salah Sukkarieh,et al.  Inertial Aiding of Inverse Depth SLAM using a Monocular Camera , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[22]  Stergios I. Roumeliotis,et al.  On the complexity and consistency of UKF-based SLAM , 2009, 2009 IEEE International Conference on Robotics and Automation.

[23]  David Nistér,et al.  An efficient solution to the five-point relative pose problem , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[24]  Wen-Hsiang Tsai,et al.  Robotics and Autonomous Systems Location Estimation for Indoor Autonomous Vehicle Navigation by Omni-directional Vision Using Circular Landmarks on Ceilings , 2022 .

[25]  Antonio González,et al.  Mobile Robot Map-Based Localization using approximate locations and the Extended Kalman Filter , 2005 .

[26]  Jihua Huang,et al.  A Low-Order DGPS-Based Vehicle Positioning System Under Urban Environment , 2006, IEEE/ASME Transactions on Mechatronics.

[27]  Sebastian Thrun,et al.  FastSLAM 2.0: an improved particle filtering algorithm for simultaneous localization and mapping that provably converges , 2003, IJCAI 2003.

[28]  R. Jarvis,et al.  A Review of Robotic SLAM , 2007 .

[29]  Simon Lacroix,et al.  Vision-Based SLAM: Stereo and Monocular Approaches , 2007, International Journal of Computer Vision.

[30]  Yunhui Liu,et al.  Dynamic Visual Tracking for Manipulators Using an Uncalibrated Fixed Camera , 2007, IEEE Transactions on Robotics.

[31]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[32]  Yunhui Liu,et al.  A new algorithm for robot localization using monocular vision and inertia/odometry sensors , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[33]  F. Moita,et al.  Sensor fusion for precise autonomous vehicle navigation in outdoor semi-structured environments , 2005, Proceedings. 2005 IEEE Intelligent Transportation Systems, 2005..

[34]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[35]  David W. Murray,et al.  Simultaneous Localization and Map-Building Using Active Vision , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[37]  Hyun Myung,et al.  Landmark-Based Particle Localization Algorithm for Mobile Robots With a Fish-Eye Vision System , 2013, IEEE/ASME Transactions on Mechatronics.