Hybrid Maps Enhanced Localization System for Mobile Manipulator in Harsh Manufacturing Workshop

With excellent mobility and flexibility, mobile manipulators have great potential for loading and unloading tasks of numerical control machine tools (CNC) in manufacturing workshops. However, because of the rough and oily ground, dynamic obstacles and the convex plate of a CNC, harsh manufacturing workshop poses a huge challenge to the localization system of an autonomous mobile manipulator. To address the above problem, this paper presents a hybrid maps enhanced localization system which mainly consists of a global localization method and a pose tracking method. Hybrid maps including hybrid grid map, multi-resolution likelihood fields (MLFs) and hybrid point map are constructed to efficaciously model the harsh environment and to improve localization performance. Our global localization method employs the convex hull sampling to spares dense Lidar data and the MLFs based branch and bound (BnB) search to speed up global search. To achieve real-time localization reliably and accurately, our pose tracking method seamlessly combines the BnB search and the adaptive Monte Carlo localization, and the Iterative Closest Point (ICP) based scan matching using the hybrid point map is adopted for higher accuracy. In addition, a distance filter improved by unscented transform is integrated into the pose tracking process to mitigate the influence of dynamic obstacles. The developed localization system is evaluated through different experiments including two weeks of loading and unloading tasks in a real manufacturing scenario, resulting in superior localization performance.

[1]  Patrick Rives,et al.  Dense Omnidirectional RGB‐D Mapping of Large‐scale Outdoor Environments for Real‐time Localization and Autonomous Navigation , 2015, J. Field Robotics.

[2]  Wolfram Burgard,et al.  An accurate and efficient navigation system for omnidirectional robots in industrial environments , 2017, Auton. Robots.

[3]  Chao Liu,et al.  Reliable and Fast Localization in Ambiguous Environments Using Ambiguity Grid Map , 2019, Sensors.

[4]  Zdenko Kovacic,et al.  High-accuracy vehicle localization for autonomous warehousing , 2016 .

[5]  Ronald Parr,et al.  Learning probabilistic motion models for mobile robots , 2004, ICML.

[6]  Xiaozhi Qu,et al.  Vehicle localization using mono-camera and geo-referenced traffic signs , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[7]  Javier González,et al.  A robust, multi-hypothesis approach to matching occupancy grid maps , 2013, Robotica.

[8]  Andrey V. Savkin,et al.  An algorithm for safe navigation of mobile robots by a sensor network in dynamic cluttered industrial environments , 2018, Robotics and Computer-Integrated Manufacturing.

[9]  Yuriy S. Shmaliy,et al.  Indoor INS/LiDAR-Based Robot Localization With Improved Robustness Using Cascaded FIR Filter , 2019, IEEE Access.

[10]  Ryan M. Eustice,et al.  Robust LIDAR localization using multiresolution Gaussian mixture maps for autonomous driving , 2017, Int. J. Robotics Res..

[11]  Zdenko Kovacic,et al.  Multi-layer mapping-based autonomous forklift localization in an industrial environment , 2014, 22nd Mediterranean Conference on Control and Automation.

[12]  Dieter Fox,et al.  Adapting the Sample Size in Particle Filters Through KLD-Sampling , 2003, Int. J. Robotics Res..

[13]  Yi Liu,et al.  Online Dynamic Tip-Over Avoidance for a Wheeled Mobile Manipulator With an Improved Tip-Over Moment Stability Criterion , 2019, IEEE Access.

[14]  Manuela M. Veloso,et al.  Episodic non-Markov localization , 2017, Robotics Auton. Syst..

[15]  Jari Saarinen,et al.  Best-first branch and bound search method for map based localization , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Wolfgang Hess,et al.  Real-time loop closure in 2D LIDAR SLAM , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Wolfram Burgard,et al.  Lifelong localization in changing environments , 2013, Int. J. Robotics Res..

[18]  Renaud Dubé,et al.  PoseMap: Lifelong, Multi-Environment 3D LiDAR Localization , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Izabela Nielsen,et al.  A methodology for implementation of mobile robot in adaptive manufacturing environments , 2017, J. Intell. Manuf..

[20]  Kyung Shik Roh,et al.  Coarse-to-Fine Localization for a Mobile Robot Based on Place Learning With a 2-D Range Scan , 2016, IEEE Transactions on Robotics.

[21]  M. A. Jayaram,et al.  Convex Hulls in Image Processing: A Scoping Review , 2016 .

[22]  Bernhard Nebel,et al.  Towards effective localization in dynamic environments , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Yan Yang,et al.  A Novel Steering System for a Space-Saving 4WS4WD Electric Vehicle: Design, Modeling, and Road Tests , 2017, IEEE Transactions on Intelligent Transportation Systems.

[24]  Wolfram Burgard,et al.  On the position accuracy of mobile robot localization based on particle filters combined with scan matching , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Branko Ristic,et al.  KLD sampling with Gmapping proposal for Monte Carlo localization of mobile robots , 2019, Inf. Fusion.

[26]  Manuela M. Veloso,et al.  Corrective Gradient Refinement for mobile robot localization , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Wolfram Burgard,et al.  Robust Monte Carlo localization for mobile robots , 2001, Artif. Intell..

[28]  Tilo Schwarz,et al.  Precise pose graph localization with sparse point and lane features , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[29]  Sebastian Thrun,et al.  Learning Occupancy Grid Maps with Forward Sensor Models , 2003, Auton. Robots.

[30]  Gen Li,et al.  An Improved Observation Model for Monte-Carlo Localization Integrated with Reliable Reflector Prediction* , 2019, 2019 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[31]  Yohan Dupuis,et al.  Robust robot localization in a complex oil and gas industrial environment , 2018, J. Field Robotics.

[32]  Haibo Liu,et al.  Point Cloud Registration Based on MCMC-SA ICP Algorithm , 2019, IEEE Access.

[33]  Xiang-Yang Li,et al.  One More Tag Enables Fine-Grained RFID Localization and Tracking , 2018, IEEE/ACM Transactions on Networking.

[34]  Wolfram Burgard,et al.  Gaussian mixture models for probabilistic localization , 2008, 2008 IEEE International Conference on Robotics and Automation.

[35]  Myo-Taeg Lim,et al.  Improving Reliability of Particle Filter-Based Localization in Wireless Sensor Networks via Hybrid Particle/FIR Filtering , 2015, IEEE Transactions on Industrial Informatics.