Robust Approaches for Localization on Multi-camera Systems in Dynamic Environments

Localization of humanoid robots in real-life scenarios has to robustly tackle dynamic environments and provide coherent data and tight integration for follow-up tasks. However state-of-the-art solutions, like ORBSlam2 [1], lack this ability. In this work we present two adaptations of ORBSlam2 for a multi-camera setup on the DLR Rollin' Justin System, one distributed multi-slam and one combined single-process system. Further, we introduce the usage of pre-recorded maps with ORBSlam2 and the alignment with semantic maps for planning. We compare performance of the adaptations against and the original approach in realistic experiments and discuss advantages and disadvantages of all methods.

[1]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[2]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[3]  Somkiat Wangsiripitak,et al.  Avoiding moving outliers in visual SLAM by tracking moving objects , 2009, 2009 IEEE International Conference on Robotics and Automation.

[4]  Markus Lienkamp,et al.  Persistent Map Saving for Visual Localization for Autonomous Vehicles: An ORB-SLAM 2 Extension , 2020, 2020 Fifteenth International Conference on Ecological Vehicles and Renewable Energies (EVER).

[5]  Richard Elvira,et al.  ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual–Inertial, and Multimap SLAM , 2021, IEEE Transactions on Robotics.

[6]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[7]  Luis Montano,et al.  Semantic visual SLAM in populated environments , 2017, 2017 European Conference on Mobile Robots (ECMR).

[8]  Stefan Hinz,et al.  MultiCol-SLAM - A Modular Real-Time Multi-Camera SLAM System , 2016, ArXiv.

[9]  Hujun Bao,et al.  Robust monocular SLAM in dynamic environments , 2013, 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[10]  Danping Zou,et al.  CoSLAM: Collaborative Visual SLAM in Dynamic Environments , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Roland Siegwart,et al.  Using multi-camera systems in robotics: Efficient solutions to the NPnP problem , 2013, 2013 IEEE International Conference on Robotics and Automation.

[12]  Raúl Rojas,et al.  Localization inside a populated parking garage by using particle filters with a map of the static environment , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[13]  Kurt Konolige,et al.  g 2 o: A general Framework for (Hyper) Graph Optimization , 2011 .

[14]  Edwin Olson,et al.  AprilTag 2: Efficient and robust fiducial detection , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[15]  Marc Pollefeys,et al.  Self-calibration and visual SLAM with a multi-camera system on a micro aerial vehicle , 2014, Auton. Robots.