Multi Robot Object-Based SLAM

We propose a multi robot SLAM approach that uses 3D objects as landmarks for localization and mapping. The approach is fully distributed in that the robots only communicate during rendezvous and there is no centralized server gathering the data. Moreover, it leverages local computation at each robot (e.g., object detection and object pose estimation) to reduce the communication burden. We show that object-based representations reduce the memory requirements and information exchange among robots, compared to point-cloud-based representations; this enables operation in severely bandwidth-constrained scenarios. We test the approach in simulations and field tests, demonstrating its advantages over related techniques: our approach is as accurate as a centralized method, scales well to large teams, and is resistant to noise.

[1]  Benjamin Kuipers,et al.  The Spatial Semantic Hierarchy , 2000, Artif. Intell..

[2]  Nico Blodow,et al.  Functional object mapping of kitchen environments , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Pieter Abbeel,et al.  BigBIRD: A large-scale 3D database of object instances , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[4]  John J. Leonard,et al.  Communication-constrained multi-AUV cooperative SLAM , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[6]  Frank Dellaert,et al.  Distributed trajectory estimation with privacy and communication constraints: A two-stage distributed Gauss-Seidel approach , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Nathan Michael,et al.  Distributed real-time cooperative localization and mapping using an uncertainty-aware expectation maximization approach , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Dieter Fox,et al.  A large-scale hierarchical multi-view RGB-D object dataset , 2011, 2011 IEEE International Conference on Robotics and Automation.

[9]  Henrik I. Christensen,et al.  Simultaneous localization and mapping with learned object recognition and semantic data association , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Frank Dellaert,et al.  DDF-SAM 2.0: Consistent distributed smoothing and mapping , 2013, 2013 IEEE International Conference on Robotics and Automation.

[11]  Henrik I. Christensen,et al.  Planar surface SLAM with 3D and 2D sensors , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  Stergios I. Roumeliotis,et al.  Distributed Multi-Robot Localization , 2000, DARS.

[13]  Sebastian Thrun,et al.  Multi-robot SLAM with Sparse Extended Information Filers , 2003, ISRR.

[14]  Frank Dellaert,et al.  SLAM with object discovery, modeling and mapping , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Stergios I. Roumeliotis,et al.  Distributed multirobot localization , 2002, IEEE Trans. Robotics Autom..

[16]  Henrik I. Christensen,et al.  Efficient Organized Point Cloud Segmentation with Connected Components , 2013 .

[17]  F. Dellaert.  Factor Graphs and GTSAM: A Hands-on Introduction , 2012 .

[18]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Antonios Gasteratos,et al.  Semantic mapping for mobile robotics tasks: A survey , 2015, Robotics Auton. Syst..

[20]  Olivier Stasse,et al.  MonoSLAM: Real-Time Single Camera SLAM , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Ehud Rivlin,et al.  Graph-based distributed cooperative navigation for a general multi-robot measurement model , 2012, Int. J. Robotics Res..

[23]  Paul H. J. Kelly,et al.  SLAM++: Simultaneous Localisation and Mapping at the Level of Objects , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.