Simultaneous Localization And Mapping: Present, Future, and the Robust-Perception Age

Simultaneous Localization and Mapping (SLAM) consists in the concurrent construction of a representation of the environment (the map), and the estimation of the state of the robot moving within it. The SLAM community has made astonishing progress over the last 30 years, enabling large-scale real-world applications, and witnessing a steady transition of this technology to industry. We survey the current state of SLAM. We start by presenting what is now the de-facto standard formulation for SLAM. We then review related work, covering a broad set of topics including robustness and scalability in long-term mapping, metric and semantic representations for mapping, theoretical performance guarantees, active SLAM and exploration, and other new frontiers. The paper serves as a tutorial for the non-expert reader. It is also a position paper: by looking at the published research with a critical eye, we delineate open challenges and new research issues, that still deserve careful scientific investigation. The paper also contains the authors’ take on two questions that often animate discussions during robotics conferences: do robots need SLAM? Is SLAM solved?

[1]  Giuseppe Carlo Calafiore,et al.  Lagrangian duality in 3D SLAM: Verification techniques and optimal solutions , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Kurt Konolige,et al.  Incremental mapping of large cyclic environments , 1999, Proceedings 1999 IEEE International Symposium on Computational Intelligence in Robotics and Automation. CIRA'99 (Cat. No.99EX375).

[3]  Gamini Dissanayake,et al.  A review of recent developments in Simultaneous Localization and Mapping , 2011, 2011 6th International Conference on Industrial and Information Systems.

[4]  John J. Leonard,et al.  Communication-constrained multi-AUV cooperative SLAM , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Alfred O. Hero,et al.  Sensor Management: Past, Present, and Future , 2011, IEEE Sensors Journal.

[6]  Gamini Dissanayake,et al.  Active SLAM using Model Predictive Control and Attractor based Exploration , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Ryad Benosman,et al.  Asynchronous Event-Based Visual Shape Tracking for Stable Haptic Feedback in Microrobotics , 2012, IEEE Transactions on Robotics.

[8]  Edwin Olson,et al.  Inference on networks of mixtures for robust robot mapping , 2012, Robotics: Science and Systems.

[9]  Stefano Soatto,et al.  Steps Towards a Theory of Visual Information: Active Perception, Signal-to-Symbol Conversion and the Interplay Between Sensing and Control , 2011, ArXiv.

[10]  Gamini Dissanayake,et al.  Planning under uncertainty using model predictive control for information gathering , 2006, Robotics Auton. Syst..

[11]  Venu Madhav Govindu,et al.  Combining two-view constraints for motion estimation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Frank Dellaert,et al.  iSAM2: Incremental smoothing and mapping using the Bayes tree , 2012, Int. J. Robotics Res..

[13]  David Wettergreen,et al.  Real‐Time SLAM with Octree Evidence Grids for Exploration in Underwater Tunnels , 2007, J. Field Robotics.

[14]  Didier Stricker,et al.  CoRBS: Comprehensive RGB-D benchmark for SLAM using Kinect v2 , 2016, 2016 IEEE Winter Conference on Applications of Computer Vision (WACV).

[15]  Jaime Valls Miró,et al.  Active Pose SLAM , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Frank Dellaert,et al.  Planning in the continuous domain: A generalized belief space approach for autonomous navigation in unknown environments , 2015, Int. J. Robotics Res..

[17]  John J. Leonard,et al.  Real-time 6-DOF multi-session visual SLAM over large-scale environments , 2013, Robotics Auton. Syst..

[18]  Keith Yu Kit Leung,et al.  The UTIAS multi-robot cooperative localization and mapping dataset , 2011, Int. J. Robotics Res..

[19]  David Wettergreen,et al.  Active SLAM and Loop Prediction with the Segmented Map Using Simplified Models , 2009, FSR.

[20]  Tobi Delbruck,et al.  A 240 × 180 130 dB 3 µs Latency Global Shutter Spatiotemporal Vision Sensor , 2014, IEEE Journal of Solid-State Circuits.

[21]  Wolfram Burgard,et al.  Hierarchical sparse coded surface models , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Dorian Gálvez-López,et al.  Bags of Binary Words for Fast Place Recognition in Image Sequences , 2012, IEEE Transactions on Robotics.

[23]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[24]  Michael Trentini,et al.  Multiple‐Robot Simultaneous Localization and Mapping: A Review , 2016, J. Field Robotics.

[25]  Stergios I. Roumeliotis,et al.  Distributed Maximum A Posteriori Estimation for Multi-robot Cooperative Localization , 2009 .

[26]  Pieter Abbeel,et al.  Scaling up Gaussian Belief Space Planning Through Covariance-Free Trajectory Optimization and Automatic Differentiation , 2014, WAFR.

[27]  Juan Andrade-Cetto,et al.  Information-Based Compact Pose SLAM , 2010, IEEE Transactions on Robotics.

[28]  Alex Pentland,et al.  Recovery of Nonrigid Motion and Structure , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Paul Newman,et al.  Loop closure detection in SLAM by combining visual and spatial appearance , 2006, Robotics Auton. Syst..

[30]  Ryan M. Eustice,et al.  Real-Time Visual SLAM for Autonomous Underwater Hull Inspection Using Visual Saliency , 2013, IEEE Transactions on Robotics.

[31]  Udo Frese,et al.  Interview: Is SLAM Solved? , 2010, KI - Künstliche Intelligenz.

[32]  Wolfram Burgard,et al.  A Tutorial on Graph-Based SLAM , 2010, IEEE Intelligent Transportation Systems Magazine.

[33]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[34]  Roland Siegwart,et al.  Long-Endurance Sensing and Mapping Using a Hand-Launchable Solar-Powered UAV , 2015, FSR.

[35]  Basilio Bona,et al.  Active SLAM and Exploration with Particle Filters Using Kullback-Leibler Divergence , 2014, J. Intell. Robotic Syst..

[36]  Aaron Hertzmann,et al.  Nonrigid Structure-from-Motion: Estimating Shape and Motion with Hierarchical Priors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[38]  Gamini Dissanayake,et al.  Linear SLAM: A linear solution to the feature-based and pose graph SLAM based on submap joining , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  J. Mendel Lessons in Estimation Theory for Signal Processing, Communications, and Control , 1995 .

[40]  John J. Leonard,et al.  Consistent sparsification for graph optimization , 2013, 2013 European Conference on Mobile Robots.

[41]  Tom Duckett,et al.  Experimental Analysis of Sample-Based Maps for Long-Term SLAM , 2009, Int. J. Robotics Res..

[42]  Siddhartha S. Srinivasa,et al.  Chisel: Real Time Large Scale 3D Reconstruction Onboard a Mobile Device using Spatially Hashed Signed Distance Fields , 2015, Robotics: Science and Systems.

[43]  J. M. M. Montiel,et al.  Visual SLAM for Handheld Monocular Endoscope , 2014, IEEE Transactions on Medical Imaging.

[44]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[45]  Ryan M. Eustice,et al.  Ford Campus vision and lidar data set , 2011, Int. J. Robotics Res..

[46]  Wolfram Burgard,et al.  An approach to solving large-scale SLAM problems with a small memory footprint , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[47]  Barbara Caputo,et al.  Multi-modal Semantic Place Classification , 2010, Int. J. Robotics Res..

[48]  Alex Pentland,et al.  Good vibrations: modal dynamics for graphics and animation , 1989, SIGGRAPH.

[49]  Basilio Bona,et al.  A fast and accurate approximation for planar pose graph optimization , 2014, Int. J. Robotics Res..

[50]  Frank Dellaert,et al.  Selecting good measurements via ℓ1 relaxation: A convex approach for robust estimation over graphs , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[51]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[52]  Wolfram Burgard,et al.  A benchmark for the evaluation of RGB-D SLAM systems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[53]  A. Rényi On Measures of Entropy and Information , 1961 .

[54]  Ryan M. Eustice,et al.  Perception-driven navigation: Active visual SLAM for robotic area coverage , 2013, 2013 IEEE International Conference on Robotics and Automation.

[55]  Nicholas Roy,et al.  A Linear Approximation for Graph-Based Simultaneous Localization and Mapping , 2012 .

[56]  Tom Duckett,et al.  Lifelong Information-Driven Exploration to Complete and Refine 4-D Spatio-Temporal Maps , 2016, IEEE Robotics and Automation Letters.

[57]  Ryad Benosman,et al.  Asynchronous event-based corner detection and matching , 2015, Neural Networks.

[58]  ARISTIDES A. G. REQUICHA,et al.  Representations for Rigid Solids: Theory, Methods, and Systems , 1980, CSUR.

[59]  Leonidas J. Guibas,et al.  Shape2Pose , 2014, ACM Trans. Graph..

[60]  Emilio Frazzoli,et al.  Low-latency heading feedback control with neuromorphic vision sensors using efficient approximated incremental inference , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[61]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[62]  Roland Siegwart,et al.  Improved appearance-based matching in similar and dynamic environments using a Vocabulary tree , 2010, 2010 IEEE International Conference on Robotics and Automation.

[63]  Andreas Nchter 3D Robotic Mapping: The Simultaneous Localization and Mapping Problem with Six Degrees of Freedom , 2009 .

[64]  Sebastian Ramos,et al.  The Cityscapes Dataset for Semantic Urban Scene Understanding , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[65]  Frank Dellaert,et al.  Duality-based verification techniques for 2D SLAM , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[66]  Yoel Shkolnisky,et al.  Three-Dimensional Structure Determination from Common Lines in Cryo-EM by Eigenvectors and Semidefinite Programming , 2011, SIAM J. Imaging Sci..

[67]  Javier Civera,et al.  Towards semantic SLAM using a monocular camera , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[68]  James M. Rehg,et al.  Joint Semantic Segmentation and 3D Reconstruction from Monocular Video , 2014, ECCV.

[69]  Stefano Soatto,et al.  Visual Scene Representations: Sufficiency, Minimality, Invariance and Deep Approximations , 2014, ICLR.

[70]  Davide Scaramuzza,et al.  Low-latency event-based visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[71]  Dieter Fox,et al.  Object Recognition in 3D Point Clouds Using Web Data and Domain Adaptation , 2010, Int. J. Robotics Res..

[72]  Brian Wyvill,et al.  Introduction to Implicit Surfaces , 1997 .

[73]  T. Delbruck,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 1 , 2022 .

[74]  Tomás Pajdla,et al.  Robust Rotation and Translation Estimation in Multiview Reconstruction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[75]  Jarek Rossignac,et al.  Solid modeling , 1994, IEEE Computer Graphics and Applications.

[76]  M. Carter Computer graphics: Principles and practice , 1997 .

[77]  Ryan M. Eustice,et al.  Generic factor-based node marginalization and edge sparsification for pose-graph SLAM , 2013, 2013 IEEE International Conference on Robotics and Automation.

[78]  Frank Dellaert,et al.  3D reconstruction of underwater structures , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[79]  Berthold Bäuml,et al.  On task-oriented criteria for configurations selection in robot calibration , 2013, 2013 IEEE International Conference on Robotics and Automation.

[80]  Mariana Luderitz Kolberg,et al.  Ouroboros: Using potential field in unexplored regions to close loops , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[81]  Wolfram Burgard,et al.  Nonlinear Constraint Network Optimization for Efficient Map Learning , 2009, IEEE Transactions on Intelligent Transportation Systems.

[82]  F. Dellaert Factor Graphs and GTSAM: A Hands-on Introduction , 2012 .

[83]  Henning Biermann,et al.  Recovering non-rigid 3D shape from image streams , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[84]  Davide Scaramuzza,et al.  Air-ground localization and map augmentation using monocular dense reconstruction , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[85]  Jonas Nygårds,et al.  C-SAM: Multi-Robot SLAM using square root information smoothing , 2008, 2008 IEEE International Conference on Robotics and Automation.

[86]  James J. Gibson,et al.  The Ecological Approach to Visual Perception: Classic Edition , 2014 .

[87]  Thomas B. Schön,et al.  Learning deep dynamical models from image pixels , 2014, ArXiv.

[88]  Wolfram Burgard,et al.  Accurate indoor localization for RGB-D smartphones and tablets given 2D floor plans , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[89]  Andrew J. Davison,et al.  A benchmark for RGB-D visual odometry, 3D reconstruction and SLAM , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[90]  Edwin Olson,et al.  Fast iterative alignment of pose graphs with poor initial estimates , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[91]  John J. Leonard,et al.  A convex relaxation for approximate global optimization in simultaneous localization and mapping , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[92]  Francesc Moreno-Noguer,et al.  Sequential Non-Rigid Structure from Motion Using Physical Priors , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[93]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[94]  Peter I. Corke,et al.  Visual Place Recognition: A Survey , 2016, IEEE Transactions on Robotics.

[95]  Stergios I. Roumeliotis,et al.  A Multi-State Constraint Kalman Filter for Vision-aided Inertial Navigation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[96]  Reinhard Klette,et al.  Towards Ubiquitous Autonomous Driving: The CCSAD Dataset , 2015, CAIP.

[97]  Frank Dellaert,et al.  Tectonic SAM: Exact, Out-of-Core, Submap-Based SLAM , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[98]  Niko Sünderhauf,et al.  Appearance change prediction for long-term navigation across seasons , 2013, 2013 European Conference on Mobile Robots.

[99]  Richard Szeliski,et al.  Bundle Adjustment in the Large , 2010, ECCV.

[100]  Dinesh Manocha,et al.  Model Synthesis: A General Procedural Modeling Algorithm , 2011, IEEE Transactions on Visualization and Computer Graphics.

[101]  Le Song,et al.  Hilbert Space Embeddings of Hidden Markov Models , 2010, ICML.

[102]  Vijay Kumar,et al.  Autonomous robotic exploration using occupancy grid maps and graph SLAM based on Shannon and Rényi Entropy , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[103]  Ron Alterovitz,et al.  Motion planning under uncertainty using iterative local optimization in belief space , 2012, Int. J. Robotics Res..

[104]  Sebastian Thrun,et al.  Active Exploration in Dynamic Environments , 1991, NIPS.

[105]  Nando de Freitas,et al.  A Bayesian exploration-exploitation approach for optimal online sensing and planning with a visually guided mobile robot , 2009, Auton. Robots.

[106]  John J. Leonard,et al.  Temporally scalable visual SLAM using a reduced pose graph , 2013, 2013 IEEE International Conference on Robotics and Automation.

[107]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[108]  Ingemar J. Cox,et al.  Dynamic Map Building for an Autonomous Mobile Robot , 1992 .

[109]  Horst Bischof,et al.  A Globally Optimal Algorithm for Robust TV-L1 Range Image Integration , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[110]  Ian D. Reid,et al.  Dense Reconstruction Using 3D Object Shape Priors , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[111]  Stefano Soatto,et al.  Wide-Sense Estimation on the Special Orthogonal Group , 2008, Commun. Inf. Syst..

[112]  Giuseppe Carlo Calafiore,et al.  Distributed centroid estimation from noisy relative measurements , 2012, Syst. Control. Lett..

[113]  Michal Irani,et al.  Multi-frame optical flow estimation using subspace constraints , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[114]  Laurent Kneip,et al.  Collaborative monocular SLAM with multiple Micro Aerial Vehicles , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[115]  Heng Wang,et al.  A convex optimization based approach for pose SLAM problems , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[116]  Kai Oliver Arras,et al.  FLIRT - Interest regions for 2D range data , 2010, 2010 IEEE International Conference on Robotics and Automation.

[117]  Stergios I. Roumeliotis,et al.  An observability-constrained sliding window filter for SLAM , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[118]  Ian D. Reid,et al.  A hybrid SLAM representation for dynamic marine environments , 2010, 2010 IEEE International Conference on Robotics and Automation.

[119]  Giuseppe Carlo Calafiore,et al.  Multi-agent localization from noisy relative pose measurements , 2011, 2011 IEEE International Conference on Robotics and Automation.

[120]  Ian D. Reid,et al.  Adaptive relative bundle adjustment , 2009, Robotics: Science and Systems.

[121]  Antonio Torralba,et al.  Parsing IKEA Objects: Fine Pose Estimation , 2013, 2013 IEEE International Conference on Computer Vision.

[122]  Grzegorz Cielniak,et al.  An Adaptive Spherical View Representation for Navigation in Changing Environments , 2009, ECMR.

[123]  John J. Leonard,et al.  Dynamic pose graph SLAM: Long-term mapping in low dynamic environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[124]  Luca Carlone,et al.  From Angular Manifolds to the Integer Lattice: Guaranteed Orientation Estimation With Application to Pose Graph Optimization , 2012, IEEE Transactions on Robotics.

[125]  John J. Leonard,et al.  Towards lifelong feature-based mapping in semi-static environments , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[126]  Hu He,et al.  Large Scale Monocular Vision-Only Mapping from a Fixed-Wing sUAS , 2012, FSR.

[127]  Pavel Zemcík,et al.  Incremental Block Cholesky Factorization for Nonlinear Least Squares in Robotics , 2013, Robotics: Science and Systems.

[128]  Frank Dellaert,et al.  Initialization techniques for 3D SLAM: A survey on rotation estimation and its use in pose graph optimization , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[129]  Paul H. J. Kelly,et al.  SLAM++: Simultaneous Localisation and Mapping at the Level of Objects , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[130]  Richard S. Sutton,et al.  Goal Seeking Components for Adaptive Intelligence: An Initial Assessment. , 1981 .

[131]  W. Burgard,et al.  Monte Carlo localization in hand-drawn maps , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[132]  Roland Siegwart,et al.  The EuRoC micro aerial vehicle datasets , 2016, Int. J. Robotics Res..

[133]  Kurt Konolige,et al.  Double window optimisation for constant time visual SLAM , 2011, 2011 International Conference on Computer Vision.

[134]  Davide Scaramuzza,et al.  Air‐ground Matching: Appearance‐based GPS‐denied Urban Localization of Micro Aerial Vehicles , 2015, J. Field Robotics.

[135]  Tom Duckett,et al.  A multilevel relaxation algorithm for simultaneous localization and mapping , 2005, IEEE Transactions on Robotics.

[136]  Andreas Nüchter,et al.  3D Robotic Mapping - The Simultaneous Localization and Mapping Problem with Six Degrees of Freedom , 2009, Springer Tracts in Advanced Robotics.

[137]  Alexei Makarenko,et al.  An experiment in integrated exploration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[138]  Maria Teresa Lazaro,et al.  Multi-robot SLAM using condensed measurements , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[139]  Daniel Cremers,et al.  Event-based 3D SLAM with a depth-augmented dynamic vision sensor , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[140]  Gamini Dissanayake,et al.  Simultaneous Localization and Mapping - Exactly Sparse Information Filters , 2011, New Frontiers in Robotics.

[141]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[142]  Paul Newman,et al.  Highly scalable appearance-only SLAM - FAB-MAP 2.0 , 2009, Robotics: Science and Systems.

[143]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[144]  Andreas Geiger,et al.  Vision meets robotics: The KITTI dataset , 2013, Int. J. Robotics Res..

[145]  Prabir Barooah,et al.  Collaborative localization with heterogeneous inter-robot measurements by Riemannian optimization , 2013, 2013 IEEE International Conference on Robotics and Automation.

[146]  Luke Fletcher,et al.  Multiple relative pose graphs for robust cooperative mapping , 2010, 2010 IEEE International Conference on Robotics and Automation.

[147]  Francesco Bullo,et al.  On frame and orientation localization for relative sensing networks , 2013, Autom..

[148]  John J. Leonard,et al.  Simultaneous stochastic mapping and localization , 1999 .

[149]  Charles E. Thorpe,et al.  The annotated laser data set for navigation in urban areas , 2011, Int. J. Robotics Res..

[150]  Luca Carlone,et al.  A convergence analysis for pose graph optimization via Gauss-Newton methods , 2013, 2013 IEEE International Conference on Robotics and Automation.

[151]  Leslie Pack Kaelbling,et al.  Planning and Acting in Partially Observable Stochastic Domains , 1998, Artif. Intell..

[152]  Michael Bosse,et al.  Keypoint design and evaluation for place recognition in 2D lidar maps , 2009, Robotics Auton. Syst..

[153]  Wolfram Burgard,et al.  Nonlinear factor recovery for long-term SLAM , 2016, Int. J. Robotics Res..

[154]  John J. Leonard,et al.  Adaptive Mobile Robot Navigation and Mapping , 1999, Int. J. Robotics Res..

[155]  F. Bullo,et al.  SENSOR NETWORK LOCALIZATION ON THE GROUP OF 3D DISPLACEMENTS , 2014 .

[156]  Jami J. Shah,et al.  Parametric and Feature-Based CAD/CAM: Concepts, Techniques, and Applications , 1995 .

[157]  Prabir Barooah,et al.  Error growth in position estimation from noisy relative pose measurements , 2013, Robotics Auton. Syst..

[158]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[159]  James F. O'Brien,et al.  Interpolating and approximating implicit surfaces from polygon soup , 2005, SIGGRAPH Courses.

[160]  Gamini Dissanayake,et al.  How far is SLAM from a linear least squares problem? , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[161]  Hugh F. Durrant-Whyte,et al.  Decentralised cooperative localisation for heterogeneous teams of mobile robots , 2011, 2011 IEEE International Conference on Robotics and Automation.

[162]  Barbara Caputo,et al.  COLD: The CoSy Localization Database , 2009, Int. J. Robotics Res..

[163]  Wolfram Burgard,et al.  Coordinated multi-robot exploration , 2005, IEEE Transactions on Robotics.

[164]  R. Bajcsy Active perception , 1988 .

[165]  Luke Fletcher,et al.  A High-rate, Heterogeneous Data Set From The DARPA Urban Challenge , 2010, Int. J. Robotics Res..

[166]  Sunando Sengupta,et al.  Semantic octree: Unifying recognition, reconstruction and representation via an octree constrained higher order MRF , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[167]  Johan Fredriksson,et al.  Simultaneous Multiple Rotation Averaging Using Lagrangian Duality , 2012, ACCV.

[168]  Yasir Latif,et al.  Fast minimum uncertainty search on a graph map representation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[169]  Davide Scaramuzza,et al.  REMODE: Probabilistic, monocular dense reconstruction in real time , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[170]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[171]  Francesc Moreno-Noguer,et al.  Real-time 3D reconstruction of non-rigid shapes with a single moving camera , 2016, Comput. Vis. Image Underst..

[172]  Stefano Soatto,et al.  A semi-direct approach to structure from motion , 2003, The Visual Computer.

[173]  F. Fraundorfer,et al.  Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications , 2012, IEEE Robotics & Automation Magazine.

[174]  Emilio Frazzoli,et al.  A Power-Performance Approach to Comparing Sensor Families, with application to comparing neuromorphic to traditional vision sensors , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[175]  Winston Churchill,et al.  The New College Vision and Laser Data Set , 2009, Int. J. Robotics Res..

[176]  Andrej Pázman,et al.  Foundations of Optimum Experimental Design , 1986 .

[177]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[178]  Michael Bosse,et al.  Get Out of My Lab: Large-scale, Real-Time Visual-Inertial Localization , 2015, Robotics: Science and Systems.

[179]  Roland Siegwart,et al.  Challenging data sets for point cloud registration algorithms , 2012, Int. J. Robotics Res..

[180]  Ian D. Reid,et al.  On the comparison of uncertainty criteria for active SLAM , 2012, 2012 IEEE International Conference on Robotics and Automation.

[181]  Cyrill Stachniss,et al.  Efficient information-theoretic graph pruning for graph-based SLAM with laser range finders , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[182]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[183]  Marc Pollefeys,et al.  Joint 3D Scene Reconstruction and Class Segmentation , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[184]  Henrik I. Christensen,et al.  Graphical SLAM for Outdoor Applications , 2007, J. Field Robotics.

[185]  David W. Murray,et al.  Towards simultaneous recognition, localization and mapping for hand-held and wearable cameras , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[186]  Silvio Savarese,et al.  Semantic structure from motion with points, regions, and objects , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[187]  Arunabha Bagchi,et al.  A theoretical look at information-driven sensor management criteria , 2011, 14th International Conference on Information Fusion.

[188]  Yasir Latif,et al.  Robust Loop Closing Over Time , 2012, Robotics: Science and Systems.

[189]  Michael Warren,et al.  Unaided stereo vision based pose estimation , 2010, ICRA 2010.

[190]  Chiara Bartolozzi,et al.  Asynchronous frameless event-based optical flow , 2012, Neural Networks.

[191]  Cyrill Stachniss,et al.  Robotic Mapping and Exploration , 2009, Springer Tracts in Advanced Robotics.

[192]  Alexei Makarenko,et al.  Information based adaptive robotic exploration , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[193]  Wolfram Burgard,et al.  Robust map optimization using dynamic covariance scaling , 2013, 2013 IEEE International Conference on Robotics and Automation.

[194]  Wolfram Burgard,et al.  A Tree Parameterization for Efficiently Computing Maximum Likelihood Maps using Gradient Descent , 2007, Robotics: Science and Systems.

[195]  Andreas Geiger,et al.  Lost! Leveraging the Crowd for Probabilistic Visual Self-Localization , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[196]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[197]  Gal A. Kaminka,et al.  Efficient frontier detection for robot exploration , 2014, Int. J. Robotics Res..

[198]  Juan Andrade-Cetto,et al.  Potential information fields for mobile robot exploration , 2015, Robotics Auton. Syst..

[199]  A. Singer Angular Synchronization by Eigenvectors and Semidefinite Programming. , 2009, Applied and computational harmonic analysis.

[200]  Joaquim Salvi,et al.  The SLAM problem: a survey , 2008, CCIA.

[201]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[202]  Gamini Dissanayake,et al.  Exploiting the Separable Structure of SLAM , 2015, Robotics: Science and Systems.

[203]  David Nistér,et al.  Scalable Recognition with a Vocabulary Tree , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[204]  John J. Leonard,et al.  Kintinuous: Spatially Extended KinectFusion , 2012, AAAI 2012.

[205]  Andrew J. Davison,et al.  DTAM: Dense tracking and mapping in real-time , 2011, 2011 International Conference on Computer Vision.

[206]  Tobi Delbrück,et al.  Low-latency localization by active LED markers tracking using a dynamic vision sensor , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[207]  Junzhou Huang,et al.  Towards robust and effective shape modeling: Sparse shape composition , 2012, Medical Image Anal..

[208]  Nathan Michael,et al.  Incremental Distributed Inference from Arbitrary Poses and Unknown Data Association: Using Collaborating Robots to Establish a Common Reference , 2016, IEEE Control Systems.

[209]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[210]  John J. Leonard,et al.  Robust incremental online inference over sparse factor graphs: Beyond the Gaussian case , 2013, 2013 IEEE International Conference on Robotics and Automation.

[211]  Heng Wang,et al.  On the Structure of Nonlinearities in Pose Graph SLAM , 2012, Robotics: Science and Systems.

[212]  Hauke Strasdat,et al.  Visual SLAM: Why filter? , 2012, Image Vis. Comput..

[213]  Frank Dellaert,et al.  Square Root SAM: Simultaneous Localization and Mapping via Square Root Information Smoothing , 2006, Int. J. Robotics Res..

[214]  Andrew J. Davison,et al.  Guest Editorial Special Issue on Visual SLAM , 2008 .

[215]  Davide Scaramuzza,et al.  Continuous-Time Trajectory Estimation for Event-based Vision Sensors , 2015, Robotics: Science and Systems.

[216]  Tobi Delbrück,et al.  A pencil balancing robot using a pair of AER dynamic vision sensors , 2009, 2009 IEEE International Symposium on Circuits and Systems.

[217]  Stefan Leutenegger,et al.  Simultaneous Optical Flow and Intensity Estimation from an Event Camera , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[218]  Frank Dellaert,et al.  Multi-level submap based SLAM using nested dissection , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[219]  Gordon Wyeth,et al.  FAB-MAP + RatSLAM: Appearance-based SLAM for multiple times of day , 2010, 2010 IEEE International Conference on Robotics and Automation.

[220]  Ryad Benosman,et al.  Asynchronous Event-Based Hebbian Epipolar Geometry , 2011, IEEE Transactions on Neural Networks.

[221]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[222]  John J. Leonard,et al.  Monocular SLAM Supported Object Recognition , 2015, Robotics: Science and Systems.

[223]  Frank Dellaert,et al.  DDF-SAM: Fully distributed SLAM using Constrained Factor Graphs , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[224]  Winston Churchill,et al.  Experience-based navigation for long-term localisation , 2013, Int. J. Robotics Res..

[225]  Michael S. Bernstein,et al.  Image retrieval using scene graphs , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[226]  Dimitrios G. Kottas,et al.  On the Consistency of Vision-Aided Inertial Navigation , 2012, ISER.

[227]  Carlos Sagüés,et al.  Distributed Consensus on Robot Networks for Dynamically Merging Feature-Based Maps , 2012, IEEE Transactions on Robotics.

[228]  Evangelos E. Milios,et al.  Globally Consistent Range Scan Alignment for Environment Mapping , 1997, Auton. Robots.

[229]  Robert E. Mahony,et al.  Optimization Algorithms on Matrix Manifolds , 2007 .

[230]  Ryad Benosman,et al.  Event-based 3D reconstruction from neuromorphic retinas , 2013, Neural Networks.

[231]  Marc Hanheide,et al.  Long-term topological localisation for service robots in dynamic environments using spectral maps , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[232]  Udo Frese,et al.  A Discussion of Simultaneous Localization and Mapping , 2006, Auton. Robots.

[233]  L. V. White FOUNDATIONS OF OPTIMUM EXPERIMENTAL DESIGN (Mathematics and Its Applications: East European Series) , 1987 .

[234]  Edwin Olson,et al.  Single-Cluster Spectral Graph Partitioning for Robotics Applications , 2005, Robotics: Science and Systems.

[235]  Wolfram Burgard,et al.  Information Gain-based Exploration Using Rao-Blackwellized Particle Filters , 2005, Robotics: Science and Systems.

[236]  Frank Dellaert,et al.  Concurrent filtering and smoothing: A parallel architecture for real-time navigation and full smoothing , 2014, Int. J. Robotics Res..

[237]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization, Mapping and Moving Object Tracking , 2007, Int. J. Robotics Res..

[238]  Wolfram Burgard,et al.  Supervised semantic labeling of places using information extracted from sensor data , 2007, Robotics Auton. Syst..

[239]  Jörg Conradt,et al.  Event-based particle filtering for robot self-localization , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[240]  Paul Timothy Furgale,et al.  Continuous-time batch estimation using temporal basis functions , 2012, 2012 IEEE International Conference on Robotics and Automation.

[241]  Alberto Elfes,et al.  Occupancy grids: a probabilistic framework for robot perception and navigation , 1989 .

[242]  Patrick Pérez,et al.  Incremental dense semantic stereo fusion for large-scale semantic scene reconstruction , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[243]  Cyrill Stachniss,et al.  Hierarchical optimization on manifolds for online 2D and 3D mapping , 2010, 2010 IEEE International Conference on Robotics and Automation.

[244]  Dimitrios G. Kottas,et al.  Camera-IMU-based localization: Observability analysis and consistency improvement , 2014, Int. J. Robotics Res..

[245]  Frank Dellaert,et al.  Exactly sparse memory efficient SLAM using the multi-block alternating direction method of multipliers , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[246]  Roland Siegwart,et al.  Map API - scalable decentralized map building for robots , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[247]  Ryan M. Eustice,et al.  Visual localization within LIDAR maps for automated urban driving , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[248]  Davide Scaramuzza,et al.  Event-based, 6-DOF pose tracking for high-speed maneuvers , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[249]  Frank Dellaert,et al.  Subgraph-preconditioned conjugate gradients for large scale SLAM , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[250]  Javier González,et al.  A Novel Measure of Uncertainty for Mobile Robot SLAM with Rao—Blackwellized Particle Filters , 2008, Int. J. Robotics Res..

[251]  Kostas Daniilidis,et al.  Grasping surfaces of revolution: Simultaneous pose and shape recovery from two views , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[252]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[253]  Michael Kaess,et al.  Simultaneous localization and mapping with infinite planes , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[254]  Dejan Pangercic,et al.  Semantic Object Maps for robotic housework - representation, acquisition and use , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[255]  Dieter Fox,et al.  DynamicFusion: Reconstruction and tracking of non-rigid scenes in real-time , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[256]  Jingjing Du,et al.  An application of Kullback-Leibler divergence to active SLAM and exploration with Particle Filters , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[257]  Jana Kosecka,et al.  Semantic parsing of street scenes from video , 2012, Int. J. Robotics Res..

[258]  Frank Dellaert,et al.  Distributed trajectory estimation with privacy and communication constraints: A two-stage distributed Gauss-Seidel approach , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[259]  Hanumant Singh,et al.  Visually Mapping the RMS Titanic: Conservative Covariance Estimates for SLAM Information Filters , 2006, Int. J. Robotics Res..

[260]  Sebastian Thrun,et al.  The Graph SLAM Algorithm with Applications to Large-Scale Mapping of Urban Structures , 2006, Int. J. Robotics Res..

[261]  Matthew Cook,et al.  Interacting maps for fast visual interpretation , 2011, The 2011 International Joint Conference on Neural Networks.

[262]  Giuseppe Carlo Calafiore,et al.  Planar Pose Graph Optimization: Duality, Optimal Solutions, and Verification , 2016, IEEE Transactions on Robotics.

[263]  Yasir Latif,et al.  On the monotonicity of optimality criteria during exploration in active SLAM , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[264]  Frank Dellaert,et al.  DDF-SAM 2.0: Consistent distributed smoothing and mapping , 2013, 2013 IEEE International Conference on Robotics and Automation.

[265]  Jörg Conradt,et al.  Simultaneous Localization and Mapping for Event-Based Vision Systems , 2013, ICVS.

[266]  Ian D. Reid,et al.  Manhattan scene understanding using monocular, stereo, and 3D features , 2011, 2011 International Conference on Computer Vision.

[267]  Hongdong Li,et al.  Rotation Averaging , 2013, International Journal of Computer Vision.

[268]  Sebastian Thrun,et al.  Exploration in active learning , 1998 .

[269]  Ryad Benosman,et al.  Simultaneous Mosaicing and Tracking with an Event Camera , 2014, BMVC.

[270]  Dezhen Song,et al.  Visual Navigation Using Heterogeneous Landmarks and Unsupervised Geometric Constraints , 2015, IEEE Transactions on Robotics.

[271]  Amit Singer,et al.  Exact and Stable Recovery of Rotations for Robust Synchronization , 2012, ArXiv.

[272]  Brian Yamauchi,et al.  A frontier-based approach for autonomous exploration , 1997, Proceedings 1997 IEEE International Symposium on Computational Intelligence in Robotics and Automation CIRA'97. 'Towards New Computational Principles for Robotics and Automation'.

[273]  Patric Jensfelt,et al.  Large-scale semantic mapping and reasoning with heterogeneous modalities , 2012, 2012 IEEE International Conference on Robotics and Automation.

[274]  Javier Civera,et al.  C2TAM: A Cloud framework for cooperative tracking and mapping , 2014, Robotics Auton. Syst..

[275]  Ashutosh Saxena,et al.  Hierarchical Semantic Labeling for Task-Relevant RGB-D Perception , 2014, Robotics: Science and Systems.

[276]  René Vidal,et al.  Intrinsic consensus on SO(3) with almost-global convergence , 2012, 2012 IEEE 51st IEEE Conference on Decision and Control (CDC).

[277]  Michael Suppa,et al.  Stereo-vision based obstacle mapping for indoor/outdoor SLAM , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[278]  Niko Sünderhauf,et al.  Towards a robust back-end for pose graph SLAM , 2012, 2012 IEEE International Conference on Robotics and Automation.

[279]  Vincent Lepetit,et al.  View-based Maps , 2010, Int. J. Robotics Res..

[280]  Daniel Matolin,et al.  An asynchronous time-based image sensor , 2008, 2008 IEEE International Symposium on Circuits and Systems.

[281]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[282]  Nathan Michael,et al.  Distributed real-time cooperative localization and mapping using an uncertainty-aware expectation maximization approach , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[283]  Ian D. Reid,et al.  A fast, modular scene understanding system using context-aware object detection , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[284]  Tobi Delbrück,et al.  A 128$\times$ 128 120 dB 15 $\mu$s Latency Asynchronous Temporal Contrast Vision Sensor , 2008, IEEE Journal of Solid-State Circuits.

[285]  Andreas Krause,et al.  Adaptive Submodularity: Theory and Applications in Active Learning and Stochastic Optimization , 2010, J. Artif. Intell. Res..

[286]  Heng Wang,et al.  On the number of local minima to the point feature based SLAM problem , 2012, 2012 IEEE International Conference on Robotics and Automation.