Simultaneous Localization and Mapping: A Survey of Current Trends in Autonomous Driving

In this paper, we propose a survey of the Simultaneous Localization And Mapping (SLAM) field when considering the recent evolution of autonomous driving. The growing interest regarding self-driving cars has given new directions to localization and mapping techniques. In this survey, we give an overview of the different branches of SLAM before going into the details of specific trends that are of interest when considered with autonomous applications in mind. We first present the limits of classical approaches for autonomous driving and discuss the criteria that are essential for this kind of application. We then review the methods where the identified challenges are tackled. We mostly focus on approaches building and reusing long-term maps in various conditions (weather, season, etc.). We also go through the emerging domain of multivehicle SLAM and its link with self-driving cars. We survey the different paradigms of that field (centralized and distributed) and the existing solutions. Finally, we conclude by giving an overview of the various large-scale experiments that have been carried out until now and discuss the remaining challenges and future orientations.

[1]  Wolfram Burgard,et al.  Metric localization using Google Street View , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[2]  Hauke Strasdat,et al.  Real-time monocular SLAM: Why filter? , 2010, 2010 IEEE International Conference on Robotics and Automation.

[3]  Thierry Peynot,et al.  The Marulan Data Sets: Multi-sensor Perception in a Natural Environment with Challenging Conditions , 2010, Int. J. Robotics Res..

[4]  Sebastian Thrun,et al.  Multi-robot SLAM with Sparse Extended Information Filers , 2003, ISRR.

[5]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[6]  Kurt Konolige,et al.  FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping , 2008, IEEE Transactions on Robotics.

[7]  Jeffrey K. Uhlmann,et al.  Unscented filtering and nonlinear estimation , 2004, Proceedings of the IEEE.

[8]  Xin Zhang,et al.  End to End Learning for Self-Driving Cars , 2016, ArXiv.

[9]  James R. Bergen,et al.  Visual odometry for ground vehicle applications , 2006, J. Field Robotics.

[10]  Javier Civera,et al.  C2TAM: A Cloud framework for cooperative tracking and mapping , 2014, Robotics Auton. Syst..

[11]  Fabien Moutarde,et al.  Monocular urban localization using street view , 2016, 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[12]  Zhengyou Zhang,et al.  Incremental motion estimation through modified bundle adjustment , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[13]  Sanjiv Singh,et al.  The DARPA Urban Challenge: Autonomous Vehicles in City Traffic, George Air Force Base, Victorville, California, USA , 2009, The DARPA Urban Challenge.

[14]  Brett Browning,et al.  Closed-form Online Pose-chain SLAM , 2013, 2013 IEEE International Conference on Robotics and Automation.

[15]  Javier Civera,et al.  1-point RANSAC for EKF-based Structure from Motion , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Paul Newman,et al.  Outdoor SLAM using visual appearance and laser ranging , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[17]  Roland Chapuis,et al.  Localization and Mapping Using Only a Rotating FMCW Radar Sensor , 2013, Sensors.

[18]  Paul Newman,et al.  Practice makes perfect? Managing and leveraging visual experiences for lifelong navigation , 2012, 2012 IEEE International Conference on Robotics and Automation.

[19]  Matthew R. Walter,et al.  Sparse extended information filters: insights into sparsification , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Cordelia Schmid,et al.  Evaluation of Interest Point Detectors , 2000, International Journal of Computer Vision.

[21]  Wolfram Burgard,et al.  Conceptual spatial representations for indoor mobile robots , 2008, Robotics Auton. Syst..

[22]  Javier Civera,et al.  Towards semantic SLAM using a monocular camera , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Jens-Steffen Gutmann,et al.  A Constant-Time Algorithm for Vector Field SLAM using an Exactly Sparse Extended Information Filter , 2010, Robotics: Science and Systems.

[24]  Javier Ruiz-del-Solar,et al.  Semantic Mapping of Large-Scale Outdoor Scenes for Autonomous Off-Road Driving , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[25]  Cyrill Stachniss,et al.  Lazy Data Association For Image Sequences Matching Under Substantial Appearance Changes , 2016, IEEE Robotics and Automation Letters.

[26]  Sebastian Thrun,et al.  Map-Based Precision Vehicle Localization in Urban Environments , 2007, Robotics: Science and Systems.

[27]  Klaus C. J. Dietmayer,et al.  Multi-sensor self-localization based on Maximally Stable Extremal Regions , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[28]  William Whittaker,et al.  A robust approach to high‐speed navigation for unrehearsed desert terrain , 2006, J. Field Robotics.

[29]  Alexander Bachmann,et al.  Visual features for vehicle localization and ego-motion estimation , 2009, 2009 IEEE Intelligent Vehicles Symposium.

[30]  G. Ros,et al.  Visual SLAM for Driverless Cars : A Brief Survey , 2012 .

[31]  Michael Frankfurter,et al.  Numerical Recipes In C The Art Of Scientific Computing , 2016 .

[32]  Chieh-Chih Wang,et al.  LADAR-based detection and tracking of moving objects from a ground vehicle at high speeds , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[33]  Frank Dellaert,et al.  Large-scale experimental design for decentralized SLAM , 2012, Defense, Security, and Sensing.

[34]  Gonzalo Ferrer,et al.  Autonomous navigation for mobile service robots in urban pedestrian environments , 2011, J. Field Robotics.

[35]  Carlos Sagüés,et al.  Dynamic consensus for merging visual maps under limited communications , 2010, 2010 IEEE International Conference on Robotics and Automation.

[36]  J. P. Lewis.  Fast Normalized Cross-Correlation , 2010 .

[37]  Javier Ibanez Guzman,et al.  A constrained SLAM approach to robust and accurate localisation of autonomous ground vehicles , 2007, Robotics Auton. Syst..

[38]  P. Newman,et al.  Navigating , Recognising and Describing Urban Spaces With Vision and Laser , 2009 .

[39]  Wolfram Burgard,et al.  G2o: A general framework for graph optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[40]  Roland Chapuis,et al.  Communicating Vehicles in Convoy and Monocular Vision-based Localization , 2010 .

[41]  Max Pfingsthorn,et al.  UvA-DARE ( Digital Academic Repository ) A scalable hybrid multi-robot SLAM method for highly detailed maps , 2007 .

[42]  Dominique Gruyer,et al.  A cooperative fusion architecture for robust localization: Application to autonomous driving , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[43]  Gerd Wanielik,et al.  Improving Urban Vehicle Localization with Traffic Sign Recognition , 2015, 2015 IEEE 18th International Conference on Intelligent Transportation Systems.

[44]  Joachim Clemens,et al.  Evidential FastSLAM for grid mapping , 2013, Proceedings of the 16th International Conference on Information Fusion.

[45]  Stefan B. Williams,et al.  Efficient View-Based SLAM Using Visual Loop Closures , 2008, IEEE Transactions on Robotics.

[46]  Gamini Dissanayake,et al.  Convergence and Consistency Analysis for Extended Kalman Filter Based SLAM , 2007, IEEE Transactions on Robotics.

[47]  John J. Leonard,et al.  Past, Present, and Future of Simultaneous Localization and Mapping: Toward the Robust-Perception Age , 2016, IEEE Transactions on Robotics.

[48]  Juan D. Tardós,et al.  Large-Scale SLAM Building Conditionally Independent Local Maps: Application to Monocular Vision , 2008, IEEE Transactions on Robotics.

[49]  Arturo Gil,et al.  Multi-robot visual SLAM using a Rao-Blackwellized particle filter , 2010, Robotics Auton. Syst..

[50]  Hugh F. Durrant-Whyte,et al.  Simultaneous Localization and Mapping with Sparse Extended Information Filters , 2004, Int. J. Robotics Res..

[51]  Matthew R. Walter,et al.  Exactly Sparse Extended Information Filters for Feature-based SLAM , 2007, Int. J. Robotics Res..

[52]  Wolfram Burgard,et al.  Robust Visual Robot Localization Across Seasons Using Network Flows , 2014, AAAI.

[53]  Ales Leonardis,et al.  Robust localization using panoramic view-based recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[54]  Jeffrey K. Uhlmann,et al.  A counter example to the theory of simultaneous localization and map building , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[55]  Patrick Rives,et al.  Dense visual mapping of large scale environments for real-time localisation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[56]  Cindy Cappelle,et al.  Camera/Laser/GPS Fusion Method for Vehicle Positioning Under Extended NIS-Based Sensor Validation , 2013, IEEE Transactions on Instrumentation and Measurement.

[57]  Eduardo Mario Nebot,et al.  Optimization of the simultaneous localization and map-building algorithm for real-time implementation , 2001, IEEE Trans. Robotics Autom..

[58]  John J. Leonard,et al.  Pure range-only sub-sea SLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[59]  John J. Leonard,et al.  Explore and return: experimental validation of real-time concurrent mapping and localization , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[60]  I.T. Ruiz,et al.  Decentralised Simultaneous Localisation and Mapping for AUVs , 2007, OCEANS 2007 - Europe.

[61]  Ronald Parr,et al.  DP-SLAM: fast, robust simultaneous localization and mapping without predetermined landmarks , 2003, IJCAI 2003.

[62]  Kyoung Mu Lee,et al.  Multi-robot SLAM using ceiling vision , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[63]  Gaurav S. Sukhatme,et al.  Fault detection and identification in a mobile robot using multiple model estimation and neural network , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[64]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[65]  Michael R. James,et al.  Generation of Accurate Lane-Level Maps from Coarse Prior Maps and Lidar , 2015, IEEE Intelligent Transportation Systems Magazine.

[66]  Teresa A. Vidal-Calleja,et al.  Large scale multiple robot visual mapping with heterogeneous landmarks in semi-structured terrain , 2011, Robotics Auton. Syst..

[67]  Gamini Dissanayake,et al.  A review of recent developments in Simultaneous Localization and Mapping , 2011, 2011 6th International Conference on Industrial and Information Systems.

[68]  Carlos Sagüés,et al.  Consistent data association in multi-robot systems with limited communications , 2010, Robotics: Science and Systems.

[69]  John J. Leonard,et al.  Dynamic pose graph SLAM: Long-term mapping in low dynamic environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[70]  Walterio W. Mayol-Cuevas,et al.  Real-Time and Robust Monocular SLAM Using Predictive Multi-resolution Descriptors , 2006, ISVC.

[71]  Julius Ziegler,et al.  StereoScan: Dense 3d reconstruction in real-time , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[72]  Julius Ziegler,et al.  Lanelets: Efficient map representation for autonomous driving , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[73]  Francisco Angel Moreno,et al.  A collection of outdoor robotic datasets with centimeter-accuracy ground truth , 2009, Auton. Robots.

[74]  Mark E. Campbell,et al.  Map‐aided localization in sparse global positioning system environments using vision and particle filtering , 2011, J. Field Robotics.

[75]  Yoshiko Kojima,et al.  Automatic lane-level map generation for advanced driver assistance systems using low-cost sensors , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[76]  Sebastian Thrun,et al.  Towards fully autonomous driving: Systems and algorithms , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[77]  Evangeline Pollard,et al.  Credibilist simultaneous Localization And Mapping with a LIDAR , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[78]  Jagath Samarabandu,et al.  Recent advances in simultaneous localization and map-building using computer vision , 2007, Adv. Robotics.

[79]  Rafael Toledo-Moreo,et al.  Creating Enhanced Maps for Lane-Level Vehicle Navigation , 2010, IEEE Transactions on Intelligent Transportation Systems.

[80]  Lina María Paz,et al.  Divide and Conquer: EKF SLAM in O(n) , 2008, IEEE Trans. Robotics.

[81]  F. Fraundorfer,et al.  Visual Odometry : Part II: Matching, Robustness, Optimization, and Applications , 2012, IEEE Robotics & Automation Magazine.

[82]  Alberto Broggi,et al.  PROUD-Public road urban driverless test: Architecture and results , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[83]  Wolfram Burgard,et al.  An efficient fastSLAM algorithm for generating maps of large-scale cyclic environments from raw laser range measurements , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[84]  José A. Castellanos,et al.  Linear time vehicle relocation in SLAM , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[85]  Markus Maurer,et al.  Autonomous Vehicle Guidance on Braunschweig's inner ring road within the Stadtpilot Project , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[86]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[87]  Paul Timothy Furgale,et al.  Visual teach and repeat for long‐range rover autonomy , 2010, J. Field Robotics.

[88]  Joachim Hertzberg,et al.  3D Mapping with Semantic Knowledge , 2005, RoboCup.

[89]  Laurent Delobel,et al.  Robust localization using a top-down approach with several LIDAR sensors , 2015, 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[90]  Timothy S. Bailey,et al.  Mobile Robot Localisation and Mapping in Extensive Outdoor Environments , 2002 .

[91]  Stefan B. Williams,et al.  Towards multi-vehicle simultaneous localisation and mapping , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[92]  Markus Schreiber,et al.  LaneLoc: Lane marking based localization using highly accurate maps , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[93]  Ernst D. Dickmanns,et al.  An integrated spatio-temporal approach to automatic visual guidance of autonomous vehicles , 1990, IEEE Trans. Syst. Man Cybern..

[94]  Peter Cheeseman,et al.  On the Representation and Estimation of Spatial Uncertainty , 1986 .

[95]  Paul Newman,et al.  Using laser range data for 3D SLAM in outdoor environments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[96]  Fawzi Nashashibi,et al.  Multi-vehicle cooperative localization using indirect vehicle-to-vehicle relative pose estimation , 2012, 2012 IEEE International Conference on Vehicular Electronics and Safety (ICVES 2012).

[97]  R. E. Kalman,et al.  New Results in Linear Filtering and Prediction Theory , 1961 .

[98]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[99]  Wolfram Burgard,et al.  Autonomous Robot Navigation in Highly Populated Pedestrian Zones , 2015, J. Field Robotics.

[100]  Michael Bosse,et al.  Summary Maps for Lifelong Visual Localization , 2016, J. Field Robotics.

[101]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[102]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[103]  Michael Trentini,et al.  Multiple‐Robot Simultaneous Localization and Mapping: A Review , 2016, J. Field Robotics.

[104]  Hugh F. Durrant-Whyte,et al.  Decentralised Solutions to the Cooperative Multi-Platform Navigation Problem , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[105]  Richard Szeliski,et al.  City-Scale Location Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[106]  Peter I. Corke,et al.  Visual Place Recognition: A Survey , 2016, IEEE Transactions on Robotics.

[107]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[108]  Fawzi Nashashibi,et al.  PML-SLAM: a solution for localization in large-scale urban environments , 2015 .

[109]  Luca Gatti,et al.  VIAC: An out of ordinary experiment , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[110]  Aram Kawewong,et al.  Online and Incremental Appearance-based SLAM in Highly Dynamic Environments , 2011, Int. J. Robotics Res..

[111]  Javier Civera,et al.  1‐Point RANSAC for extended Kalman filtering: Application to real‐time structure from motion and visual odometry , 2010, J. Field Robotics.

[112]  Paul H. J. Kelly,et al.  SLAM++: Simultaneous Localisation and Mapping at the Level of Objects , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[113]  Romuald Aufrère,et al.  A general consistent decentralized Simultaneous Localization And Mapping solution , 2015, Robotics Auton. Syst..

[114]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[115]  Paul Newman,et al.  Generation and exploitation of local orthographic imagery for road vehicle localisation , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[116]  Hauke Strasdat,et al.  Visual SLAM: Why filter? , 2012, Image Vis. Comput..

[117]  Takeo Kanade,et al.  Real-time topometric localization , 2012, 2012 IEEE International Conference on Robotics and Automation.

[118]  Martin Lauer,et al.  Team AnnieWAY's Entry to the 2011 Grand Cooperative Driving Challenge , 2012, IEEE Transactions on Intelligent Transportation Systems.

[119]  Wolfram Burgard,et al.  A real-time algorithm for mobile robot mapping with applications to multi-robot and 3D mapping , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[120]  Xiaojun Wu,et al.  DAvinCi: A cloud computing framework for service robots , 2010, 2010 IEEE International Conference on Robotics and Automation.

[121]  Walter Lang,et al.  Application of Computational Intelligence for Sensor Fault Detection and Isolation , 2007 .

[122]  Werner Huber,et al.  Experience, Results and Lessons Learned from Automated Driving on Germany's Highways , 2015, IEEE Intelligent Transportation Systems Magazine.

[123]  Klaus C. J. Dietmayer,et al.  Autonomous driving at Ulm University: A modular, robust, and sensor-independent fusion approach , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[124]  Gordon Wyeth,et al.  SeqSLAM: Visual route-based navigation for sunny summer days and stormy winter nights , 2012, 2012 IEEE International Conference on Robotics and Automation.

[125]  Harry Shum,et al.  Efficient bundle adjustment with virtual key frames: a hierarchical approach to multi-frame structure from motion , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[126]  Todd Jochem,et al.  Rapidly Adapting Machine Vision for Automated Vehicle Steering , 1996, IEEE Expert.

[127]  Raúl Rojas,et al.  Pole-based localization for autonomous vehicles in urban scenarios , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[128]  Michel Dhome,et al.  Real Time Localization and 3D Reconstruction , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[129]  Jean-Paul Laumond,et al.  Position referencing and consistent world modeling for mobile robots , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[130]  Wei Zhang,et al.  Image Based Localization in Urban Environments , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[131]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[132]  José A. Castellanos,et al.  Robocentric map joining: Improving the consistency of EKF-SLAM , 2007, Robotics Auton. Syst..

[133]  Ivan Petrovic,et al.  Stereo odometry based on careful feature selection and tracking , 2015, 2015 European Conference on Mobile Robots (ECMR).

[134]  Rafael Toledo-Moreo,et al.  Lane-Level Integrity Provision for Navigation and Map Matching With GNSS, Dead Reckoning, and Enhanced Maps , 2010, IEEE Transactions on Intelligent Transportation Systems.

[135]  Yalou Huang,et al.  Cooperative simultaneous localization and mapping for multi-robot: Approach & experimental validation , 2010, 2010 8th World Congress on Intelligent Control and Automation.

[136]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[137]  Roland Siegwart,et al.  Toward automated driving in cities using close-to-market sensors: An overview of the V-Charge Project , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[138]  Gamini Dissanayake,et al.  How far is SLAM from a linear least squares problem? , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[139]  Eduardo Mario Nebot,et al.  Consistency of the FastSLAM algorithm , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[140]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[141]  Wolfram Burgard,et al.  Coordinated multi-robot exploration , 2005, IEEE Transactions on Robotics.

[142]  Ian D. Reid,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems a Comparison of Loop Closing Techniques in Monocular Slam , 2022 .

[143]  Miao Wang,et al.  Optimized route network graph as map reference for autonomous cars operating on German autobahn , 2011, The 5th International Conference on Automation, Robotics and Applications.

[144]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[145]  Vincent Frémont,et al.  Mapping and localization using GPS, lane markings and proprioceptive sensors , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[146]  Ian D. Reid,et al.  Mapping Large Loops with a Single Hand-Held Camera , 2007, Robotics: Science and Systems.

[147]  Patric Jensfelt,et al.  Fault detection for mobile robots using redundant positioning systems , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[148]  Wolfram Burgard,et al.  Do you see the bakery? Leveraging geo-referenced texts for global localization in public maps , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[149]  Jiri Matas,et al.  Robust wide-baseline stereo from maximally stable extremal regions , 2004, Image Vis. Comput..

[150]  Ji Zhang,et al.  Visual-lidar odometry and mapping: low-drift, robust, and fast , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[151]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[152]  John J. Leonard,et al.  6-DOF Multi-session Visual SLAM using Anchor Nodes , 2011, ECMR.

[153]  K. Madhava Krishna,et al.  Mapping large scale environments by combining Particle Filter and Information Filter , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[154]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[155]  Amir Roshan Zamir,et al.  City scale geo-spatial trajectory estimation of a moving camera , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[156]  Hugh F. Durrant-Whyte,et al.  Simultaneous map building and localization for an autonomous mobile robot , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.

[157]  Javier González,et al.  Subjective local maps for hybrid metric-topological SLAM , 2009, Robotics Auton. Syst..

[158]  John J. Leonard,et al.  Temporally scalable visual SLAM using a reduced pose graph , 2013, 2013 IEEE International Conference on Robotics and Automation.

[159]  Sebastian Thrun,et al.  Robust vehicle localization in urban environments using probabilistic maps , 2010, 2010 IEEE International Conference on Robotics and Automation.

[160]  Pavan Chakraborty,et al.  A review on cloud robotics based frameworks to solve simultaneous localization and mapping (slam) problem , 2017, ArXiv.

[161]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[162]  Rob H. Deaves,et al.  Multiple robot system for decentralized SLAM investigations , 2000, SPIE Optics East.

[163]  Henning Lategahn,et al.  City GPS using stereo vision , 2012, 2012 IEEE International Conference on Vehicular Electronics and Safety (ICVES 2012).

[164]  Roberto Cipolla,et al.  PoseNet: A Convolutional Network for Real-Time 6-DOF Camera Relocalization , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[165]  Konrad Tollmar,et al.  Searching the Web with mobile images for location recognition , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[166]  Paul Newman,et al.  Integrating metric and semantic maps for vision-only automated parking , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[167]  Eduardo Mario Nebot,et al.  Consistency of the EKF-SLAM Algorithm , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[168]  A. Davison,et al.  1-Point RANSAC for EKF Filtering . Application to Real-Time Structure from Motion and Visual Odometry , 2010 .

[169]  Paul Newman,et al.  Appearance-only SLAM at large scale with FAB-MAP 2.0 , 2011, Int. J. Robotics Res..

[170]  Tom Drummond,et al.  Unified Loop Closing and Recovery for Real Time Monocular SLAM , 2008, BMVC.

[171]  Andrew J. Davison,et al.  Automatically and efficiently inferring the hierarchical structure of visual maps , 2009, 2009 IEEE International Conference on Robotics and Automation.

[172]  Ian D. Reid,et al.  An image-to-map loop closing method for monocular SLAM , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[173]  Oussama Khatib,et al.  Springer Handbook of Robotics , 2007, Springer Handbooks.

[174]  J. A. Castellanos,et al.  Limits to the consistency of EKF-based SLAM , 2004 .

[175]  Francisco Angel Moreno,et al.  The Málaga urban dataset: High-rate stereo and LiDAR in a realistic urban scenario , 2014, Int. J. Robotics Res..

[176]  Ian D. Reid,et al.  On combining visual SLAM and visual odometry , 2010, 2010 IEEE International Conference on Robotics and Automation.

[177]  Fawzi Nashashibi,et al.  A real-time robust global localization for autonomous mobile robots in large environments , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[178]  José A. Castellanos,et al.  Multisensor fusion for simultaneous localization and map building , 2001, IEEE Trans. Robotics Autom..

[179]  Hugh F. Durrant-Whyte,et al.  Decentralised SLAM with Low-Bandwidth Communication for Teams of Vehicles , 2003, FSR.

[180]  Manish Kumar,et al.  Building Detection from Mobile Imagery Using Informative SIFT Descriptors , 2005, SCIA.

[181]  Michel Dhome,et al.  Lessons learned after more than 1000 km in an autonomous shuttle guided by vision , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[182]  Stefan B. Williams,et al.  An efficient approach to the simultaneous localisation and mapping problem , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[183]  Eduardo Nebot,et al.  Localization and map building using laser range sensors in outdoor applications , 2000, J. Field Robotics.

[184]  Y. Charlie Hu,et al.  Multi-robot SLAM with topological/metric maps , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[185]  Udo Frese,et al.  A Discussion of Simultaneous Localization and Mapping , 2006, Auton. Robots.

[186]  John J. Leonard,et al.  Cooperative concurrent mapping and localization , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[187]  Sebastian Thrun,et al.  Stanley: The robot that won the DARPA Grand Challenge , 2006, J. Field Robotics.

[188]  Pieter Abbeel,et al.  Image Object Label 3 D CAD Model Candidate Grasps Google Object Recognition Engine Google Cloud Storage Select Feasible Grasp with Highest Success Probability Pose EstimationCamera Robots Cloud 3 D Sensor , 2014 .

[189]  Michel Dhome,et al.  Monocular Vision for Mobile Robot Localization and Autonomous Navigation , 2007, International Journal of Computer Vision.

[190]  Yohan Dupuis,et al.  Fast and robust vehicle positioning on graph-based representation of drivable maps , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[191]  Javier Civera,et al.  Unified Inverse Depth Parametrization for Monocular SLAM , 2006, Robotics: Science and Systems.

[192]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[193]  Patrick Gros,et al.  Robot motion control from a visual memory , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[194]  Jeffrey K. Uhlmann,et al.  General Decentralized Data Fusion With Covariance Intersection (CI) , 2001 .

[195]  Christian Berger,et al.  Caroline: An autonomously driving vehicle for urban environments , 2008, J. Field Robotics.

[196]  Takashi Tsubouchi,et al.  Vehicle localization in outdoor woodland environments with sensor fault detection , 2008, 2008 IEEE International Conference on Robotics and Automation.

[197]  W. Burgard,et al.  RAWSEEDS: Robotics Advancement through Web-publishing of Sensorial and Elaborated Extensive Data Sets , 2010 .

[198]  Vikram Krishnamurthy,et al.  Data incest removal in a survivable estimation fusion architecture , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[199]  Wolfram Burgard,et al.  Monte Carlo localization for mobile robots , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[200]  Frank Dellaert,et al.  Covariance recovery from a square root information matrix for data association , 2009, Robotics Auton. Syst..

[201]  Juan D. Tardós,et al.  Data association in stochastic mapping using the joint compatibility test , 2001, IEEE Trans. Robotics Autom..

[202]  Henk Nijmeijer,et al.  Introduction to the Special Issue on the 2011 Grand Cooperative Driving Challenge , 2012 .

[203]  Peter S. Maybeck,et al.  Stochastic Models, Estimation And Control , 2012 .

[204]  C. Brenner.  Vehicle localization using landmarks obtained by a lidar mobile mapping system , 2010 .

[205]  William Whittaker,et al.  Autonomous driving in urban environments: Boss and the Urban Challenge , 2008, J. Field Robotics.

[206]  Martin David Adams,et al.  An augmented state SLAM formulation for multiple line-of-sight features with millimetre wave RADAR , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[207]  Trung-Dung Vu,et al.  Vehicle Perception: Localization, Mapping with Detection, Classification and Tracking of Moving Objects , 2009 .

[208]  A. Bartoli,et al.  Bi-Objective Bundle Adjustment With Application to Multi-Sensor SLAM , 2010 .

[209]  Raffaello D'Andrea,et al.  Rapyuta: A Cloud Robotics Platform , 2015, IEEE Transactions on Automation Science and Engineering.

[210]  Michael Bosse,et al.  An Atlas framework for scalable mapping , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[211]  Fawzi Nashashibi,et al.  Cooperative Multi-Vehicle Localization Using Split Covariance Intersection Filter , 2013, IEEE Intelligent Transportation Systems Magazine.

[212]  Kurt Konolige,et al.  Towards lifelong visual maps , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[213]  Daniel Cremers,et al.  Direct Sparse Odometry , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[214]  Junichi Meguro,et al.  A Low-Cost Solution for Automatic Lane-Level Map Generation Using Conventional In-Car Sensors , 2016, IEEE Transactions on Intelligent Transportation Systems.

[215]  José Ruíz Ascencio,et al.  Visual simultaneous localization and mapping: a survey , 2012, Artificial Intelligence Review.

[216]  John J. Leonard,et al.  Consistent, Convergent, and Constant-Time SLAM , 2003, IJCAI.

[217]  Sebastian Thrun,et al.  Results for outdoor-SLAM using sparse extended information filters , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[218]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[219]  Ryan M. Eustice,et al.  Ford Campus vision and lidar data set , 2011, Int. J. Robotics Res..

[220]  Jeffrey K. Uhlmann,et al.  New extension of the Kalman filter to nonlinear systems , 1997, Defense, Security, and Sensing.

[221]  C. Stiller,et al.  Team AnnieWAYs entry to the Grand Cooperative Driving Challenge 2011 , 2012 .

[222]  Luke Fletcher,et al.  A High-rate, Heterogeneous Data Set From The DARPA Urban Challenge , 2010, Int. J. Robotics Res..

[223]  Peter I. Corke,et al.  Routed roads: Probabilistic vision-based place recognition for changing conditions, split streets and varied viewpoints , 2016, Int. J. Robotics Res..

[224]  Marc Pollefeys,et al.  Leveraging 3D City Models for Rotation Invariant Place-of-Interest Recognition , 2011, International Journal of Computer Vision.

[225]  Joel W. Burdick,et al.  Alice: An information‐rich autonomous vehicle for high‐speed desert navigation , 2006, J. Field Robotics.

[226]  Udo Frese,et al.  Closing a Million-Landmarks Loop , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[227]  Ronald Parr,et al.  DP-SLAM 2.0 , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[228]  P. Faure,et al.  Radar-based SLAM without odometric sensor , 2010 .

[229]  Fabien Moutarde,et al.  Improving robustness of monocular urban localization using augmented Street View , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[230]  Patrick Rives,et al.  An asymmetric real-time dense visual localisation and mapping system , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[231]  Erik Blasch,et al.  Unmanned vehicles come of age: The DARPA grand challenge , 2006, Computer.

[232]  Frank Dellaert,et al.  DDF-SAM: Fully distributed SLAM using Constrained Factor Graphs , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[233]  Michel Dhome,et al.  Localization in urban environments: monocular vision compared to a differential GPS sensor , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[234]  Thiagalingam Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation , 2001 .

[235]  Andrew Zisserman,et al.  Efficient Visual Search of Videos Cast as Text Retrieval , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[236]  Hugh Durrant-Whyte,et al.  A Beginners Guide to Decentralised Data Fusion , 2006 .

[237]  Hugh F. Durrant-Whyte,et al.  An Experimental and Theoretical Investigation into Simultaneous Localisation and Map Building , 1999, ISER.

[238]  Fawzi Nashashibi,et al.  A new method for occupancy grid maps merging: Application to multi-vehicle cooperative local mapping and moving object detection in outdoor environment , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[239]  Alberto Broggi,et al.  Extensive Tests of Autonomous Driving Technologies , 2013, IEEE Transactions on Intelligent Transportation Systems.

[240]  Cyrill Stachniss,et al.  Hierarchical optimization on manifolds for online 2D and 3D mapping , 2010, 2010 IEEE International Conference on Robotics and Automation.

[241]  Romuald Aufrère,et al.  Real-Time Monocular SLAM With Low Memory Requirements , 2015, IEEE Transactions on Intelligent Transportation Systems.

[242]  Ryan M. Eustice,et al.  Visual localization within LIDAR maps for automated urban driving , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[243]  Paul Newman,et al.  Navigating, Recognizing and Describing Urban Spaces With Vision and Lasers , 2009, Int. J. Robotics Res..

[244]  Stergios I. Roumeliotis,et al.  Multi-robot SLAM with Unknown Initial Correspondence: The Robot Rendezvous Case , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[245]  Joaquim Salvi,et al.  The SLAM problem: a survey , 2008, CCIA.

[246]  Wolfram Burgard,et al.  Efficient estimation of accurate maximum likelihood maps in 3D , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[247]  Kevin P. Murphy,et al.  Bayesian Map Learning in Dynamic Environments , 1999, NIPS.

[248]  Mohammad Reza Emami,et al.  Just-in-time cooperative simultaneous localization and mapping , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[249]  Takashi Tsubouchi,et al.  Path-following algorithms and experiments for an unmanned surface vehicle , 2009 .

[250]  Michael Felsberg,et al.  Robust stereo visual odometry from monocular techniques , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[251]  Hugh Durrant-Whyte,et al.  Simultaneous localization and mapping (SLAM): part II , 2006 .

[252]  Joachim Hertzberg,et al.  Towards semantic maps for mobile robots , 2008, Robotics Auton. Syst..

[253]  Gaurav S. Sukhatme,et al.  Sensor fault detection and identification in a mobile robot , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[254]  Juan D. Tardós,et al.  Hierarchical SLAM: real-time accurate mapping of large environments , 2005, IEEE Transactions on Robotics.

[255]  Mubarak Shah,et al.  Accurate Image Localization Based on Google Maps Street View , 2010, ECCV.

[256]  Xiaozhi Qu,et al.  Vehicle localization using mono-camera and geo-referenced traffic signs , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[257]  Julius Ziegler,et al.  Making Bertha Drive—An Autonomous Journey on a Historic Route , 2014, IEEE Intelligent Transportation Systems Magazine.

[258]  Winston Churchill,et al.  The New College Vision and Laser Data Set , 2009, Int. J. Robotics Res..

[259]  Irfan A. Essa,et al.  Propagation of innovative information in non-linear least-squares structure from motion , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[260]  Tom Drummond,et al.  Scalable Monocular SLAM , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[261]  Gamini Dissanayake,et al.  A critique of current developments in simultaneous localization and mapping , 2016 .

[262]  Wolfram Burgard,et al.  Robust visual SLAM across seasons , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[263]  E. Nebot,et al.  Autonomous Navigation and Map building Using Laser Range Sensors in Outdoor Applications , 2000 .

[264]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[265]  Paul Newman,et al.  Made to measure: Bespoke landmarks for 24-hour, all-weather localisation with a camera , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[266]  Tomás Pajdla,et al.  Visual localization by linear combination of image descriptors , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[267]  Tom Duckett,et al.  Experimental Analysis of Sample-Based Maps for Long-Term SLAM , 2009, Int. J. Robotics Res..

[268]  Roland Siegwart,et al.  Some results on SLAM and the closing the loop problem , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[269]  Sebastian Thrun,et al.  Online simultaneous localization and mapping with detection and tracking of moving objects: theory and results from a ground vehicle in crowded urban areas , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[270]  Ren C. Luo,et al.  Multisensor fusion and integration: approaches, applications, and future research directions , 2002 .

[271]  Peter Mühlfellner,et al.  Evaluation of fisheye-camera based visual multi-session localization in a real-world scenario , 2013, 2013 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops).

[272]  Cyrill Stachniss,et al.  Simultaneous Localization and Mapping , 2016, Springer Handbook of Robotics, 2nd Ed..

[273]  Volker Willert,et al.  How to distinguish inliers from outliers in visual odometry for high-speed automotive applications , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[274]  Emanuele Menegatti,et al.  Image-based memory for robot navigation using properties of omnidirectional images , 2004, Robotics Auton. Syst..

[275]  Nathan Michael,et al.  Multi-robot pose graph localization and data association from unknown initial relative poses via expectation maximization , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[276]  Davide Scaramuzza,et al.  MAV urban localization from Google street view data , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[277]  Hans P. Moravec.  Sensor Fusion in Certainty Grids for Mobile Robots , 1988, AI Mag..

[278]  John J. Leonard,et al.  A Computationally Efficient Method for Large-Scale Concurrent Mapping and Localization , 2000 .

[279]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[280]  William Whittaker,et al.  A robust approach to high‐speed navigation for unrehearsed desert terrain , 2007 .