Landmark based localization in urban environment

Abstract A landmark based localization with uncertainty analysis based on cameras and geo-referenced landmarks is presented in this paper. The system is developed to adapt different camera configurations for six degree-of-freedom pose estimation. Local bundle adjustment is applied for optimization and the geo-referenced landmarks are integrated to reduce the drift. In particular, the uncertainty analysis is taken into account. On the one hand, we estimate the uncertainties of poses to predict the precision of localization. On the other hand, uncertainty propagation is considered for matching, tracking and landmark registering. The proposed method is evaluated on both KITTI benchmark and the data acquired by a mobile mapping system. In our experiments, decimeter level accuracy can be reached.

[1]  David W. Murray,et al.  Parallel Tracking and Mapping on a camera phone , 2009, 2009 8th IEEE International Symposium on Mixed and Augmented Reality.

[2]  Javier Civera,et al.  Stereo parallel tracking and mapping for robot localization , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[3]  Wolfgang Hübner,et al.  Monocular Camera Trajectory Optimization using LiDAR data , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[4]  Andreas Geiger,et al.  Are we ready for autonomous driving? The KITTI vision benchmark suite , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Bahman Soheilian,et al.  3D road marking reconstruction from street-level calibrated stereo pairs , 2010 .

[6]  Kurt Konolige,et al.  Real-time Localization in Outdoor Environments using Stereo Vision and Inexpensive GPS , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[7]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[8]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[9]  Maxime Lhuillier,et al.  Error propagations for local bundle adjustment , 2009, CVPR.

[10]  Bruno Vallet,et al.  Detection and 3D reconstruction of traffic signs from multiple view color images , 2013 .

[11]  Xiaozhi Qu,et al.  Vehicle localization using mono-camera and geo-referenced traffic signs , 2015, 2015 IEEE Intelligent Vehicles Symposium (IV).

[12]  Shunping Ji,et al.  A GENERIC PROBABILISTIC MODEL AND A HIERARCHICAL SOLUTION FOR SENSOR LOCALIZATION IN NOISY AND RESTRICTED CONDITIONS , 2016 .

[13]  Michael Bosse,et al.  Keyframe-based visual–inertial odometry using nonlinear optimization , 2015, Int. J. Robotics Res..

[14]  Maxime Lhuillier.  Incremental Fusion of Structure-from-Motion and GPS Using Constrained Bundle Adjustments , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  N. David,et al.  Stereopolis II: A multi-purpose and multi-sensor 3D mobile mapping system for street visualisation and 3D metrology , 2014 .

[16]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.

[17]  Cindy Cappelle,et al.  GPS and Stereovision-Based Visual Odometry: Application to Urban Scene Mapping and IntelligentVehicle Localization , 2011 .

[18]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[19]  Juan D. Tardós,et al.  ORB-SLAM2: An Open-Source SLAM System for Monocular, Stereo, and RGB-D Cameras , 2016, IEEE Transactions on Robotics.

[20]  Jörg Stückler,et al.  Large-scale direct SLAM with stereo cameras , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Éric Marchand,et al.  Direct model based visual tracking and pose estimation using mutual information , 2014, Image Vis. Comput..

[22]  Andrew J. Davison,et al.  Real-time simultaneous localisation and mapping with a single camera , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[23]  Vincent Lepetit,et al.  Global 6DOF Pose Estimation from Untextured 2D City Models , 2015, ArXiv.

[24]  Bahman Soheilian,et al.  Towards a sub-decimetric georeferencing of ground-based mobile mapping systems in urban areas : Matching ground-based and aerial-based imagery using roadmarks , 2007 .

[25]  Dorian Gálvez-López,et al.  Bags of Binary Words for Fast Place Recognition in Image Sequences , 2012, IEEE Transactions on Robotics.

[26]  Ignacio Parra,et al.  Accurate Global Localization Using Visual Odometry and Digital Maps on Urban Environments , 2012, IEEE Transactions on Intelligent Transportation Systems.

[27]  Ivan Petrovic,et al.  Stereo odometry based on careful feature selection and tracking , 2015, 2015 European Conference on Mobile Robots (ECMR).

[28]  Alper Yilmaz,et al.  GPS-DENIED GEO-LOCALISATION USING VISUAL ODOMETRY , 2016 .

[29]  Markus Schreiber,et al.  LaneLoc: Lane marking based localization using highly accurate maps , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[30]  Marc Luxen.  Variance Component Estimation in Performance Characteristics Applied to Feature Extraction Procedures , 2003, DAGM-Symposium.

[31]  Roland Siegwart,et al.  A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation , 2011, CVPR 2011.

[32]  Xiaozhi Qu,et al.  Landmark based localization: LBA refinement using MCMC-optimized projections of RJMCMC-extracted road marks , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[33]  Michel Dhome,et al.  Monocular Vision for Mobile Robot Localization and Autonomous Navigation , 2007, International Journal of Computer Vision.

[34]  Oliver Pink,et al.  Visual map matching and localization using a global feature map , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[35]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[36]  Long Quan,et al.  Linear N-Point Camera Pose Determination , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Bahman Soheilian,et al.  Augmenting Vehicle Localization Accuracy with Cameras and 3D Road Infrastructure Database , 2014, ECCV Workshops.

[38]  Paul Timothy Furgale,et al.  Stereo mapping and localization for long-range path following on rough terrain , 2010, 2010 IEEE International Conference on Robotics and Automation.

[39]  Davide Scaramuzza,et al.  Benefit of large field-of-view cameras for visual odometry , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[40]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[41]  Michel Dhome,et al.  Real Time Localization and 3D Reconstruction , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[42]  Volker Willert,et al.  Flow-decoupled normalized reprojection error for visual odometry , 2016, 2016 IEEE 19th International Conference on Intelligent Transportation Systems (ITSC).

[43]  Bahman Soheilian,et al.  Road Marking Extraction Using a MODEL&DATA-DRIVEN Rj-Mcmc , 2015 .

[44]  Michel Dhome,et al.  Towards geographical referencing of monocular SLAM reconstruction using 3D city models: Application to real-time accurate vision-based localization , 2009, CVPR.

[45]  Andreas Geiger,et al.  Lost! Leveraging the Crowd for Probabilistic Visual Self-Localization , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.