On-Board Visual SLAM on a UGV Using a RGB-D Camera

We present a approach to real-time localization and mapping using a RGB-D camera, such as Microsoft Kinect, and a small and powerful computer Intel Stick Core M3 Processor. Our system can run the computation and sensing required for SLAM on-board the UGV, removing the dependence on unreliable wireless communication. We make use of visual odometry, loop closure and graph optimization to achieve this purpose. Our approach is able to perform accurate and efficient on-board SLAM, and we evaluate its performance thoroughly with varying environments and illumination conditions. The experiments demonstrate that our system can robustly deal with difficult data in indoor and outdoor scenarios.

[1]  Hauke Strasdat,et al.  Scale Drift-Aware Large Scale Monocular SLAM , 2010, Robotics: Science and Systems.

[2]  Cecilio Angulo,et al.  Pedestrian Detection for UAVs Using Cascade Classifiers and Saliency Maps , 2017, IWANN.

[3]  John J. Leonard,et al.  Temporally scalable visual SLAM using a reduced pose graph , 2013, 2013 IEEE International Conference on Robotics and Automation.

[4]  Wilbert G. Aguilar,et al.  3D Environment Mapping Using the Kinect V2 and Path Planning Based on RRT Algorithms , 2016 .

[5]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[6]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[7]  Wilbert G. Aguilar,et al.  Obstacle Avoidance for Low-Cost UAVs , 2017, 2017 IEEE 11th International Conference on Semantic Computing (ICSC).

[8]  Wilbert G. Aguilar,et al.  RRT* GL Based Optimal Path Planning for Real-Time Navigation of UAVs , 2017, IWANN.

[9]  Roland Siegwart,et al.  Monocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments , 2011, J. Field Robotics.

[10]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[11]  John J. Leonard,et al.  Deformation-based loop closure for large scale dense RGB-D SLAM , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Wilbert G. Aguilar,et al.  Haptic-based navigation for the virtual bronchoscopy , 2011 .

[13]  Stefano Soatto,et al.  Real-time 3D motion and structure of point features: a front-end system for vision-based control and interaction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Wilbert G. Aguilar,et al.  Obstacle Avoidance for Flight Safety on Unmanned Aerial Vehicles , 2017, IWANN.

[15]  F. Michaud,et al.  Appearance-Based Loop Closure Detection for Online Large-Scale and Long-Term Operation , 2013, IEEE Transactions on Robotics.

[16]  Marc Pollefeys,et al.  Vision-based autonomous mapping and exploration using a quadrotor MAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Cecilio Angulo,et al.  Real-Time Model-Based Video Stabilization for Microaerial Vehicles , 2015, Neural Processing Letters.

[18]  Wilbert Geovanny Aguilar Castillo,et al.  Obstacle Avoidance Based-Visual Navigation for Micro Aerial Vehicles , 2017 .

[19]  Albert S. Huang,et al.  Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera , 2011, ISRR.

[20]  Wilbert G. Aguilar,et al.  Pedestrian Detection for UAVs Using Cascade Classifiers with Meanshift , 2017, 2017 IEEE 11th International Conference on Semantic Computing (ICSC).

[21]  Andrew I. Comport,et al.  Real-time dense appearance-based SLAM for RGB-D sensors , 2011 .

[22]  Wolfram Burgard,et al.  Real-time 3D visual SLAM with a hand-held camera , 2011 .

[23]  Daniel Cremers,et al.  Real-Time Dense Geometry from a Handheld Camera , 2010, DAGM-Symposium.

[24]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[25]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[26]  Kurt Konolige,et al.  Large-Scale Visual Odometry for Rough Terrain , 2007, ISRR.

[27]  Cecilio Angulo,et al.  Robust video stabilization based on motion intention for low-cost micro aerial vehicles , 2014, 2014 IEEE 11th International Multi-Conference on Systems, Signals & Devices (SSD14).

[28]  Juan D. Tardós,et al.  Visual-Inertial Monocular SLAM With Map Reuse , 2016, IEEE Robotics and Automation Letters.

[29]  François Michaud,et al.  Online global loop closure detection for large-scale multi-session graph-based SLAM , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[31]  John J. Leonard,et al.  RSS 2012 Workshop on Long-term Operation of Autonomous Robotic Systems in Changing Environments , 2012 .

[32]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[33]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[34]  Wolfram Burgard,et al.  Efficient estimation of accurate maximum likelihood maps in 3D , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  W. Burgard,et al.  Real-time 3 D visual SLAM with a hand-held RGB-D camera , 2011 .

[36]  Steven Mills,et al.  Bag‐of‐words‐driven, single‐camera simultaneous localization and mapping , 2011, J. Field Robotics.

[37]  Daniel Cremers,et al.  Dense visual SLAM for RGB-D cameras , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  Henrik I. Christensen,et al.  Closing the Loop With Graphical SLAM , 2007, IEEE Transactions on Robotics.

[39]  Frank Dellaert,et al.  Square Root SAM , 2005, Robotics: Science and Systems.

[40]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[41]  Vincent Lepetit,et al.  View-based Maps , 2010, Int. J. Robotics Res..

[42]  Cecilio Angulo,et al.  Real-time video stabilization without phantom movements for micro aerial vehicles , 2014, EURASIP J. Image Video Process..

[43]  Patrick Rives,et al.  Real-time dense RGB-D localisation and mapping , 2011, IEEE International Conference on Robotics and Automation.

[44]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[45]  Stefan Kohlbrecher,et al.  A flexible and scalable SLAM system with full 3D motion estimation , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[46]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.