Visual SLAM with a RGB-D Camera on a Quadrotor UAV Using on-Board Processing

In this article, we present a high accuracy system for real-time localization and mapping using a RGB-D camera. With the use the RGB-D sensor Microsoft Kinect and the small and powerful computer Intel Stick Core M3 Processor, our system can run the computation and sensing required for SLAM on-board the UAV, removing the dependence on unreliable wireless communication. We use visual odometry, loop closure and graph optimization to achieve this purpose. Our approach is able to perform accurate and efficient on-board SLAM by analyzing data and maps generated on several tests of the system.

[1]  Wilbert Geovanny Aguilar Castillo,et al.  Obstacle Avoidance Based-Visual Navigation for Micro Aerial Vehicles , 2017 .

[2]  Stefan Kohlbrecher,et al.  A flexible and scalable SLAM system with full 3D motion estimation , 2011, 2011 IEEE International Symposium on Safety, Security, and Rescue Robotics.

[3]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[4]  Albert S. Huang,et al.  Visual Odometry and Mapping for Autonomous Flight Using an RGB-D Camera , 2011, ISRR.

[5]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[6]  Vincent Lepetit,et al.  View-based Maps , 2010, Int. J. Robotics Res..

[7]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[8]  Kurt Konolige,et al.  Large-Scale Visual Odometry for Rough Terrain , 2007, ISRR.

[9]  Marc Pollefeys,et al.  Vision-based autonomous mapping and exploration using a quadrotor MAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Cecilio Angulo,et al.  Real-Time Model-Based Video Stabilization for Microaerial Vehicles , 2015, Neural Processing Letters.

[11]  Juan D. Tardós,et al.  Visual-Inertial Monocular SLAM With Map Reuse , 2016, IEEE Robotics and Automation Letters.

[12]  Cecilio Angulo,et al.  Real-time video stabilization without phantom movements for micro aerial vehicles , 2014, EURASIP J. Image Video Process..

[13]  Cecilio Angulo Bahón,et al.  Control autónomo de cuadricópteros para seguimiento de trayectorias , 2014 .

[14]  Patrick Rives,et al.  Real-time dense RGB-D localisation and mapping , 2011, IEEE International Conference on Robotics and Automation.

[15]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[16]  Cecilio Angulo,et al.  Robust video stabilization based on motion intention for low-cost micro aerial vehicles , 2014, 2014 IEEE 11th International Multi-Conference on Systems, Signals & Devices (SSD14).

[17]  Daniel Cremers,et al.  LSD-SLAM: Large-Scale Direct Monocular SLAM , 2014, ECCV.

[18]  John J. Leonard,et al.  Deformation-based loop closure for large scale dense RGB-D SLAM , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Stefano Soatto,et al.  Real-time 3D motion and structure of point features: a front-end system for vision-based control and interaction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[20]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[21]  Daniel Cremers,et al.  Dense visual SLAM for RGB-D cameras , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Henrik I. Christensen,et al.  Closing the Loop With Graphical SLAM , 2007, IEEE Transactions on Robotics.

[23]  Wilbert G. Aguilar,et al.  3D Environment Mapping Using the Kinect V2 and Path Planning Based on RRT Algorithms , 2016 .

[24]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  Marc Pollefeys,et al.  Autonomous obstacle avoidance and maneuvering on a vision-guided MAV using on-board processing , 2011, 2011 IEEE International Conference on Robotics and Automation.

[26]  Wolfram Burgard,et al.  Efficient estimation of accurate maximum likelihood maps in 3D , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Frank Dellaert,et al.  Square Root SAM , 2005, Robotics: Science and Systems.

[28]  François Michaud,et al.  Online global loop closure detection for large-scale multi-session graph-based SLAM , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  John J. Leonard,et al.  RSS 2012 Workshop on Long-term Operation of Autonomous Robotic Systems in Changing Environments , 2012 .

[30]  James R. Bergen,et al.  Visual odometry , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[31]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[32]  Roland Siegwart,et al.  Monocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments , 2011, J. Field Robotics.

[33]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[34]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[35]  Hauke Strasdat,et al.  Scale Drift-Aware Large Scale Monocular SLAM , 2010, Robotics: Science and Systems.

[36]  Daniel Cremers,et al.  Real-Time Dense Geometry from a Handheld Camera , 2010, DAGM-Symposium.

[37]  Steven Mills,et al.  Bag‐of‐words‐driven, single‐camera simultaneous localization and mapping , 2011, J. Field Robotics.

[38]  Wilbert G. Aguilar,et al.  Haptic-based navigation for the virtual bronchoscopy , 2011 .

[39]  F. Michaud,et al.  Appearance-Based Loop Closure Detection for Online Large-Scale and Long-Term Operation , 2013, IEEE Transactions on Robotics.

[40]  Wolfram Burgard,et al.  Real-time 3D visual SLAM with a hand-held camera , 2011 .