Real-Time 3D Modeling with a RGB-D Camera and On-Board Processing

In this article we present a three dimensional modeling system that generates precise real-time mapping using a RGB-D camera. With the use of the light weight sensors Microsoft Kinect and small and powerful computers like the Intel Stick Core M3 Processor, our system can run all the computation and sensing required to smoothly run SLAM (Simultaneous Localization and Mapping) on-board and in real-time, removing the dependence on unreliable wireless communication. We use visual odometry, loop closure and graph optimization. Our approach is capable of generating accurate maps of several objects analyzing the data yielded by several tests of the system.

[1]  Kurt Konolige,et al.  FrameSLAM: From Bundle Adjustment to Real-Time Visual Mapping , 2008, IEEE Transactions on Robotics.

[2]  Wilbert G. Aguilar,et al.  3D Environment Mapping Using the Kinect V2 and Path Planning Based on RRT Algorithms , 2016 .

[3]  Cecilio Angulo Bahón,et al.  Control autónomo de cuadricópteros para seguimiento de trayectorias , 2014 .

[4]  Frank Dellaert,et al.  iSAM: Incremental Smoothing and Mapping , 2008, IEEE Transactions on Robotics.

[5]  John J. Leonard,et al.  Deformation-based loop closure for large scale dense RGB-D SLAM , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Stefano Soatto,et al.  Real-time 3D motion and structure of point features: a front-end system for vision-based control and interaction , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[7]  Daniel Cremers,et al.  Dense visual SLAM for RGB-D cameras , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Henrik I. Christensen,et al.  Closing the Loop With Graphical SLAM , 2007, IEEE Transactions on Robotics.

[9]  Steven Mills,et al.  Bag‐of‐words‐driven, single‐camera simultaneous localization and mapping , 2011, J. Field Robotics.

[10]  Wilbert G. Aguilar,et al.  Haptic-based navigation for the virtual bronchoscopy , 2011 .

[11]  Frank Dellaert,et al.  Square Root SAM , 2005, Robotics: Science and Systems.

[12]  Cecilio Angulo,et al.  Real-time video stabilization without phantom movements for micro aerial vehicles , 2014, EURASIP J. Image Video Process..

[13]  Patrick Rives,et al.  Real-time dense RGB-D localisation and mapping , 2011, IEEE International Conference on Robotics and Automation.

[14]  J. M. M. Montiel,et al.  ORB-SLAM: A Versatile and Accurate Monocular SLAM System , 2015, IEEE Transactions on Robotics.

[15]  F. Michaud,et al.  Appearance-Based Loop Closure Detection for Online Large-Scale and Long-Term Operation , 2013, IEEE Transactions on Robotics.

[16]  Ian D. Reid,et al.  Mapping Large Loops with a Single Hand-Held Camera , 2007, Robotics: Science and Systems.

[17]  Wolfram Burgard,et al.  Real-time 3D visual SLAM with a hand-held camera , 2011 .

[18]  François Michaud,et al.  Online global loop closure detection for large-scale multi-session graph-based SLAM , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  John J. Leonard,et al.  RSS 2012 Workshop on Long-term Operation of Autonomous Robotic Systems in Changing Environments , 2012 .

[20]  Richard Szeliski,et al.  Reconstructing building interiors from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[21]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[22]  MillsSteven,et al.  Bag-of-words-driven, single-camera simultaneous localization and mapping , 2011 .

[23]  AnguloCecilio,et al.  Real-Time Model-Based Video Stabilization for Microaerial Vehicles , 2016 .

[24]  Marc Pollefeys,et al.  Vision-based autonomous mapping and exploration using a quadrotor MAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[26]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[27]  Roland Siegwart,et al.  Monocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments , 2011, J. Field Robotics.

[28]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[29]  Cecilio Angulo Bahón,et al.  Estabilización Robusta de Vídeo basada en Diferencia de Nivel de Gris , 2013 .

[30]  Wolfram Burgard,et al.  A real-time algorithm for mobile robot mapping with applications to multi-robot and 3D mapping , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[31]  Daniel Cremers,et al.  Real-Time Dense Geometry from a Handheld Camera , 2010, DAGM-Symposium.

[32]  Hauke Strasdat,et al.  Scale Drift-Aware Large Scale Monocular SLAM , 2010, Robotics: Science and Systems.

[33]  Joachim Hertzberg,et al.  Three-dimensional mapping with time-of-flight cameras , 2009 .

[34]  Wilbert Geovanny Aguilar Castillo,et al.  Obstacle Avoidance Based-Visual Navigation for Micro Aerial Vehicles , 2017 .

[35]  Cecilio Angulo,et al.  Robust video stabilization based on motion intention for low-cost micro aerial vehicles , 2014, 2014 IEEE 11th International Multi-Conference on Systems, Signals & Devices (SSD14).

[36]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[37]  Wolfram Burgard,et al.  Efficient estimation of accurate maximum likelihood maps in 3D , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[38]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[39]  Vincent Lepetit,et al.  View-based Maps , 2010, Int. J. Robotics Res..

[40]  Cecilio Angulo,et al.  Real-Time Model-Based Video Stabilization for Microaerial Vehicles , 2015, Neural Processing Letters.