Estimation of scale and slope information for structure from motion-based 3D map

Dealing with natural disasters, such as debris flow, typically involves teleoperation of an unmanned robot. Three-dimensional (3D) map information of an environment is especially useful for teleoperating the unmanned robot system to perform unmanned construction and auto-investigation. Recently, structure from motion (SfM) using an unmanned aerial vehicle (UAV) equipped with monocular cameras has been proposed as a general method to build 3D map information. However, absolute slope and scale information for the built 3D map cannot be obtained when applying general SfM technology without the deployment of ground control points (GCPs). Therefore, we propose a method that can recover absolute slope and scale information for a 3D map. To this end, we apply sensor fusion technology that combines inertial measurement unit (IMU) data from an unmanned ground vehicle (UGV) and image data from the camera mounted on a UAV. Experimental results show that our estimation scheme is able to successfully represent the slope and scale information along with the 3D map.

[1]  J. M. M. Montiel,et al.  The SPmap: a probabilistic framework for simultaneous localization and map building , 1999, IEEE Trans. Robotics Autom..

[2]  Richard Szeliski,et al.  Reconstructing building interiors from images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[3]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[4]  Kazuya Yoshida,et al.  Collaborative mapping of an earthquake‐damaged building via ground and aerial robots , 2012, J. Field Robotics.

[5]  Jiwon Seo,et al.  Multi-UAV-based stereo vision system without GPS for ground obstacle mapping to assist path planning of UGV , 2014 .

[6]  Wenyi Zhao,et al.  Alignment of Continuous Video onto 3D Point Clouds , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  David Nister,et al.  Alignment of continuous video onto 3D point clouds , 2004, CVPR 2004.

[8]  Sebastian Thrun,et al.  FastSLAM: a factored solution to the simultaneous localization and mapping problem , 2002, AAAI/IAAI.

[9]  Marco Dubbini,et al.  Using Unmanned Aerial Vehicles (UAV) for High-Resolution Reconstruction of Topography: The Structure from Motion Approach on Coastal Environments , 2013, Remote. Sens..

[10]  P. B. Sujit,et al.  Route Planning for Angle Constrained Terrain Mapping Using an Unmanned Aerial Vehicle , 2013, J. Intell. Robotic Syst..

[11]  Arko Lucieer,et al.  An Automated Technique for Generating Georectified Mosaics from Ultra-High Resolution Unmanned Aerial Vehicle (UAV) Imagery, Based on Structure from Motion (SfM) Point Clouds , 2012, Remote. Sens..

[12]  Horst Bischof,et al.  Automatic alignment of 3D reconstructions using a Digital Surface Model , 2011, CVPR 2011 WORKSHOPS.