Environment mapping & interpretation by drone

In this paper we present the processing chain for geometric and semantic mapping of a drone environment that we developed for search-and-rescue purposes. A precise 3D modelling of the environment is computed using video and (if available) Lidar data captured during the drone flight. Then semantic mapping is performed by interactive learning on the model, thus allowing generic object detection. Finally, tracking of moving objects are performed in the video stream and localized in the 3D model, thus giving a global view of the situation. We assess our system on real data captured on various test locations.

[1]  Bertrand Le Saux,et al.  Rapid semantic mapping: Learn environment classifiers on the fly , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Bertrand Le Saux Interactive Design of Object Classifiers in Remote Sensing , 2014, 2014 22nd International Conference on Pattern Recognition.

[3]  Aurélien Plyer,et al.  Massively parallel Lucas Kanade optical flow for real-time video processing applications , 2014, Journal of Real-Time Image Processing.

[4]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[5]  Guy Le Besnerais,et al.  eVO: A realtime embedded stereo odometry for MAV applications , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[7]  Manolis I. A. Lourakis,et al.  SBA: A software package for generic sparse bundle adjustment , 2009, TOMS.

[8]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Marc Pollefeys,et al.  Vision-based autonomous mapping and exploration using a quadrotor MAV , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Joachim Hertzberg,et al.  Towards semantic maps for mobile robots , 2008, Robotics Auton. Syst..

[11]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Aurélien Plyer,et al.  Real-time mobile object detection using stereo , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).