Flight autonomy of micro-drone in indoor environments using LiDAR flash camera

Autonomy starts with awareness of the environment. Robots are given autonomy using sensors that endow them with perceptual capabilities, such as cameras . Recently, a new type of camera working under the Time-of-Flight principle has been developed, capable of acquiring dense depth maps at high frame rates. Its small size and weight make it suitable for its use on-board a flying vehicle for indoor localization and mapping . This document outlines the first approaches taken in the use of a ToF camera for such tasks constrained by real-time requirements. The camera has been mounted on a flying vehicle that uses the open source Paparazzi autopilot system developed by the ENAC ( Ecole National de l'Aviation Civile ) french team. Since indoor environments are predominantly planar, planar patches have been favoured to model the environment and detect motion of the UAV. A Region Growing segmentation algorithm identifies and extracts planes from the scene in real-time. Planes are tracked and registered across a sequence of frames to estimate the camera's ego-motion . Initial results of plane-based visual odometry are presented and confirm the device suitability.

[1]  Peerayut Khongsab.  Signal processing and performance evaluation of a PMD camera for space docking , 2009 .

[2]  Andreas Nüchter,et al.  Robust 3D-mapping with time-of-flight cameras , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Roland Siegwart,et al.  Probabilistic plane fitting in 3D and an application to robotic mapping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[4]  M. W. Kadous,et al.  On building 3D maps using a Range Camera: Applications to Rescue Robotics , 2006 .

[5]  Ronald L. Graham,et al.  An Efficient Algorithm for Determining the Convex Hull of a Finite Planar Set , 1972, Inf. Process. Lett..

[6]  Gerd Hirzinger,et al.  Extrinsic and depth calibration of ToF-cameras , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  R. Lange,et al.  Solid-state time-of-flight range camera , 2001 .

[8]  Andreas Birk,et al.  Fast plane detection and polygonalization in noisy 3D range images , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Andreas Birk,et al.  A Novel Approach to Efficient Error Correction for the SwissRanger Time-of-Flight 3D Camera , 2009, RoboCup.

[10]  Sven Behnke,et al.  Robust Ego-Motion Estimation with ToF Cameras , 2009, ECMR.

[11]  Stefan May,et al.  Calibration and Registration for Precise Surface Reconstruction with TOF Cameras , 2007 .

[12]  Roland Siegwart,et al.  A Fast and Robust 3D Feature Extraction Algorithm for Structured Environment Reconstruction , 2003 .

[13]  Scott Robbins,et al.  Photogrammetric calibration and colorization of the SwissRanger SR-3100 3-D range imaging sensor , 2009 .

[14]  Robert Lange,et al.  3D time-of-flight distance measurement with custom solid-state image sensors in CMOS/CCD-technology , 2006 .

[15]  D. Holz,et al.  3 D Pose Estimation and Mapping with Time-of-Flight Cameras , 2008 .

[16]  Heinz Hügli,et al.  Real-time scattering compensation for time-of-flight camera , 2007, ICVS 2007.

[17]  Stefan May,et al.  3D time-of-flight cameras for mobile robotics , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Andreas Kolb,et al.  Lateral and Depth Calibration of PMD-Distance Sensors , 2006, ISVC.

[19]  Roland Siegwart,et al.  A state-of-the-art 3D sensor for robot navigation , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[20]  Kazunori Ohno,et al.  Real-Time Robot Trajectory Estimation and 3D Map Construction using 3D Camera , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Andreas Birk,et al.  A Characterization of 3D Sensors for Response Robots , 2009, RoboCup.

[22]  Timo Kahlmann,et al.  CALIBRATION FOR INCREASED ACCURACY OF THE RANGE IMAGING CAMERA SWISSRANGER , 2006 .

[23]  Andreas Birk,et al.  Fast 3D mapping by matching planes extracted from range sensor point-clouds , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  A. Birk,et al.  Fast Detection of Polygons in 3D Point Clouds from Noise-Prone Range Sensors , 2007, 2007 IEEE International Workshop on Safety, Security and Rescue Robotics.

[25]  Jan Weingarten,et al.  Feature-based 3D SLAM , 2006 .

[26]  Heinz Hügli,et al.  Optimized scattering compensation for time-of-flight camera , 2007, SPIE Optics East.

[27]  Andreas Birk,et al.  Fast Registration Based on Noisy Planes With Unknown Correspondences for 3-D Mapping , 2010, IEEE Transactions on Robotics.