Towards Full Omnidirectional Depth Sensing Using Active Vision for Small Unmanned Aerial Vehicles

Collision avoidance for small unmanned aerial vehicles operating in a variety of environments is limited by the types of available depth sensors. Currently, there are no sensors that are lightweight, function outdoors in sunlight, and cover enough of a field of view to be useful in complex environments, although many sensors excel in one or two of these areas. We present a new depth estimation method, based on concepts from multi-view stereo and structured light methods, that uses only lightweight miniature cameras and a small laser dot matrix projector to produce measurements in the range of 1-12 meters. The field of view of the system is limited only by the number and type of cameras/projectors used, and can be fully Omni directional if desired. The sensitivity of the system to design and calibration parameters is tested in simulation, and results from a functional prototype are presented.

[1]  Jizhong Xiao,et al.  3 D Indoor Mapping for Micro-UAVs Using Hybrid Range Finders and Multi-Volume Occupancy Grids , 2010 .

[2]  Narendra Ahuja,et al.  Performance Analysis of Stereo, Vergence, and Focus as Depth Cues for Active Vision , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  P. Hanrahan,et al.  Digital light field photography , 2006 .

[4]  Albert S. Huang,et al.  Estimation, planning, and mapping for autonomous flight using an RGB-D camera in GPS-denied environments , 2012, Int. J. Robotics Res..

[5]  Srinivasa G. Narasimhan,et al.  A low-power structured light sensor for outdoor scene reconstruction and dominant material identification , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Horst Bischof,et al.  Dense reconstruction on-the-fly , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Adam Harmat,et al.  Parallel Tracking and Mapping with Multiple Cameras on an Unmanned Aerial Vehicle , 2012, ICIRA.

[8]  Joaquim Salvi,et al.  Pattern codification strategies in structured light systems , 2004, Pattern Recognit..

[9]  Larry H. Matthies,et al.  Fast optical hazard detection for planetary rovers using multiple spot laser triangulation , 1997, Proceedings of International Conference on Robotics and Automation.

[10]  F. Lerasle,et al.  Car cockpit 3D reconstruction by a structured light sensor , 2000, Proceedings of the IEEE Intelligent Vehicles Symposium 2000 (Cat. No.00TH8511).

[11]  Roland Siegwart,et al.  Intuitive 3D Maps for MAV Terrain Exploration and Obstacle Avoidance , 2011, J. Intell. Robotic Syst..

[12]  Steven Mills,et al.  Design and calibration of a hybrid computer vision and structured light 3D imaging system , 2011, The 5th International Conference on Automation, Robotics and Applications.

[13]  Reinhard Koch,et al.  Pose estimation and map building with a Time-Of-Flight-camera for robot navigation , 2008, Int. J. Intell. Syst. Technol. Appl..

[14]  David Fofi,et al.  A comparative survey on invisible structured light , 2004, IS&T/SPIE Electronic Imaging.

[15]  Davide Scaramuzza,et al.  Omnidirectional Vision: From Calibration to Root Motion Estimation , 2007 .

[16]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[17]  Hichem Sahli,et al.  Terrain Traversability Analysis for off-road robots using Time-Of-Flight 3D Sensing , 2013 .

[18]  Takeo Kanade,et al.  A Multiple-Baseline Stereo , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Radim Dvorak,et al.  Object Surface Reconstruction from One Camera System , 2009, FGIT.

[20]  Laurent Jacques,et al.  The PANOPTIC Camera: A Plenoptic Sensor with Real-Time Omnidirectional Capability , 2013, J. Signal Process. Syst..

[21]  Viktor Malyarchuk,et al.  Digital cameras with designs inspired by the arthropod eye , 2013, Nature.

[22]  Fulvio Scarano,et al.  Tomographic PIV: principles and practice , 2012 .

[23]  Roberto Manduchi,et al.  Active Triangulation in the Outdoors : A Photometric Analysis , 2010 .

[24]  C. Thorpe,et al.  Eye-safe laser line striper for outside use , 2002, Intelligent Vehicle Symposium, 2002. IEEE.

[25]  N. Pfeifer,et al.  Laser scanning – principles and applications , 2007 .

[26]  Radu Orghidan,et al.  Catadioptric single-shot rangefinder for textured map building in robot navigation , 2007 .

[27]  Reinhard Koch,et al.  Pose Estimation and Map Building with a PMD-Camera for Robot Navigation , 2007 .