An evaluation of stereo and laser-based range sensing for rotorcraft unmanned aerial vehicle obstacle avoidance

We present an evaluation of stereo vision and laser-based range sensing for rotorcraft unmanned aerial vehicle (RUAV) obstacle avoidance. Our focus is on sensors that are suitable for mini-RUAV class vehicles in terms of weight and power consumption. The study is limited to the avoidance of large static obstacles such as trees. We compare two commercially available devices that are representative of the state of the art in two-dimensional scanning laser and stereo-based sensing. Stereo is evaluated with three different focal length lenses to assess the tradeoff between range resolution and field of view (FOV). The devices are evaluated in the context of obstacle avoidance through extensive flight trials with an RUAV. We discuss the merits and limitations of each sensor type, including sensing range, FOV, accuracy, and susceptibility to lighting conditions. We show that the stereo device fitted with 8-mm lenses has a better sensing range and vertical FOV than the laser device; however, it relies on careful calibration and is affected by high-contrast outdoor lighting conditions. The laser has a wider horizontal FOV and is more reliable at detecting obstacles that are within a 20-m range. Overall the laser produced superior obstacle avoidance performance, with a success rate of 84% compared to 42% for 8-mm stereo. © 2012 Wiley Periodicals, Inc. © 2012 Wiley Periodicals, Inc.

[1]  Larry H. Matthies,et al.  Error modeling in stereo navigation , 1986, IEEE J. Robotics Autom..

[2]  Franz Andert,et al.  Online world modeling and path planning for an unmanned helicopter , 2009, Auton. Robots.

[3]  Dirk Haehnel,et al.  Junior: The Stanford entry in the Urban Challenge , 2008 .

[4]  Gaurav S. Sukhatme,et al.  Vision‐based navigation through urban canyons , 2009, J. Field Robotics.

[5]  Peter I. Corke,et al.  High dynamic range stereo vision for outdoor mobile robotics , 2009, 2009 IEEE International Conference on Robotics and Automation.

[6]  Stefan Hrabar,et al.  Reactive obstacle avoidance for Rotorcraft UAVs , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Nicholas Roy,et al.  Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments , 2009, Defense + Commercial Sensing.

[8]  Takeo Kanade,et al.  Integrating LIDAR into Stereo for Fast and Improved Disparity Computation , 2011, 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission.

[9]  Peter I. Corke,et al.  Low-cost flight control system for a small autonomous helicopter , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[10]  G. Gerhart,et al.  Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments , 2009 .

[11]  Roland Siegwart,et al.  MAV navigation through indoor corridors using optical flow , 2010, 2010 IEEE International Conference on Robotics and Automation.

[12]  Sebastian Scherer,et al.  Flying Fast and Low Among Obstacles: Methodology and Experiments , 2008, Int. J. Robotics Res..

[13]  Wai Ho Li,et al.  Image processing to automate condition assessment of overhead line components , 2010, 2010 1st International Conference on Applied Robotics for the Power Industry.

[14]  Pavan Sikka,et al.  DDX : A distributed software architecture for robotic systems , 2004 .

[15]  Jeffrey Byrne,et al.  Flight Testing of a Fault-Tolerant Control and Vision-based Obstacle Avoidance System for UAVs , 2005 .

[16]  Sebastian Scherer,et al.  Flying Fast and Low Among Obstacles , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[17]  S. Sastry,et al.  Autonomous Exploration in Unknown Urban Environments for Unmanned Aerial Vehicles , 2005 .

[18]  Dario Floreano,et al.  Toward 30-gram Autonomous Indoor Aircraft: Vision-based Obstacle Avoidance and Altitude Control , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[19]  Pascal Fua,et al.  A parallel stereo algorithm that produces dense depth maps and preserves image features , 1993, Machine Vision and Applications.

[20]  R. Walker,et al.  The Smart Skies project , 2011, IEEE Aerospace and Electronic Systems Magazine.

[21]  Luke Fletcher,et al.  A perception-driven autonomous urban vehicle , 2008 .

[22]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[23]  Sebastian Thrun,et al.  Junior: The Stanford entry in the Urban Challenge , 2008, J. Field Robotics.

[24]  Wolfram Burgard,et al.  Towards a navigation system for autonomous indoor flying , 2009, 2009 IEEE International Conference on Robotics and Automation.

[25]  Stefano Ghidoni,et al.  TerraMax Vision at the Urban Challenge 2007 , 2010, IEEE Transactions on Intelligent Transportation Systems.

[26]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[27]  Dominique Gruyer,et al.  Cooperative Fusion for Multi-Obstacles Detection With Use of Stereovision and Laser Scanner , 2005, Auton. Robots.

[28]  Carlo Tomasi,et al.  Depth Discontinuities by Pixel-to-Pixel Stereo , 1999, International Journal of Computer Vision.

[29]  Marc Pollefeys,et al.  Autonomous obstacle avoidance and maneuvering on a vision-guided MAV using on-board processing , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Farid Kendoul,et al.  Beyond visual range obstacle avoidance and infrastructure inspection by an autonomous helicopter , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Robert C. Bolles,et al.  Outdoor Mapping and Navigation Using Stereo Vision , 2006, ISER.

[32]  Dale D. Rowley,et al.  Real-time Evaluation of Vision-based Navigation for Autonomous Landing of a Rotorcraft Unmanned Aerial Vehicle in a Non-cooperative Environment , 2005 .

[33]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.

[34]  Michael J. Turmon,et al.  Autonomous off-road navigation with end-to-end learning for the LAGR program , 2009 .

[35]  nbsp,et al.  Field-Testing of a Helicopter UAV Obstacle Field Navigation and Landing System , 2009 .

[36]  Andres Huertas,et al.  Stereo-vision-based terrain mapping for off-road autonomous navigation , 2009, Defense + Commercial Sensing.

[37]  Sebastian Scherer,et al.  Efficient C-space and cost function updates in 3D for unmanned aerial vehicles , 2009, 2009 IEEE International Conference on Robotics and Automation.

[38]  Larry H. Matthies,et al.  Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[39]  Carlo Tomasi,et al.  Depth Discontinuities by Pixel-to-Pixel Stereo , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[40]  Luke Fletcher,et al.  A perception‐driven autonomous urban vehicle , 2008, J. Field Robotics.

[41]  Franz Andert,et al.  Mapping and path planning in complex environments: An obstacle avoidance approach for an unmanned helicopter , 2011, 2011 IEEE International Conference on Robotics and Automation.

[42]  Andres Huertas,et al.  Stereo-vision-based perception capabilities developed during the Robotics Collaborative Technology Alliances program , 2010, Defense + Commercial Sensing.

[43]  Pascual Campoy Cervera,et al.  A Stereoscopic Vision System Guiding an Autonomous Helicopter for Overhead Power Cable Inspection , 2001, RobVis.

[44]  Bir Bhanu,et al.  A system for obstacle detection during rotorcraft low altitude flight , 1996 .