Free LSD: Prior-Free Visual Landing Site Detection for Autonomous Planes

Full autonomy for fixed-wing unmanned aerial vehicles (UAVs) requires the capability to autonomously detect potential landing sites in unknown and unstructured terrain, allowing for self-governed mission completion or handling of emergency situations. In this letter, we propose a perception system addressing this challenge by detecting landing sites based on their texture and geometric shape without using any prior knowledge about the environment. The proposed method considers hazards within the landing region such as terrain roughness and slope, surrounding obstacles that obscure the landing approach path, and the local wind field that is estimated by the on-board EKF. The latter enables applicability of the proposed method on small-scale autonomous planes without landing gear. A safe approach path is computed based on the UAV dynamics, expected state estimation and actuator uncertainty, and the on-board computed elevation map. The proposed framework has been successfully tested on photo-realistic synthetic datasets and in challenging real-world environments.

[1]  Konstantin Kondak,et al.  Vision aided automatic landing system for fixed wing UAV , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Michael Knight,et al.  A Biologically Inspired, Vision‐based Guidance System for Automatic Landing of a Fixed‐wing Aircraft , 2014, J. Field Robotics.

[3]  G. Toussaint Solving geometric problems with the rotating calipers , 1983 .

[4]  Andrew E. Johnson,et al.  Lidar-Based Hazard Avoidance for Safe Landing on Mars , 2002 .

[5]  Emanuele Trucco,et al.  A compact algorithm for rectification of stereo pairs , 2000, Machine Vision and Applications.

[6]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[7]  Roland Brockers,et al.  Autonomous landing and ingress of micro-air-vehicles in urban environments based on monocular vision , 2011, Defense + Commercial Sensing.

[8]  Roland Siegwart,et al.  Unified temporal and spatial calibration for multi-sensor systems , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Roland Siegwart,et al.  Robotic technologies for solar‐powered UAVs: Fully autonomous updraft‐aware aerial sensing for multiday search‐and‐rescue missions , 2018, J. Field Robotics.

[10]  David Hyunchul Shim,et al.  A Vision-Based Automatic Landing Method for Fixed-Wing UAVs , 2010, J. Intell. Robotic Syst..

[11]  Simon Lacroix,et al.  Autonomous Detection of Safe Landing Areas for an UAV from Monocular Images , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Yang Cheng,et al.  Real-time surface slope estimation by homography alignment for spacecraft safe landing , 2010, 2010 IEEE International Conference on Robotics and Automation.

[13]  Timothy W. McLain,et al.  Autonomous Landing of Miniature Aerial Vehicles , 2005, J. Aerosp. Comput. Inf. Commun..

[14]  Prashant Parikh A Theory of Communication , 2010 .

[15]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[16]  Gaurav S. Sukhatme,et al.  Towards vision-based safe landing for an autonomous helicopter , 2002, Robotics Auton. Syst..

[17]  D. Fitzgerald,et al.  A Vision Based Forced Landing Site Selection System for an Autonomous UAV , 2005, 2005 International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[18]  Matti Pietikäinen,et al.  Color Texture Classification with Color Histograms and Local Binary Patterns , 2002 .

[19]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[20]  Daniel P. Huttenlocher,et al.  Distance Transforms of Sampled Functions , 2012, Theory Comput..

[21]  Luis Mejías Alvarez,et al.  Enabling Aircraft Emergency Landings Using Active Visual Site Detection , 2013, FSR.

[22]  Roland Siegwart,et al.  Robust map generation for fixed-wing UAVs with low-cost highly-oblique monocular cameras , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[23]  Kevin Weiler An Incremental Angle Point in Polygon Test , 1994, Graphics Gems.

[24]  Flavio Fontana,et al.  Continuous on-board monocular-vision-based elevation mapping applied to autonomous landing of micro aerial vehicles , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[25]  M. Hutter,et al.  A Universal Grid Map Library: Implementation and Use Case for Rough Terrain Navigation , 2016 .

[26]  Roland Siegwart,et al.  Robust state estimation for small unmanned airplanes , 2014, 2014 IEEE Conference on Control Applications (CCA).

[27]  Roland Siegwart,et al.  Intuitive 3D Maps for MAV Terrain Exploration and Obstacle Avoidance , 2011, J. Intell. Robotic Syst..

[28]  Rassoul Amirfattahi,et al.  Fast semantic segmentation of aerial images based on color and texture , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[29]  J. Canny Finding Edges and Lines in Images , 1983 .

[30]  Nathan Michael,et al.  Vision-based landing site evaluation and informed optimal trajectory generation toward autonomous rooftop landing , 2015, Auton. Robots.

[31]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[32]  John R. Smith,et al.  Color for Image Retrieval , 2002 .

[33]  Matthew S. Whalley,et al.  Flight Trials of a Rotorcraft Unmanned Aerial Vehicle Landing Autonomously at Unprepared Sites , 2006 .