Vision-based landing site evaluation and informed optimal trajectory generation toward autonomous rooftop landing

Autonomous landing is an essential function for micro air vehicles (MAVs) for many scenarios. We pursue an active perception strategy that enables MAVs with limited onboard sensing and processing capabilities to concurrently assess feasible rooftop landing sites with a vision-based perception system while generating trajectories that balance continued landing site assessment and the requirement to provide visual monitoring of an interest point. The contributions of the work are twofold: (1) a perception system that employs a dense motion stereo approach that determines the 3D model of the captured scene without the need of geo-referenced images, scene geometry constraints, or external navigation aids; and (2) an online trajectory generation approach that balances the need to concurrently explore available rooftop vantages of an interest point while ensuring confidence in the landing site suitability by considering the impact of landing site uncertainty as assessed by the perception system. Simulation and experimental evaluation of the performance of the perception and trajectory generation methodologies are analyzed independently and jointly in order to establish the efficacy and robustness of the proposed approach.

[1]  Daniel Cremers,et al.  Semi-dense Visual Odometry for a Monocular Camera , 2013, 2013 IEEE International Conference on Computer Vision.

[2]  Eric W. Frew,et al.  Trajectory generation for constant velocity target motion estimation using monocular vision , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[3]  Roland Brockers,et al.  Fully self-contained vision-aided navigation and landing of a micro air vehicle independent from external sensor inputs , 2012, Defense, Security, and Sensing.

[4]  Matthew S. Whalley,et al.  Flight Trials of a Rotorcraft Unmanned Aerial Vehicle Landing Autonomously at Unprepared Sites , 2006 .

[5]  Sameera S. Ponda,et al.  Trajectory Optimization for Target Localization Using Small Unmanned Aerial Vehicles , 2009 .

[6]  S. Shankar Sastry,et al.  Autonomous Vision-based Landing and Terrain Mapping Using an MPC-controlled Unmanned Rotorcraft , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Xi Liu,et al.  Forced landing technologies for unmanned aerial vehicles : towards safer operations , 2009 .

[8]  Jonathan P. How,et al.  Robust Trajectory Planning for Autonomous Parafoils under Wind Uncertainty , 2013 .

[9]  Sebastian Scherer,et al.  Autonomous landing at unprepared sites by a full-scale helicopter , 2012, Robotics Auton. Syst..

[10]  Kian Hsiang Low,et al.  Decentralized active robotic exploration and mapping for probabilistic field classification in environmental sensing , 2012, AAMAS.

[11]  Nathan Michael,et al.  Vision-based Landing Site Evaluation and Trajectory Generation Toward Rooftop Landing , 2014, Robotics: Science and Systems.

[12]  George J. Pappas,et al.  On trajectory optimization for active sensing in Gaussian process models , 2009, Proceedings of the 48h IEEE Conference on Decision and Control (CDC) held jointly with 2009 28th Chinese Control Conference.

[13]  Nicholas R. J. Lawrance,et al.  Energy-constrained motion planning for information gathering with autonomous aerial soaring , 2013, 2013 IEEE International Conference on Robotics and Automation.

[14]  Gaurav S. Sukhatme,et al.  Landing a Helicopter on a Moving Target , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[15]  Radhakant Padhi,et al.  Automatic path planning and control design for autonomous landing of UAVs using dynamic inversion , 2009, 2009 American Control Conference.

[16]  Jonathan M. Garibaldi,et al.  Real-Time Correlation-Based Stereo Vision with Reduced Border Errors , 2002, International Journal of Computer Vision.

[17]  Kaichang Di,et al.  CAHVOR camera model and its photogrammetric conversion for planetary applications , 2004 .

[18]  Thomas Stützle,et al.  A beginner's introduction to iterated local search , 2001 .

[19]  Zoubin Ghahramani,et al.  Sparse Gaussian Processes using Pseudo-inputs , 2005, NIPS.

[20]  Mariano I. Lizarraga,et al.  Autonomous landing system for a UAV , 2004 .

[21]  Richard Szeliski,et al.  A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[22]  Roland Siegwart,et al.  Versatile distributed pose estimation and sensor self-calibration for an autonomous MAV , 2012, 2012 IEEE International Conference on Robotics and Automation.

[23]  Daniel Cremers,et al.  Real-Time Dense Geometry from a Handheld Camera , 2010, DAGM-Symposium.

[24]  Simon Lacroix,et al.  Autonomous Detection of Safe Landing Areas for an UAV from Monocular Images , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Peter I. Corke,et al.  Multirotor Aerial Vehicles: Modeling, Estimation, and Control of Quadrotor , 2012, IEEE Robotics & Automation Magazine.

[26]  Pratap Tokekar,et al.  Sensor Planning for a Symbiotic UAV and UGV System for Precision Agriculture , 2016, IEEE Trans. Robotics.

[27]  Roland Siegwart,et al.  Vision-based MAV Navigation: Implementation Challenges Towards a Usable System in Real-Life Scenarios , 2012, RSS 2012.

[28]  Carl E. Rasmussen,et al.  Infinite Mixtures of Gaussian Process Experts , 2001, NIPS.

[29]  Han-Lim Choi,et al.  Continuous trajectory planning of mobile sensors for informative forecasting , 2010, Autom..

[30]  Andrew J. Davison,et al.  DTAM: Dense tracking and mapping in real-time , 2011, 2011 International Conference on Computer Vision.

[31]  Pillar C. Eng,et al.  Path planning, guidance and control for a UAV forced landing , 2011 .

[32]  Yang Cheng,et al.  Real-time surface slope estimation by homography alignment for spacecraft safe landing , 2010, 2010 IEEE International Conference on Robotics and Automation.

[33]  Davide Scaramuzza,et al.  REMODE: Probabilistic, monocular dense reconstruction in real time , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[34]  Vijay Kumar,et al.  Vision-Based State Estimation and Trajectory Control Towards High-Speed Flight with a Quadrotor , 2013, Robotics: Science and Systems.

[35]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[36]  S. Sastry,et al.  Vision based terrain recovery for landing unmanned aerial vehicles , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[37]  Larry H. Matthies,et al.  Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[38]  Jonathan P. How,et al.  Information-Theoretic Motion Planning for Constrained Sensor Networks , 2013, J. Aerosp. Inf. Syst..

[39]  Siu-Tsen Shen,et al.  HALO the Winning Entry to the DARPA UAVForge Challenge 2012 , 2013, HCI.

[40]  G. Klein,et al.  Parallel Tracking and Mapping for Small AR Workspaces , 2007, 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality.

[41]  Stergios I. Roumeliotis,et al.  The Jet Propulsion Laboratory Autonomous Helicopter Testbed: A platform for planetary exploration technology research and development , 2006, J. Field Robotics.

[42]  Davide Scaramuzza,et al.  SVO: Fast semi-direct monocular visual odometry , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[43]  Andreas Krause,et al.  Nonmyopic Informative Path Planning in Spatio-Temporal Models , 2007, AAAI.

[44]  Roland Siegwart,et al.  Monocular Vision for Long‐term Micro Aerial Vehicle State Estimation: A Compendium , 2013, J. Field Robotics.