Autonomous landing on a moving vehicle with an unmanned aerial vehicle

This paper addresses the perception, control and trajectory planning for an aerial platform to identify and land on a moving car at 15 km/h. The hexacopter Unmanned Aerial Vehicle (UAV), equipped with onboard sensors and a computer, detects the car using a monocular camera and predicts the car future movement using a nonlinear motion model. While following the car, the UAV lands on its roof, and it attaches itself using magnetic legs. The proposed system is fully autonomous from takeoff to landing. Numerous field tests were conducted throughout the year-long development and preparations for the MBZIRC 2017 competition, for which the system was designed. We propose a novel control system in which a Model Predictive Controller is used in real time to generate a reference trajectory for the UAV, which are then tracked by the nonlinear feedback controller. This combination allows to track predictions of the car motion with minimal position error. The evaluation presents three successful autonomous landings during the MBZIRC 2017, where our system achieved the fastest landing among all competing teams. ∗http://mrs.felk.cvut.cz †http://www.grasp.upenn.edu

[1]  Chun Kiat Tan,et al.  Autonomous ship deck landing of a quadrotor using invariant ellipsoid method , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[2]  David Hyunchul Shim,et al.  Outdoor autonomous landing on a moving platform for quadrotors using an omnidirectional camera , 2014, 2014 International Conference on Unmanned Aircraft Systems (ICUAS).

[3]  Zexiang Li,et al.  Precise quadrotor autonomous landing with SRUKF vision perception , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Hyochoong Bang,et al.  Target state estimation for vision-based landing on a moving ground target , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[5]  Maarouf Saad,et al.  Autonomous Landing of a Quadrotor on a Moving Platform , 2017, IEEE Transactions on Aerospace and Electronic Systems.

[6]  Vijay Kumar,et al.  Cooperative Grasping and Transport Using Multiple Quadrotors , 2010, DARS.

[7]  Haibin Duan,et al.  Implementation of autonomous visual tracking and landing for a low-cost quadrotor , 2013 .

[8]  Yang Yi,et al.  Autonomous landing of a quadrotor on an UGV , 2016, 2016 IEEE International Conference on Mechatronics and Automation.

[9]  Zicheng Guo,et al.  Parallel thinning with two-subiteration algorithms , 1989, Commun. ACM.

[10]  Vijay Kumar,et al.  Cooperative autonomous search, grasping, and delivering in a treasure hunt scenario by a team of unmanned aerial vehicles , 2018, J. Field Robotics.

[11]  Daewon Lee,et al.  Autonomous landing of a VTOL UAV on a moving platform using image-based visual servoing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  Matthew A. Garratt,et al.  Monocular vision-based real-time target recognition and tracking for autonomously landing an UAV in a cluttered shipboard environment , 2017, Auton. Robots.

[13]  Rudolph van der Merwe,et al.  The unscented Kalman filter for nonlinear estimation , 2000, Proceedings of the IEEE 2000 Adaptive Systems for Signal Processing, Communications, and Control Symposium (Cat. No.00EX373).

[14]  Andreas Zell,et al.  A cross-platform comparison of visual marker based approaches for autonomous flight of quadrocopters , 2013 .

[15]  Nabil Aouf,et al.  Vision Based Autonomous Landing of Multirotor UAV on Moving Platform , 2017, J. Intell. Robotic Syst..

[16]  Taeyoung Lee,et al.  Nonlinear Robust Tracking Control of a Quadrotor UAV on SE(3) , 2013 .

[17]  Haibo Luo,et al.  Towards autonomous tracking and landing on moving target , 2016, 2016 IEEE International Conference on Real-time Computing and Robotics (RCAR).

[18]  Dongjin Lee,et al.  Close-range vision navigation and guidance for rotary UAV autonomous landing , 2015, 2015 IEEE International Conference on Automation Science and Engineering (CASE).

[19]  A. Masi,et al.  NEW INFRARED TIME OF-FLIGHT MEASUREMENT SENSOR FOR ROBOTIC PLATFORMS , 2014 .

[20]  Sven Behnke,et al.  Fast autonomous landing on a moving target at MBZIRC , 2017, 2017 European Conference on Mobile Robots (ECMR).

[21]  Dang Quang Nguyen,et al.  Autonomous Landing of a Quadcopter on a High-Speed Ground Vehicle , 2017 .

[22]  Cheng Hui,et al.  Autonomous takeoff, tracking and landing of a UAV on a moving UGV using onboard monocular vision , 2013, Proceedings of the 32nd Chinese Control Conference.

[23]  Matthew J. Rutherford,et al.  Real-time, GPU-based pose estimation of a UAV for autonomous takeoff and landing , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Marc Pollefeys,et al.  PIXHAWK: A micro aerial vehicle design for autonomous flight using onboard computer vision , 2012, Auton. Robots.

[25]  J. A. Rossiter,et al.  Model-Based Predictive Control : A Practical Approach , 2017 .

[26]  Shen Lincheng,et al.  On-board vision autonomous landing techniques for quadrotor: A survey , 2016, 2016 35th Chinese Control Conference (CCC).

[27]  Brooks,et al.  Intelligent Robots and Systems IROS ' 90 Lunar Base Const rue t ion Rob 0 t s , .

[28]  Andreas Zell,et al.  An Onboard Monocular Vision System for Autonomous Takeoff, Hovering and Landing of a Micro Aerial Vehicle , 2013, J. Intell. Robotic Syst..

[29]  Jianwei Zhang,et al.  Vision-based autonomous landing system for unmanned aerial vehicle: A survey , 2014, 2014 International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI).

[30]  Vijay Kumar,et al.  Minimum snap trajectory generation and control for quadrotors , 2011, 2011 IEEE International Conference on Robotics and Automation.

[31]  Dimitra Panagou,et al.  Vision-based target tracking and autonomous landing of a quadrotor on a ground vehicle , 2017, 2017 American Control Conference (ACC).

[32]  Youmin Zhang,et al.  Real-time autonomous take-off, tracking and landing of UAV on a moving UGV platform , 2016, 2016 24th Mediterranean Conference on Control and Automation (MED).

[33]  Martin Saska,et al.  Embedded model predictive control of unmanned micro aerial vehicles , 2016, 2016 21st International Conference on Methods and Models in Automation and Robotics (MMAR).

[34]  Roland Siegwart,et al.  Monocular‐SLAM–based navigation for autonomous micro helicopters in GPS‐denied environments , 2011, J. Field Robotics.

[35]  Vijay Kumar,et al.  Model Predictive Trajectory Tracking and Collision Avoidance for Reliable Outdoor Deployment of Unmanned Aerial Vehicles , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[36]  David Hyunchul Shim,et al.  Vision-based UAV landing on the moving vehicle , 2016, 2016 International Conference on Unmanned Aircraft Systems (ICUAS).

[37]  Martin Saska,et al.  Vision techniques for on‐board detection, following, and mapping of moving targets , 2018, J. Field Robotics.

[38]  Robert E. Mahony,et al.  Landing a VTOL Unmanned Aerial Vehicle on a Moving Platform Using Optical Flow , 2012, IEEE Transactions on Robotics.