Vision-based autonomous navigation and landing of an unmanned aerial vehicle using natural landmarks

This paper presents the design and implementation of a vision-based navigation and landing algorithm for an autonomous helicopter. The vision system allows to define target areas from a high resolution aerial or satellite image to determine the waypoints of the navigation trajectory or the landing area. The helicopter is required to navigate from an initial position to a final position in a partially known environment using GPS and vision, to locate a landing target (a helipad of a known shape or a natural landmark) and to land on it. The vision system, using a feature-based image matching algorithm, finds the area and gives feedbacks to the control system for autonomous landing. Vision is used for accurate target detection, recognition and tracking. The helicopter updates its landing target parameters owing to vision and uses an on board behavior-based controller to follow a path to the landing site. Results show the appropriateness of the vision-based approach that does not require any artificial landmark (e.g., helipad) and is quite robust to occlusions, light variations and seasonal changes (e.g., brown or green leaves).

[1]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[2]  Takeo Kanade,et al.  A visual odometer for autonomous helicopter flight , 1999, Robotics Auton. Syst..

[3]  S. Shankar Sastry,et al.  Autonomous Vision-based Landing and Terrain Mapping Using an MPC-controlled Unmanned Rotorcraft , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[4]  Maja J. Mataric,et al.  Behaviour-based control: examples from navigation, learning, and group behaviour , 1997, J. Exp. Theor. Artif. Intell..

[5]  Sauro Longhi,et al.  Model-Based Sensor Fault Detection and Isolation System for Unmanned Ground Vehicles: Theoretical Aspects (part I) , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[6]  James J. Little,et al.  Vision-based mobile robot localization and mapping using scale-invariant features , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[7]  S. Sastry,et al.  Output tracking control design of a helicopter model based on approximate linearization , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[8]  Gaurav S. Sukhatme,et al.  Towards vision-based safe landing for an autonomous helicopter , 2002, Robotics Auton. Syst..

[9]  Emanuele Frontoni,et al.  A Framework for Simulation and Testing of UAVs in Cooperative Scenarios , 2009, J. Intell. Robotic Syst..

[10]  Larry H. Matthies,et al.  Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[11]  S. Shankar Sastry,et al.  Multiple view motion estimation and control for landing an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[12]  Gaurav S. Sukhatme,et al.  Landing a Helicopter on a Moving Target , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[13]  S. Longhi,et al.  Experimental Validation of a Real-Time Model-Based Sensor Fault Detection and Isolation System for Unmanned Ground Vehicles , 2006, 2006 14th Mediterranean Conference on Control and Automation.

[14]  George A. Bekey,et al.  Learning helicopter control through "teaching by showing" , 1998, Proceedings of the 37th IEEE Conference on Decision and Control (Cat. No.98CH36171).

[15]  S. Shankar Sastry,et al.  HIERARCHICAL CONTROL SYSTEM SYNTHESIS FOR ROTORCRAFT-BASED UNMANNED AERIAL VEHICLES , 2000 .

[16]  A.R.S. Bramwell,et al.  Bramwell's Helicopter Dynamics , 2001 .

[17]  Maja J. Matari,et al.  Behavior-based Control: Examples from Navigation, Learning, and Group Behavior , 1997 .

[18]  Gaurav S. Sukhatme,et al.  Visually guided landing of an unmanned aerial vehicle , 2003, IEEE Trans. Robotics Autom..

[19]  Omead Amidi,et al.  An autonomous vision-guided helicopter , 1996 .

[20]  Emanuele Frontoni,et al.  Adaptive and fast scale invariant feature extraction , 2007, VISAPP.