Visual Servoing for Tracking Features in Urban Areas Using an Autonomous Helicopter

We present the design and implementation of a vision based feature tracking system for an autonomous helicopter. Visual sensing is used for estimating the position and velocity of the features (urban features like windows) with respect to the helicopter. These reference signals are then combined with GPS to navigate towards these features and then track them. We present results from experimental flight trials, performed in different conditions and various locations that show the feasibility and robustness of our approach.

[1]  S. Shankar Sastry,et al.  LANDING AN UNMANNED AIR VEHICLE: VISION BASED MOTION ESTIMATION AND NONLINEAR CONTROL , 1999 .

[2]  Emanuele Trucco,et al.  Computer and Robot Vision , 1995 .

[3]  David H. Douglas,et al.  ALGORITHMS FOR THE REDUCTION OF THE NUMBER OF POINTS REQUIRED TO REPRESENT A DIGITIZED LINE OR ITS CARICATURE , 1973 .

[4]  Jean-Claude Latombe,et al.  Landmark-Based Robot Navigation , 1992, Algorithmica.

[5]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[6]  Takeo Kanade,et al.  A visual odometer for autonomous helicopter flight , 1999, Robotics Auton. Syst..

[7]  S. Shankar Sastry,et al.  Vision guided navigation for a nonholonomic mobile robot , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.

[8]  R. E. Kalman,et al.  A New Approach to Linear Filtering and Prediction Problems , 2002 .

[9]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[10]  Eric Feron,et al.  Control Logic for Automated Aerobatic Flight of a Miniature Helicopter , 2002 .

[11]  Gaurav S. Sukhatme,et al.  Towards vision-based safe landing for an autonomous helicopter , 2002, Robotics Auton. Syst..

[12]  C Tomasi,et al.  Shape and motion from image streams: a factorization method. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[13]  Omead Amidi,et al.  An autonomous vision-guided helicopter , 1996 .

[14]  Larry H. Matthies,et al.  Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[15]  J.-Y. Bouguet,et al.  Pyramidal implementation of the lucas kanade feature tracker , 1999 .

[16]  Gaurav S. Sukhatme,et al.  A tale of two helicopters , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[17]  S. Shankar Sastry,et al.  Probabilistic pursuit-evasion games: theory, implementation, and experimental evaluation , 2002, IEEE Trans. Robotics Autom..

[18]  Gaurav S. Sukhatme,et al.  Detection and Tracking of External Features in an Urban Environment Using an Autonomous Helicopter , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[19]  Gaurav S. Sukhatme,et al.  Visually guided landing of an unmanned aerial vehicle , 2003, IEEE Trans. Robotics Autom..

[20]  I. Golightly,et al.  Visual control of an unmanned aerial vehicle for power line inspection , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[21]  Gaurav S. Sukhatme,et al.  Omnidirectional vision for an autonomous helicopter , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[22]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[23]  Andrew Richard Conway,et al.  Autonomous control of an unstable model helicopter using carrier phase gps only , 1995 .

[24]  D. I. Jones,et al.  Obstacle avoidance during aerial inspection of power lines , 2001 .

[25]  Michael Carsten Bosse,et al.  A VISION AUGMENTED NAVIGATION SYSTEM FOR AN AUTONOMOUS HELICOPTER , 1997 .