Vision-Based Navigation and Visual Servoing of Mini Flying Machines

The design of reliable navigation and control systems for Unmanned Aerial Vehicles (UAVs) based only on visual cues and inertial data has many unsolved challenging problems, ranging from hardware and software development to pure control-theoretical issues. This chapter addresses these issues by developing and implementing an adaptive vision-based autopilot for navigation and control of small and mini rotorcraft UAVs. The proposed autopilot includes a Visual Odometer (VO) for navigation in GPS-denied environments and a nonlinear control system for flight control and target tracking. The VO estimates the rotorcraft ego-motion by identifying and tracking visual features in the environment, using a single camera mounted on-board the vehicle. The VO has been augmented by an adaptive mechanism that fuses optic flow and inertial measurements to determine the range and to recover the 3D position and velocity of the vehicle. The adaptive VO pose estimates are then exploited by a nonlinear hierarchical controller for achieving various navigational tasks including take-off, landing, hovering, trajectory tracking, target tracking, etc. Furthermore, the asymptotic stability of the entire closed-loop system has been established using systems in cascade and adaptive control theories. Experimental flight test data over various ranges of the flight envelope illustrate that the proposed vision-based autopilot performs well and allows a mini rotorcraft UAV to achieve autonomously advanced flight behaviours by using vision.

[1]  T. Kanade,et al.  Real-time and 3D vision for autonomous small and micro air vehicles , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[2]  Zhang,et al.  Visually mediated odometry in honeybees , 1997, The Journal of experimental biology.

[3]  Robert E. Mahony,et al.  A Practical Visual Servo Control for an Unmanned Aerial Vehicle , 2008, IEEE Transactions on Robotics.

[4]  Matthew Garratt,et al.  Biologically inspired climbing with a hexapedal robot , 2008 .

[5]  Eric N. Johnson,et al.  Real-Time Vision-Based Relative Aircraft Navigation , 2007, J. Aerosp. Comput. Inf. Commun..

[6]  Gaurav S. Sukhatme,et al.  Visually guided landing of an unmanned aerial vehicle , 2003, IEEE Trans. Robotics Autom..

[7]  Michael H Dickinson,et al.  The influence of visual landscape on the free flight behavior of the fruit fly Drosophila melanogaster. , 2002, The Journal of experimental biology.

[8]  Aníbal Ollero,et al.  Vision-Based Odometry and SLAM for Medium and High Altitude Flying UAVs , 2009, J. Intell. Robotic Syst..

[9]  Gaurav S. Sukhatme,et al.  Combined optic-flow and stereo-based navigation of urban canyons for a UAV , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Geoffrey Louis Barrows.  Mixed-mode VLSI optic flow sensors for micro air vehicles , 1999 .

[11]  T. Hamel,et al.  A practical Visual Servo Control for a Unmanned Aerial Vehicle , 2008, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  Mrdjan J. Jankovic,et al.  Constructive Nonlinear Control , 2011 .

[13]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[14]  Zhang,et al.  Honeybee navigation en route to the goal: visual flight control and odometry , 1996, The Journal of experimental biology.

[15]  Jonathan P. How,et al.  Vision-based guidance and control of a hovering vehicle in unknown, GPS-denied environments , 2009, 2009 IEEE International Conference on Robotics and Automation.

[16]  Rogelio Lozano,et al.  Adaptive Vision-Based Controller for Small Rotorcraft UAVs Control and Guidance , 2008 .

[17]  Eric N. Johnson,et al.  Vision‐only control and guidance for aircraft , 2006, J. Field Robotics.

[18]  Karl Johan Åström,et al.  Adaptive Control , 1989, Embedded Digital Control with Microcontrollers.

[19]  Larry H. Matthies,et al.  Vision Guided Landing of an Autonomous Helicopter in Hazardous Terrain , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[20]  Dah-Jye Lee,et al.  Vision Aided Stabilization and the Development of a Quad-Rotor Micro UAV , 2007, 2007 International Symposium on Computational Intelligence in Robotics and Automation.

[21]  Xiao Xiao,et al.  Vision-based road-following using a small autonomous aircraft , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[22]  Sebastian Scherer,et al.  Flying Fast and Low Among Obstacles: Methodology and Experiments , 2008, Int. J. Robotics Res..

[23]  Derek W. Seward,et al.  Development of a Multi-Arm Mobile Robot for Nuclear Decommissioning Tasks , 2007 .

[24]  Paul Y. Oh,et al.  Autonomous Landing for Indoor Flying Robots Using Optic Flow , 2003 .

[25]  Gaurav S. Sukhatme,et al.  Visual servoing of an autonomous helicopter in urban areas using feature tracking , 2006, J. Field Robotics.

[26]  Dario Floreano,et al.  Fly-inspired visual steering of an ultralight indoor aircraft , 2006, IEEE Transactions on Robotics.

[27]  Kenzo Nonami,et al.  Optic flow-based vision system for autonomous 3D localization and control of small aerial vehicles , 2009, Robotics Auton. Syst..

[28]  S. Shankar Sastry,et al.  Multiple view motion estimation and control for landing an unmanned aerial vehicle , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[29]  Kenzo Nonami,et al.  Embedded autopilot for accurate waypoint navigation and trajectory tracking: Application to miniature rotorcraft UAVs , 2009, 2009 IEEE International Conference on Robotics and Automation.

[30]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[31]  Nicolas H. Franceschini,et al.  Optic flow regulation: the key to aircraft automatic guidance , 2005, Robotics Auton. Syst..

[32]  Mandyam V. Srinivasan,et al.  Landing Strategies in Honeybees and Applications to Uninhabited Airborne Vehicles , 2004, Int. J. Robotics Res..

[33]  Salah Sukkarieh,et al.  Real-time implementation of airborne inertial-SLAM , 2007, Robotics Auton. Syst..

[34]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Kenzo Nonami,et al.  3D Vision Based Landing Control of a Small Scale Autonomous Helicopter , 2007 .

[36]  Eduardo Sontag.  Smooth stabilization implies coprime factorization , 1989, IEEE Transactions on Automatic Control.

[37]  Nicolas H. Franceschini,et al.  A vision-based autopilot for a miniature air vehicle: joint speed control and lateral obstacle avoidance , 2008, Auton. Robots.

[38]  Takeo Kanade,et al.  A visual odometer for autonomous helicopter flight , 1999, Robotics Auton. Syst..

[39]  Camillo J. Taylor,et al.  Control of a Quadrotor Helicopter Using Dual Camera Visual Feedback , 2005, Int. J. Robotics Res..

[40]  Robert E. Mahony,et al.  Hovering flight and vertical landing control of a VTOL Unmanned Aerial Vehicle using optical flow , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Petros A. Ioannou,et al.  Robust Adaptive Control , 2012 .