Vision-aided Estimation of Attitude, Velocity, and Inertial Measurement Bias for UAV Stabilization

This paper studies vision-aided inertial navigation of small-scale unmanned aerial vehicles (UAVs) in GPS-denied environments. The objectives of the navigation system are to firstly online estimate and compensate the unknown inertial measurement biases, secondly provide drift-free velocity and attitude estimates which are crucial for UAV stabilization control, and thirdly give relatively accurate position estimation such that the UAV is able to perform at least a short-term navigation when the GPS signal is not available. For the vision system, we do not presume maps or landmarks of the environment. The vision system should be able to work robustly even given low-resolution images (e.g., 160 ×120 pixels) of near homogeneous visual features. To achieve these objectives, we propose a novel homography-based vision-aided navigation system that adopts four common sensors: a low-cost inertial measurement unit, a downward-looking monocular camera, a barometer, and a compass. The measurements of the sensors are fused by an extended Kalman filter. Based on both analytical and numerical observability analyses of the navigation system, we theoretically verify that the proposed navigation system is able to achieve the navigation objectives. We also show comprehensive simulation and real flight experimental results to verify the effectiveness and robustness of the proposed navigation system.

[1]  Abd El Rahman Shabayek,et al.  Vision Based UAV Attitude Estimation: Progress and Insights , 2012, J. Intell. Robotic Syst..

[2]  Tong Heng Lee,et al.  Systematic Design and Implementation of a Micro Unmanned Quadrotor System , 2014 .

[3]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[4]  Tong Heng Lee,et al.  Optimal sensor placement for target localisation and tracking in 2D and 3D , 2012, Int. J. Control.

[5]  Fei Wang,et al.  A mono-camera and scanning laser range finder based UAV indoor navigation system , 2013, 2013 International Conference on Unmanned Aircraft Systems (ICUAS).

[6]  S. Sukkarieh,et al.  Observability analysis and active control for airborne SLAM , 2008, IEEE Transactions on Aerospace and Electronic Systems.

[7]  Patrick Doherty,et al.  Vision-Based Unmanned Aerial Vehicle Navigation Using Geo-Referenced Information , 2009, EURASIP J. Adv. Signal Process..

[8]  Tong Heng Lee,et al.  Optimal placement of bearing-only sensors for target localization , 2012, 2012 American Control Conference (ACC).

[9]  Stergios I. Roumeliotis,et al.  Vision-Aided Inertial Navigation for Spacecraft Entry, Descent, and Landing , 2009, IEEE Transactions on Robotics.

[10]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[11]  K. Senthil Kumar,et al.  Development of Rotary Wing Mini UAS for Civilian Applications , 2013 .

[12]  Jun Zhang,et al.  Novel Technique for Vision-Based UAV Navigation , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[13]  Aníbal Ollero,et al.  Vision-Based Odometry and SLAM for Medium and High Altitude Flying UAVs , 2009, J. Intell. Robotic Syst..

[14]  Fei Wang,et al.  Development of an Unmanned Helicopter for Vertical Replenishment , 2015, Unmanned Syst..

[15]  Kun Li,et al.  Development of an Unmanned Coaxial Rotorcraft for the DARPA UAVForge Challenge , 2013 .

[16]  S. Sukkarieh,et al.  Autonomous airborne navigation in unknown terrain environments , 2004, IEEE Transactions on Aerospace and Electronic Systems.

[17]  Navid Serrano,et al.  Integrated Sensing for Entry, Descent, and Landing of a Robotic Spacecraft , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[18]  Agostino Martinelli,et al.  Vision and IMU Data Fusion: Closed-Form Solutions for Attitude, Speed, Absolute Scale, and Bias Determination , 2012, IEEE Transactions on Robotics.

[19]  P. Groves Principles of GNSS, Inertial, and Multisensor Integrated Navigation Systems, Second Edition , 2013 .

[20]  Tong Heng Lee,et al.  Unmanned Rotorcraft Systems , 2011 .

[21]  Ben M. Chen,et al.  Vision based Target Tracking/ Following and Estimation of Target Motion , 2013 .

[22]  V. Aidala,et al.  Observability Criteria for Bearings-Only Target Motion Analysis , 1981, IEEE Transactions on Aerospace and Electronic Systems.

[23]  Clark N. Taylor,et al.  Comparison of Two Image and Inertial Sensor Fusion Techniques for Navigation in Unmapped Environments , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[24]  Peidong Liu,et al.  Development of an Enhanced Ground Control System for Unmanned Aerial Vehicles , 2012 .

[25]  M K Kaiser,et al.  Vision-Based Estimation for Guidance, Navigation, and Control of an Aerial Vehicle , 2010, IEEE Transactions on Aerospace and Electronic Systems.

[26]  Yangquan Chen,et al.  A Data Fusion System for Attitude Estimation of Low-cost Miniature UAVs , 2012, J. Intell. Robotic Syst..

[27]  Uwe Stilla,et al.  SENSOR POSE INFERENCE FROM AIRBORNE VIDEOS BY DECOMPOSING HOMOGRAPHY ESTIMATES , 2004 .

[28]  Salah Sukkarieh,et al.  Real-time implementation of airborne inertial-SLAM , 2007, Robotics Auton. Syst..

[29]  Eric N. Johnson,et al.  Vision-Aided Inertial Navigation for Flight Control , 2005 .

[30]  Sumetee kesorn Visual Navigation for Mobile Robots: a Survey , 2012 .

[31]  Friedrich Fraundorfer,et al.  Visual Odometry Part I: The First 30 Years and Fundamentals , 2022 .

[32]  Hai Lin,et al.  Development of a comprehensive software system for implementing cooperative control of multiple unmanned aerial vehicles , 2009, 2009 IEEE International Conference on Control and Automation.

[33]  K. Gong,et al.  Fundamental properties and performance of conventional bearings-only target motion analysis , 1984 .