Combined RGBD-inertial based state estimation for MAV in GPS-denied indoor environments

This paper presents a integrated navigation approach for state estimation of a micro aerial vehicle (MAV) that is capable of autonomous flight in GPS-denied, indoor environments. The solution combines RGB-D sensor and inertial sensors in a tight-coupling navigation manner. Motion estimates from RGB-D visual odometry and inertial measurements are fused using an improved Extended Kalman Filter-based fusion algorithm to provide an accurate estimate of the relative position, velocity and attitude. Instead of using a global reference frame, a view-based map is employed and the algorithm maintains the position and heading relative to the current map node in the fusion algorithm. In addition, a closed-form covariance is developed to qualify the uncertainty of the RGBD visual odometry measurements, which is utilized for state update of the navigation filter. Our approach allows efficient measurement updates and enables the incorporation of RGBD visual odometry uncertainty. Experimental results of a quadrotor MAV flying in a GPS-denied indoor environment demonstrate the performance of the proposed approach. Comparisons of state estimates with ground truth measurements are also provided.

[1]  Andrea Censi,et al.  An accurate closed-form estimate of ICP's covariance , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  Eric N. Johnson,et al.  A Compact Guidance, Navigation, and Control System for Unmanned Aerial Vehicles , 2006, J. Aerosp. Comput. Inf. Commun..

[4]  Roland Siegwart,et al.  Robust embedded egomotion estimation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[6]  Sebastian Thrun,et al.  Autonomous Helicopter Tracking and Localization Using a Self-surveying Camera Array , 2007, Int. J. Robotics Res..

[7]  Rama Chellappa,et al.  Stochastic Approximation and Rate-Distortion Analysis for Robust Structure and Motion Estimation , 2003, International Journal of Computer Vision.

[8]  Wolfram Burgard,et al.  Efficient Sparse Pose Adjustment for 2D mapping , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Roland Siegwart,et al.  Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[10]  Nicholas Roy,et al.  RANGE–Robust autonomous navigation in GPS‐denied environments , 2011, J. Field Robotics.

[11]  Tom Drummond,et al.  Fusing points and lines for high performance tracking , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[12]  Rogelio Lozano,et al.  Combining Stereo Vision and Inertial Navigation System for a Quad-Rotor UAV , 2011, J. Intell. Robotic Syst..

[13]  Tianmiao Wang,et al.  Monocular vision and IMU based navigation for a small unmanned helicopter , 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[14]  Girish Chowdhary,et al.  Self-Contained Autonomous Indoor Flight with Ranging Sensor Navigation , 2012 .

[15]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[16]  G. Gerhart,et al.  Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments , 2009 .

[17]  Nicholas Roy,et al.  Stereo vision and laser odometry for autonomous helicopters in GPS-denied indoor environments , 2009, Defense + Commercial Sensing.

[18]  N. Roy,et al.  Autonomous Navigation and Exploration of a Quadrotor Helicopter in GPS-denied Indoor Environments , 2009 .

[19]  Nicholas Roy,et al.  State estimation for aggressive flight in GPS-denied environments using onboard sensing , 2012, 2012 IEEE International Conference on Robotics and Automation.