Laser-aided Infrared Visual Inertial Odometry for Unmanned Aerial Vehicle with Multi-plane Constraint

In this work, we propose an infrared visual inertial odometry (VIO) algorithm for unmanned aerial vehicles (UAV) for both daytime and nighttime. It utilizes images from a single downward-looking thermal camera, and uses a laser scanner to measure relative distance to determine the scale factor. The scale recovery process consists of a comprehensive logic flow to try out measurements into a homography decomposition with a multi-plane constraint, obtaining the results with minimum error, making the algorithm more robust. Moreover, other modifications, such as keyframe idea and pruning KLT tracker with sub-regions further improves the performance. Besides, the results are fused with an on-board IMU through an EKF-based sensor fusion framework. This infrared visual inertial odometry algorithm can still navigate UAVs during the missions when GPS is down or not reliable or under poor illumination condition.

[1]  Frederic Devernay A Non-Maxima Suppression Method for Edge Detection with Sub-Pixel Accuracy , 1995 .

[2]  Pengfei Wang,et al.  Efficient velocity estimation for MAVs by fusing motion from two frontally parallel cameras , 2018, Journal of Real-Time Image Processing.

[3]  Roland Siegwart,et al.  Versatile distributed pose estimation and sensor self-calibration for an autonomous MAV , 2012, 2012 IEEE International Conference on Robotics and Automation.

[4]  Masaki Osakabe,et al.  Infrared imaging video bolometer for the large helical device , 2001 .

[5]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[6]  Zhi Gao,et al.  Design of dense, accurate stereo maps for fast maneuvering of unmanned aerial vehicles , 2017, 2017 13th IEEE International Conference on Control & Automation (ICCA).

[7]  Zhi Gao,et al.  A brief survey of visual odometry for micro aerial vehicles , 2016, IECON 2016 - 42nd Annual Conference of the IEEE Industrial Electronics Society.

[8]  Ben M. Chen,et al.  System integration of a vision-guided UAV for autonomous landing on moving platform , 2016, 2016 12th IEEE International Conference on Control and Automation (ICCA).

[9]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[10]  Angel Domingo Sappa,et al.  A Visible-Thermal Fusion Based Monocular Visual Odometry , 2015, ROBOT.

[11]  Pierre Bremond,et al.  Nonuniformity correction and thermal drift compensation of thermal infrared camera , 2004, SPIE Defense + Commercial Sensing.

[12]  Thambipillai Srikanthan,et al.  A Framework for Fast and Robust Visual Odometry , 2017, IEEE Transactions on Intelligent Transportation Systems.

[13]  Paulo Vinicius Koerich Borges,et al.  Practical Infrared Visual Odometry , 2016, IEEE Transactions on Intelligent Transportation Systems.