Quaternion-based Orientation Estimation Fusing a Camera and Inertial Sensors for a Hovering UAV

Orientation estimation in quadrotors is essential for low-level stability control and for high-levelnavigation and motion planning. This is usually carried out by fusing measurements from different sensorsincluding inertial sensor, magnetic compass, sonar, GPS, camera, etc. In indoor environments, the GPSsignal is not available and the Earth’s magnetic field is highly disturbed. In this work we present a newapproach for visual estimation of the yaw angle based on spectral features, and a fusion algorithm usingunit quaternions, both applied to a hovering quadrotor. The approach is based on an Inertial MeasurementUnit and a downward-looking camera, rigidly attached to the quadrotor. The fusion is performed by means of an Extended Kalman Filter with a double measurement update stage. The inertial sensors provideinformation for orientation estimation, mainly for roll and pitch angles, whereas the camera is used for measuring the yaw angle. A new method to integrate the yaw angle in the measurement update of the filteris also proposed, using an augmented measurement vector in order to avoid discontinuities in the filterinnovation vector. The proposed approach is evaluated with real data and compared with ground truthgiven by a Vicon system. Experimental results are presented for both the visual yaw angle estimationand the fusion with the inertial sensors, showing an improvement in orientation estimation.

[1]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[2]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[3]  Jack B. Kuipers,et al.  Quaternions and Rotation Sequences: A Primer with Applications to Orbits, Aerospace and Virtual Reality , 2002 .

[4]  Olivier D. Faugeras,et al.  The geometry of multiple images - the laws that govern the formation of multiple images of a scene and some of their applications , 2001 .

[5]  Roland Siegwart,et al.  A benchmarking tool for MAV visual pose estimation , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[6]  Seung-Min Oh,et al.  Multisensor fusion for autonomous UAV navigation based on the Unscented Kalman Filter with Sequential Measurement Updates , 2010, 2010 IEEE Conference on Multisensor Fusion and Integration.

[7]  W. F. Phillips,et al.  Review of Attitude Representations Used for Aircraft Kinematics , 2001 .

[8]  Jiahua Wu,et al.  Rotation Invariant Classification of 3D Surface Textures using Photometric Stereo and Surface Magnitude Spectra , 2000, BMVC.

[9]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[10]  Alonzo Kelly,et al.  Linearized Error Propagation in Odometry , 2004, Int. J. Robotics Res..

[11]  Luca Fanucci,et al.  A Double-Stage Kalman Filter for Orientation Tracking With an Integrated Processor in 9-D IMU , 2013, IEEE Transactions on Instrumentation and Measurement.

[12]  Andrew G. Dempster,et al.  How feasible is the use of magnetic field alone for indoor positioning? , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[13]  L. Fanucci,et al.  A double stage Kalman filter for sensor fusion and orientation tracking in 9D IMU , 2012, 2012 IEEE Sensors Applications Symposium Proceedings.

[14]  D. Simon Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches , 2006 .

[15]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[16]  Amnon Shashua,et al.  Multiple View Geometry of General Algebraic Curves , 2004, International Journal of Computer Vision.

[17]  C. D. Kuglin,et al.  The phase correlation image alignment method , 1975 .

[18]  Nicolas Petit,et al.  The Navigation and Control technology inside the AR.Drone micro UAV , 2011 .

[19]  Larry H. Matthies,et al.  Towards Autonomous Navigation of Miniature UAV , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[20]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[21]  Patrick Robertson,et al.  Characterization of the indoor magnetic field for applications in Localization and Mapping , 2012, 2012 International Conference on Indoor Positioning and Indoor Navigation (IPIN).

[22]  Navid Nourani-Vatani,et al.  Practical visual odometry for car-like vehicles , 2009, 2009 IEEE International Conference on Robotics and Automation.

[23]  Andrew Zisserman,et al.  Classifying Images of Materials: Achieving Viewpoint and Illumination Independence , 2002, ECCV.

[24]  N. Trawny,et al.  Indirect Kalman Filter for 3 D Attitude Estimation , 2005 .

[25]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[26]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[27]  Andrew Zisserman,et al.  Geometric invariance in computer vision , 1992 .

[28]  James M. Conrad,et al.  A survey of quadrotor Unmanned Aerial Vehicles , 2012, 2012 Proceedings of IEEE Southeastcon.