Omnidirectional vision applied to Unmanned Aerial Vehicles (UAVs) attitude and heading estimation

This paper presents an aircraft attitude and heading estimator using catadioptric images as a principal sensor for UAV or as a redundant system for IMU (Inertial Measure Unit) and gyro sensors. First, we explain how the unified theory for central catadioptric cameras is used for attitude and heading estimation, explaining how the skyline is projected on the catadioptric image and how it is segmented and used to calculate the UAV's attitude. Then, we use appearance images to obtain a visual compass, and we calculate the relative rotation and heading of the aerial vehicle. Finally the tests and results using the UAV COLIBRI platform and the validation of them in real flights are presented, comparing the estimated data with the inertial values measured on board.

[1]  Kostas Daniilidis,et al.  Catadioptric Projective Geometry , 2001, International Journal of Computer Vision.

[2]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[3]  Miguel A. Olivares-Méndez,et al.  Computer Vision Onboard UAVs for Civilian Tasks , 2009, J. Intell. Robotic Syst..

[4]  Peter G. Ifju,et al.  Vision-guided flight stability and control for micro air vehicles , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Frédéric Labrosse,et al.  The visual compass: Performance and limitations of an appearance‐based method , 2006, J. Field Robotics.

[6]  Shree K. Nayar,et al.  A Theory of Single-Viewpoint Catadioptric Image Formation , 1999, International Journal of Computer Vision.

[7]  Roland Siegwart,et al.  Appearance-Guided Monocular Omnidirectional Visual Odometry for Outdoor Ground Vehicles , 2008, IEEE Transactions on Robotics.

[8]  A. Winkler,et al.  Reliability prediction model for gyroscopes , 1990, Annual Proceedings on Reliability and Maintainability Symposium.

[9]  Wageeh Boles,et al.  Fixed-Wing Attitude Estimation Using Computer Vision Based Horizon Detection , 2007 .

[10]  Toms Svoboda,et al.  Central Panoramic Cameras: Geometry and Design , 1997 .

[11]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[12]  Xianghua Ying,et al.  Catadioptric camera calibration using geometric invariants , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Javaan Singh Chahl,et al.  Innovations in intelligent machines , 2007 .

[14]  Pascal Vasseur,et al.  Omnidirectional vision on UAV for attitude computation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[15]  Tomás Svoboda,et al.  Epipolar Geometry for Central Catadioptric Cameras , 2002, International Journal of Computer Vision.

[16]  Helder Araújo,et al.  Issues on the geometry of central catadioptric image formation , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[17]  Valdir Grassi,et al.  VISUAL SERVO CONTROL OF A MOBILE ROBOT USING OMNIDIRECTIONAL VISION , 2002 .

[18]  A. Price,et al.  Aircraft attitude estimation from horizon video , 2006 .

[19]  Hendrik James Antonisse,et al.  Image segmentation in pyramids , 1982, Comput. Graph. Image Process..

[20]  Jeremy A. Walraven,et al.  Failure mechanisms in mems , 2003, International Test Conference, 2003. Proceedings. ITC 2003..

[21]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[22]  Peter G. Ifju,et al.  Sky/ground modeling for autonomous MAV flight , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[23]  Randal W. Beard,et al.  State Estimation for Micro Air Vehicles , 2007, Innovations in Intelligent Machines.

[24]  Gaurav S. Sukhatme,et al.  Omnidirectional vision for an autonomous helicopter , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[25]  S. Nayar,et al.  Catadioptric Image Formation , 1997 .

[26]  Helder Araújo,et al.  Geometric Properties of Central Catadioptric Line Images , 2002, ECCV.

[27]  Xianghua Ying,et al.  Catadioptric camera calibration using geometric invariants , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.