Vision Based UAV Attitude Estimation: Progress and Insights

Unmanned aerial vehicles (UAVs) are increasingly replacing manned systems in situations that are dangerous, remote, or difficult for manned aircraft to access. Its control tasks are empowered by computer vision technology. Visual sensors are robustly used for stabilization as primary or at least secondary sensors. Hence, UAV stabilization by attitude estimation from visual sensors is a very active research area. Vision based techniques are proving their effectiveness and robustness in handling this problem. In this work a comprehensive review of UAV vision based attitude estimation approaches is covered, starting from horizon based methods and passing by vanishing points, optical flow, and stereoscopic based techniques. A novel segmentation approach for UAV attitude estimation based on polarization is proposed. Our future insightes for attitude estimation from uncalibrated catadioptric sensors are also discussed.

[1]  Pascal Vasseur,et al.  UAV ATTITUDE ESTIMATION BY COMBINING HORIZON-BASED AND HOMOGRAPHY-BASED APPROACHES FOR CATADIOPTRIC IMAGES , 2007 .

[2]  Javaan Chahl,et al.  Biomimetic Visual Sensing and Flight Control , 2002 .

[3]  E. Reed.  The Ecological Approach to Visual Perception , 1989 .

[4]  Thomas Philip Webb.  VISION-BASED STATE ESTIMATION FOR UNINHABITED AERIAL VEHICLES USING THE COPLANARITY CONSTRAINT , 2005 .

[5]  Steven Mills,et al.  Optical Flow for Heading Estimation of a Quadrotor Helicopter , 2009 .

[6]  Takeo Kanade,et al.  Visual-inertial UAV attitude estimation using urban scene regularities , 2011, 2011 IEEE International Conference on Robotics and Automation.

[7]  C. Bil,et al.  Horizon Sensing Attitude Stabilisation : A VMC Autopilot Presented to the 18 th International UAV Systems Conference , Bristol , UK , 2003 , .

[8]  Pascal Vasseur,et al.  UAV Attitude estimation by vanishing points in catadioptric images , 2008, 2008 IEEE International Conference on Robotics and Automation.

[9]  Fei-Bin Hsiao,et al.  Complete pose determination for low altitude unmanned aerial vehicle using stereo vision , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Peter G. Ifju,et al.  Vision-guided flight stability and control for micro air vehicles , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Miguel A. Olivares-Méndez,et al.  Omnidirectional vision applied to Unmanned Aerial Vehicles (UAVs) attitude and heading estimation , 2010, Robotics Auton. Syst..

[12]  Shree K. Nayar,et al.  A theory of catadioptric image formation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[13]  A. Price,et al.  Aircraft attitude estimation from horizon video , 2006 .

[14]  Seth J. Teller,et al.  Automatic recovery of relative camera rotations for urban scenes , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[15]  Juan Lopez,et al.  Optical flow angular rate determination , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[16]  Mandyam V. Srinivasan,et al.  A Vision based system for attitude estimation of UAVS , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Michael C. Nechyba,et al.  A vision system for intelligent mission profiles of micro air vehicles , 2004, IEEE Transactions on Vehicular Technology.

[18]  Mandyam V. Srinivasan,et al.  UAV altitude and attitude stabilisation using a coaxial stereo vision system , 2010, 2010 IEEE International Conference on Robotics and Automation.

[19]  Pascal Vasseur,et al.  UAV Attitude Computation by Omnidirectional Vision in Urban Environment , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[20]  Kou-Yuan Huang,et al.  Airborne attitude/ground target location determinations using unscented Kalman filter , 2004, 2004 IEEE Aerospace Conference Proceedings (IEEE Cat. No.04TH8720).

[21]  Jefferey A. Shufelt,et al.  Performance Evaluation and Analysis of Vanishing Point Detection Techniques , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Stephen T. Barnard,et al.  Interpreting Perspective Image , 1983, Artif. Intell..

[23]  Lawrence B. Wolff,et al.  Polarization-Based Material Classification from Specular Reflection , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Peter G. Ifju,et al.  Sky/ground modeling for autonomous MAV flight , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[25]  Vincent Devlaminck,et al.  Segmentation of rough surfaces using a polarization imaging system. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[26]  P. Perona,et al.  Recursive 3-D Visual Motion Estimation Using Subspace Constraints , 1997, International Journal of Computer Vision.

[27]  R. Lind,et al.  State Estimation using Optical Flow from Parallax-Weighted Feature Tracking , 2006 .

[28]  Mandyam V. Srinivasan,et al.  A Bio-Inspired Stereo Vision System for Guidance of Autonomous Aircraft , 2011 .

[29]  Miguel A. Olivares-Méndez,et al.  Unmanned aerial vehicles UAVs attitude, height, motion estimation and control using visual systems , 2010, Auton. Robots.

[30]  Zhihai He,et al.  On the computation of the ego-motion and distance to obstacles for a micro air vehicle , 2006, 2006 American Control Conference.

[31]  Richard J. Prazenica,et al.  Vision-Based State Estimation for Autonomous Micro Air Vehicles , 2004 .

[32]  Mandyam V. Srinivasan,et al.  A stereo vision system for UAV guidance , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Peter G. Ifju,et al.  Vision-guided flight stability and control for micro air vehicles , 2003, Adv. Robotics.

[34]  Hector Rotstein,et al.  Partial Aircraft State Estimation from Visual Motion Using the Subspace Constraints Approach , 2001 .

[35]  Carsten Rother,et al.  A New Approach for Vanishing Point Detection in Architectural Environments , 2000, BMVC.

[36]  P. Perona,et al.  Motion estimation via dynamic vision , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[37]  James H. Elder,et al.  Efficient Edge-Based Methods for Estimating Manhattan Frames in Urban Imagery , 2008, ECCV.

[38]  Pascal Vasseur,et al.  Robust Attitude Estimation with Catadioptric Vision , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Terry Donald Cornall,et al.  Measuring Horizon Angle from Video on a Small Unmanned Air Vehicle , 2004 .

[40]  Rodney A. Walker,et al.  Attitude Estimation for a Fixed-Wing Aircraft Using Horizon Detection and Optical Flow , 2007, 9th Biennial Conference of the Australian Pattern Recognition Society on Digital Image Computing Techniques and Applications (DICTA 2007).

[41]  J.J. Kehoe,et al.  Partial aircraft state estimation from optical flow using non-model-based optimization , 2006, 2006 American Control Conference.

[42]  Zhaoying Zhou,et al.  Towards micro air vehicle flight autonomy research on the method of horizon extraction , 2003, Proceedings of the 20th IEEE Instrumentation Technology Conference (Cat. No.03CH37412).

[43]  Pascal Vasseur,et al.  UAV altitude estimation by mixed stereoscopic vision , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Pascal Vasseur,et al.  Omnidirectional vision on UAV for attitude computation , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[45]  Erdinç Altug,et al.  EKF Based Attitude Estimation and Stabilization of a Quadrotor UAV Using Vanishing Points in Catadioptric Images , 2011, J. Intell. Robotic Syst..

[46]  Bin Xie,et al.  Polarization-based water hazards detection for autonomous off-road navigation , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.