A vision based ensemble approach to velocity estimation for miniature rotorcraft

Successful operation of a miniature rotorcraft relies on capabilities including automated guidance, trajectory following, and teleoperation; all of which require accurate estimates of the vehicle’s body velocities and Euler angles. For larger rotorcraft that operate outdoors, the traditional approach is to combine a highly accurate IMU with GPS measurements. However, for small scale rotorcraft that operate indoors, lower quality MEMS IMUs are used because of limited payload. In indoor applications GPS is usually not available, and state estimates based on IMU measurements drift over time. In this paper, we propose a novel framework for state estimation that combines a dynamic flight model, IMU measurements, and 3D velocity estimates computed from an onboard monocular camera using computer vision. Our work differs from existing approaches in that, rather than using a single vision algorithm to update the vehicle’s state, we capitalize on the strengths of multiple vision algorithms by integrating them into a meta-algorithm for 3D motion estimation. Experiments are conducted on two real helicopter platforms in a laboratory environment for different motion types to demonstrate and evaluate the effectiveness of our approach.

[1]  Gustaf Hendeby,et al.  Using optical flow for filling the gaps in visual-inertial tracking , 2010, 2010 18th European Signal Processing Conference.

[2]  Bernd Krauskopf,et al.  Sensitivity of the Generic Transport Model upset dynamics to time delay , 2014 .

[3]  P. Perona,et al.  Motion estimation via dynamic vision , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[4]  Zhaodan Kong,et al.  Research Infrastructure for Interactive Human- and Autonomous Guidance , 2013, J. Intell. Robotic Syst..

[5]  A.-J. Baerveldt,et al.  A low-cost and low-weight attitude estimation system for an autonomous helicopter , 1997, Proceedings of IEEE International Conference on Intelligent Engineering Systems.

[6]  Gaurav S. Sukhatme,et al.  State estimation of an autonomous helicopter using Kalman filtering , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[7]  Bernard Mettler,et al.  Identification Modeling and Characteristics of Miniature Rotorcraft , 2002 .

[8]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[9]  Bernard Mettler,et al.  System integration of a miniature rotorcraft for aerial tele-operation research , 2011 .

[10]  Richard J. Prazenica,et al.  Vision-Based State Estimation for Autonomous Micro Air Vehicles , 2004 .

[11]  Vijay Kumar,et al.  Vision-based state estimation for autonomous rotorcraft MAVs in complex environments , 2013, 2013 IEEE International Conference on Robotics and Automation.

[12]  Roland Siegwart,et al.  Real-time onboard visual-inertial state estimation and self-calibration of MAVs in unknown environments , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  W. Niehsen,et al.  Information fusion based on fast covariance intersection filtering , 2002, Proceedings of the Fifth International Conference on Information Fusion. FUSION 2002. (IEEE Cat.No.02EX5997).

[14]  Bérénice Mettler,et al.  System Identification Modeling and Flight Characteristics Analysis of Miniature Coaxial Helicopter , 2014 .

[15]  Tarek Hamel,et al.  Robust Nonlinear Observers for Attitude Estimation of Mini UAVs , 2007 .

[16]  P. Perona,et al.  Recursive 3-D Visual Motion Estimation Using Subspace Constraints , 1997, International Journal of Computer Vision.

[17]  R. Lind,et al.  State Estimation using Optical Flow from Parallax-Weighted Feature Tracking , 2006 .

[18]  P DeBitetto,et al.  Vision-Aided Navigation for Small UAVs in GPS-Challenged Environments , 2007 .

[19]  Philippe Martin,et al.  The role of propeller aerodynamics in the model of a quadrotor UAV , 2009, 2009 European Control Conference (ECC).

[20]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[21]  Dave Zachariah,et al.  Self-motion and wind velocity estimation for small-scale UAVs , 2011, 2011 IEEE International Conference on Robotics and Automation.

[22]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[23]  L. Matthies,et al.  Precise Image-Based Motion Estimation for Autonomous Small Body Exploration , 2000 .

[24]  Carlo Tomasi,et al.  Comparison of approaches to egomotion computation , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[26]  Yunhui Liu,et al.  A robust state estimation method against GNSS outage for unmanned miniature helicopters , 2010, 2010 IEEE International Conference on Robotics and Automation.

[27]  Allan D. Jepson,et al.  Subspace methods for recovering rigid motion I: Algorithm and implementation , 2004, International Journal of Computer Vision.

[28]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[29]  Nikos Papanikolopoulos,et al.  Miniature embedded rotorcraft platform for aerial teleoperation experiments , 2009, 2009 17th Mediterranean Conference on Control and Automation.

[30]  Kimon P. Valavanis,et al.  Advances in Unmanned Aerial Vehicles: State of the Art and the Road to Autonomy , 2007 .

[31]  R.D. Quinn,et al.  Biologically inspired self-motion estimation using the fusion of airspeed and optical flow , 2006, 2006 American Control Conference.

[32]  金谷 健一 Statistical optimization for geometric computation : theory and practice , 2005 .

[33]  Roland Siegwart,et al.  Onboard IMU and monocular vision based control for MAVs in unknown in- and outdoor environments , 2011, 2011 IEEE International Conference on Robotics and Automation.

[34]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision: From Images to Geometric Models , 2003 .

[35]  Nicolas Petit,et al.  The Navigation and Control technology inside the AR.Drone micro UAV , 2011 .

[36]  Pini Gurfil,et al.  Aircraft state estimation from visual motion: application of the subspace constraints approach , 2002, 2002 IEEE Position Location and Navigation Symposium (IEEE Cat. No.02CH37284).