VISION-BASED STATE ESTIMATION FOR UNINHABITED AERIAL VEHICLES USING THE COPLANARITY CONSTRAINT

This paper presents an extension of the previous work by the authors on a vision-based state estimation algorithm for uninhabited aerial vehicles (UAVs) using the implicit extended Kalman filter (IEKF) and the coplanarity (or epipolar) constraint. The coplanarity constraint, a well-known property in the Structure from Motion (SFM) field, has advantages for this application in that the feature point locations in three dimensional spaces do not have to be known and tracked and that feature points can be discarded and acquired as necessary. This reduces the computational load which is important for real time applications such as aircraft control. Advantages of the IEKF are that, in principle, the current estimate uses all previous information, not just the current observations, and that the estimate will propagate forward in an orderly fashion in the case of interrupted or reduced measurements. The dynamics of the aircraft are included in the process model which improves the observability of the states and resolves the SFM scale factor ambiguity. A disadvantage is that the estimator is specific to the particular UAV model. The algorithm was implemented in a numerical simulation and exhibited significant biases in the state estimates. The bias problems were eliminated by zeroing out the small velocity dependent terms in the measurement matrix. The modified estimator was then employed in a UAV simulation to provide feedback to a simple autopilot. The simulation demonstrated that the state estimates provided were sufficiently accurate to allow control of the simulated UAV through successful waypoint navigation.

[1]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[2]  Alex Pentland,et al.  Recursive Estimation of Motion, Structure, and Focal Length , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Eric N. Johnson,et al.  Vision-Only Aircraft Flight Control Methods and Test Results , 2004 .

[4]  A. Hamdan,et al.  Measures of Modal Controllability and Observability for First- and Second-Order Linear Systems , 1989 .

[5]  Pietro Perona,et al.  Reducing "Structure From Motion": A General Framework for Dynamic Vision Part 2: Implementation and Experimental Assessment , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  H. C. Longuet-Higgins,et al.  A computer algorithm for reconstructing a scene from two projections , 1981, Nature.

[7]  Hector Rotstein,et al.  Partial Aircraft State Estimation from Visual Motion Using the Subspace Constraints Approach , 2001 .

[8]  T. Kanade,et al.  Real-time and 3D vision for autonomous small and micro air vehicles , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[9]  J.J. Kehoe,et al.  Partial aircraft state estimation from optical flow using non-model-based optimization , 2006, 2006 American Control Conference.

[10]  Thomas S. Huang,et al.  Theory of Reconstruction from Image Motion , 1992 .

[11]  Stefano Soatto,et al.  Structure from Motion Causally Integrated Over Time , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Peter G. Ifju,et al.  Vision-guided flight stability and control for micro air vehicles , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Richard J. Prazenica,et al.  Vision-Based State Estimation for Autonomous Micro Air Vehicles , 2004 .

[14]  P. Perona,et al.  Motion estimation via dynamic vision , 1996, IEEE Trans. Autom. Control..

[15]  Mohinder S. Grewal,et al.  Kalman Filtering: Theory and Practice Using MATLAB , 2001 .

[16]  Zdzislaw Bubnicki,et al.  Modern Control Theory , 2005 .

[17]  Lester C. Thurow,et al.  Inventing Modern America: From the Microwave to the Mouse , 2001 .

[18]  Pietro Perona,et al.  Reducing "Structure From Motion": A General Framework for Dynamic Vision Part 1: Modeling , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  T P Webb Flight Control System for a Computer Controlled Aircraft with Limited Sensors. , 1985 .

[20]  Richard J. Prazenica,et al.  Effects of Camera Uncertainty on Vision-Based Feedback , 2005 .

[21]  P. Perona,et al.  Recursive 3-D Visual Motion Estimation Using Subspace Constraints , 1997, International Journal of Computer Vision.

[22]  R. Lind,et al.  State Estimation using Optical Flow from Parallax-Weighted Feature Tracking , 2006 .

[23]  Arthur Gelb,et al.  Applied Optimal Estimation , 1974 .

[24]  D. Pines,et al.  Challenges Facing Future Micro-Air-Vehicle Development , 2006 .