Instataneous geo-location of multiple targets from monocular airborne video

We propose a robust and accurate method for multi-target geo-localization from airborne video. The difference between our approach and other approaches in the literature is fourfold: 1) it does not require gimbal control of the camera or any particular path planning control for the UAV; 2) it can instantaneously geo-locate multiple targets even if they were not previously observed by the camera; 3) it does not require a geo-referenced terrain database nor an altimeter for estimating the UAV's and the target's altitudes; and 4) it requires only one camera, but it employs a multi-stereo technique using the image sequence for increased accuracy in target geo-location. The only requirements for our approach are: that the intrinsic parameters of the camera be known; that the on board camera be equipped with global positioning system (GPS) and iner-tial measurement unit (IMU); and that enough feature points can be extracted from the surroundings of the target. Since the first two constraints are easily satisfied, the only real requirement is regarding the feature points. However, as we explain later, this last constraint can also be alleviated if the ground is approximately planar. The result is a method that can reach a few meters of accuracy for an UAV flying at a few hundred meters above the ground. Such performance is demonstrated by computer simulation, in-scale data using a model city, and real airborne video with ground truth.

[1]  Joshua D. Redding,et al.  Vision-based target localization from a fixed-wing miniature air vehicle , 2006, 2006 American Control Conference.

[2]  Kwee Chye. Yap.  Incorporating target mensuration system for target motion estimation along a road using asynchronous filter , 2006 .

[3]  Matthew A. Brown,et al.  Invariant Features from Interest Point Groups , 2002, BMVC.

[4]  Isaac Kaminer,et al.  On Vision-Based Target Tracking and Range Estimation for Small UAVs , 2005 .

[5]  Avinash C. Kak,et al.  A subsumptive, hierarchical, and distributed vision-based architecture for smart robotics , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[6]  Isaac Kaminer,et al.  Vision-Based Tracking and Motion Estimation for Moving Targets Using Small UAVs , 2006 .

[7]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[8]  Timothy W. McLain,et al.  Vision-based Target Geo-location using a Fixed-wing Miniature Air Vehicle , 2006, J. Intell. Robotic Syst..

[9]  D. Stevenson,et al.  Flight Results from Tracking Ground Targets Using SeaScan UAVs with Gimballing Cameras , 2007, 2007 American Control Conference.

[10]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[11]  Rolf Rysdyk,et al.  UAV Path Following for Constant Line-of-Sight , 2003 .

[12]  Guilherme N. DeSouza,et al.  Multiple targets geolocation using SIFT and stereo vision on airborne video sequences , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  George York,et al.  Localization of ground targets using a flying sensor network , 2006, IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (SUTC'06).

[14]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Mark J. Monda,et al.  Ground Target Localization and Tracking in a Riverine Environment from a UAV with a Gimbaled Camera , 2007 .

[16]  Avinash C. Kak,et al.  An iterative approach to the hand-eye and base-world calibration problem , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).