Multiple targets geolocation using SIFT and stereo vision on airborne video sequences

We propose a robust and accurate method for multi-target geo-localization from airborne video. The difference between our approach and other approaches in the literature is fourfold: 1) it does not require gimbal control of the camera or any particular path planning control for the UAV; 2) it can instantaneously geolocate multiple targets even if they were not previously observed by the camera; 3) it does not require a geo-referenced terrain database nor an altimeter for estimating the UAV's and the target's altitudes; and 4) it requires only one camera, but it employs a multi-stereo technique using the image sequence for increased accuracy in target geo-location. The only requirements for our approach are: that the intrinsic parameters of the camera be known; that the on board camera be equipped with global positioning system (GPS) and inertial measurement unit (IMU); and that enough feature points can be extracted from the surroundings of the target. Since the first two constraints are easily satisfied, the only real requirement is regarding the feature points. However, as we explain later, this last constraint can also be alleviated if the ground is approximately planar. The result is a method that can reach a few meters of accuracy for an UAV flying at a few hundred meters above the ground. Such performance is demonstrated by computer simulation, in-scale data using a model city, and real airborne video with ground truth.

[1]  Avinash C. Kak,et al.  An iterative approach to the hand-eye and base-world calibration problem , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[2]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[3]  Isaac Kaminer,et al.  On Vision-Based Target Tracking and Range Estimation for Small UAVs , 2005 .

[4]  Mark J. Monda,et al.  Ground Target Localization and Tracking in a Riverine Environment from a UAV with a Gimbaled Camera , 2007 .

[5]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[6]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[7]  Timothy W. McLain,et al.  Vision-based Target Geo-location using a Fixed-wing Miniature Air Vehicle , 2006, J. Intell. Robotic Syst..

[8]  George York,et al.  Localization of ground targets using a flying sensor network , 2006, IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing (SUTC'06).

[9]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Avinash C. Kak,et al.  An world-independent approach for the calibration of mobile robotics active stereo heads , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[11]  Rolf Rysdyk,et al.  UAV Path Following for Constant Line-of-Sight , 2003 .

[12]  D. Stevenson,et al.  Flight Results from Tracking Ground Targets Using SeaScan UAVs with Gimballing Cameras , 2007, 2007 American Control Conference.

[13]  Kevin D. Jones,et al.  Vision-based tracking and motion estimation for moving targets using small UAVs , 2006, 2006 American Control Conference.

[14]  Avinash C. Kak,et al.  A subsumptive, hierarchical, and distributed vision-based architecture for smart robotics , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[15]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[16]  S. P. Mudur,et al.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[17]  Joshua D. Redding,et al.  Vision-based target localization from a fixed-wing miniature air vehicle , 2006, 2006 American Control Conference.

[18]  Kwee Chye. Yap.  Incorporating target mensuration system for target motion estimation along a road using asynchronous filter , 2006 .