A cascaded method to detect aircraft in video imagery

Unmanned Aerial Vehicles (UAVs) have played vital roles recently in both military and non-military applications. One of the reasons UAVs today are unable to routinely fly in US National Airspace (NAS) is because they lack the sense and ability to avoid other aircraft. Although certificates of authorization can be obtained for short-term use, it entails significant delays and bureaucratic hurdles. Therefore, there is a great need to develop a sensing system that is equivalent to or has greater performance than a human pilot operating under Visual Flight Rules (VFR). This is challenging because of the need to detect aircraft out to at least 3 statute miles, while doing so on field-of-regard as large as 30°( vertical) × 220°( horizontal) and within the payload constraints of a medium-sized UAV. In this paper we report on recent progress towards the development of a field deployable sense-and-avoid system and concentrate on the detection and tracking aspect of the system. We tested a number of approaches and chose a cascaded approach that resulted in 100% detection rate (over about 40 approaches) and 98% tracking rate out to 5 statute miles and a false positive rate of 1 every 50 frames. Within a range of 3.75 miles we can achieve nearly 100% tracking rate.

[1]  Kenneth Steiglitz,et al.  Combinatorial Optimization: Algorithms and Complexity , 1981 .

[2]  James F. Arnold,et al.  Detection and tracking of low-observable targets through dynamic programming , 1990 .

[3]  Athanasios Aridgides,et al.  Detecting and tracking low-observable targets using IR , 1990 .

[4]  Shree K. Nayar,et al.  Vision in bad weather , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[5]  Jeffrey W. McCandless,et al.  Detection of aircraft in video sequences using a predictive optical flow algorithm , 1999 .

[6]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[7]  Tarak Gandhi,et al.  Detection of obstacles in the flight path of an aircraft , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[8]  Michael Deschenes,et al.  Detect and Avoid Technology Demonstration , 2002 .

[9]  Michael Deschenes,et al.  Development of a Sense and Avoid System , 2005 .

[10]  Mubarak Shah,et al.  A noniterative greedy algorithm for multiframe point correspondence , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Peter I. Corke,et al.  Image processing algorithms for UAV "sense and avoid" , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[12]  M. Shah,et al.  Object tracking: A survey , 2006, CSUR.

[13]  Sanjiv Singh,et al.  Learning to Detect Aircraft at Low Resolutions , 2008, ICVS.

[14]  Sanjiv Singh,et al.  Prototype Sense-and-Avoid System for UAVs , 2009 .