See and Avoid Using Onboard Computer Vision

The integration of unmanned aircraft into civil airspace is a complex issue. One key question is whether unmanned aircraft can operate just as safely as their manned counterparts. The absence of a human pilot in unmanned aircraft automatically points to a deficiency that is the lack of an inherent see-and-avoid capability. To date, regulators have mandated that an “equivalent level of safety” be demonstrated before UAVs are permitted to routinely operate in civil airspace. This chapter proposes techniques, methods, and hardware integrations that describe a “sense-and-avoid” system designed to address the lack of a see-and-avoid capability in UAVs.

[1]  Jose M. F. Moura,et al.  Multiframe detector/tracker: optimal performance , 2001 .

[2]  Bo Song,et al.  Gray-scale morphological filter for small-target detection , 2000, SPIE Optics + Photonics.

[3]  Jason J. Ford,et al.  Relative Entropy Rate Based Multiple Hidden Markov Model Approximation , 2010, IEEE Transactions on Signal Processing.

[4]  Rodney A. Walker,et al.  Airborne systems laboratory for automation research , 2010 .

[5]  Tarak Gandhi,et al.  Performance characterization of the dynamic programming obstacle detection algorithm , 2006, IEEE Transactions on Image Processing.

[6]  Krishna R. Pattipati,et al.  Use of measurements from an imaging sensor for precision target tracking , 1989 .

[7]  Tarak Gandhi,et al.  Detection of obstacles in the flight path of an aircraft , 2003 .

[8]  Rama Chellappa,et al.  Performance Characterization of Image Stabilization Algorithms , 1996, Real Time Imaging.

[9]  Lee E. Weiss,et al.  Adaptive Visual Servo Control of Robots , 1983 .

[10]  S. W. Shaw,et al.  Efficient target tracking using dynamic programming , 1993 .

[11]  Samuel J. Davey,et al.  A Comparison of Detection Performance for Several Track-before-Detect Algorithms , 2008, 2008 11th International Conference on Information Fusion.

[12]  Lan Tao,et al.  Detection of spot target in infrared clutter with morphological filter , 1996, Proceedings of the IEEE 1996 National Aerospace and Electronics Conference NAECON 1996.

[13]  Andrea Fusiello,et al.  Image stabilization by features tracking , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[14]  Giancarmine Fasano,et al.  Multi-Sensor-Based Fully Autonomous Non-Cooperative Collision Avoidance System for Unmanned Air Vehicles , 2008, J. Aerosp. Comput. Inf. Commun..

[15]  Yair Barniv,et al.  Dynamic Programming Solution for Detecting Dim Moving Targets , 1985, IEEE Transactions on Aerospace and Electronic Systems.

[16]  Peng Li,et al.  A Novel Hybrid Coarse-to-Fine Digital Image Stabilization Algorithm , 2010 .

[17]  Jyh-Yeong Chang,et al.  Digital image translational and rotational motion stabilization using optical flow technique , 2002, IEEE Trans. Consumer Electron..

[18]  N. A. Shneydor,et al.  Missile guidance and pursuit , 1998 .

[19]  D.R. Maroney,et al.  Experiemntal platforms for evaluating sensor technology for UAS collision avoidance , 2007, 2007 IEEE/AIAA 26th Digital Avionics Systems Conference.

[20]  Peter I. Corke,et al.  Image processing algorithms for UAV "sense and avoid" , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[21]  Hao Wu,et al.  Automatic target detection by optimal morphological filters , 2008, Journal of Computer Science and Technology.

[22]  Sanjiv Singh,et al.  Avoiding Collisions Between Aircraft: State of the Art and Requirements for UAVs operating in Civilian Airspace , 2008 .

[23]  Jason J. Ford,et al.  Vision-based detection and tracking of aerial targets for UAV collision avoidance , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[25]  W. Graham,et al.  Separation of air traffic by visual means: An estimate of the effectiveness of the see-and-avoid doctrine , 1970 .

[26]  David Casasent,et al.  Detection filters and algorithm fusion for ATR , 1997, IEEE Trans. Image Process..

[27]  Meng Hwa Er,et al.  Max-mean and max-median filters for detection of small targets , 1999, Optics & Photonics.

[28]  S. Shankar Sastry,et al.  An Invitation to 3-D Vision , 2004 .

[29]  Jr. G. Forney,et al.  The viterbi algorithm , 1973 .

[30]  T. J. Dennis,et al.  Image sequence stabilisation based on DFT filtering , 2000 .

[31]  Marcelo G. S. Bruno Bayesian methods for multiaspect target tracking in image sequences , 2004, IEEE Transactions on Signal Processing.

[32]  Janusz Konrad,et al.  Motion estimation for region-based video coding , 1995, Proceedings., International Conference on Image Processing.

[33]  N. A. Spencer,et al.  Development and operation of the Traffic Alert and Collision Avoidance System (TCAS) , 1989, Proc. IEEE.

[34]  B.C. Karhoff,et al.  Eyes in the Domestic Sky: An Assessment of Sense and Avoid Technology for the Army's "Warrior" Unmanned Aerial Vehicle , 2006, 2006 IEEE Systems and Information Engineering Design Symposium.

[35]  Robin J. Evans,et al.  Peformance of dynamic programming techniques for Track-Before-Detect , 1996 .

[36]  Zhang Peng,et al.  The design of Top-Hat morphological filter and application to infrared target detection , 2006 .

[37]  Jason J. Ford,et al.  Airborne vision‐based collision‐detection system , 2011, J. Field Robotics.