Image processing algorithm for integrated sense and avoid systems

To allow Unmanned Aircraft Systems (UAS) accessing National Airspace System (NAS) "Equivalent levels of safety" to the ones of human vision must be guaranteed. Therefore, an appropriate "Sense and Avoid" technology must be developed that is capable of detecting, tracking, and avoiding obstacles. The Department of Aerospace Engineering at University of Naples has been involved in a project funded by the Italian Aerospace Research Centre (CIRA) for the realization of a prototypical "Obstacle Detection & Identification" (ODID) System. It is installed onboard a Very Light Aircraft (VLA) and it is characterized by a hierarchical sensor configuration in which the radar is the main sensor while EO cameras are the auxiliary ones in order to increase accuracy and data rate so that anti-collision requirements are fulfilled. This paper focuses on the Image Processing algorithm for the panchromatic camera. Among the several techniques listed in literature the edge detection - labeling one resulted as the best compromise in terms of computational load, detection range, false alarm rate, miss detection rate and adaptability at different background luminosity conditions. Moreover it has been customized in order to allow for reliable operation in a wide range of flight and luminance configurations and it has been tested and run on a sequence of real images taken during flight tests. At the end, a table that summarizes those results is presented. Indeed, the output tracking measurements accuracy increases by an order of magnitude with respect to standalone radar one.

[1]  Jason J. Ford,et al.  Airborne vision‐based collision‐detection system , 2011, J. Field Robotics.

[2]  Carlos Orrite Uruñuela,et al.  Detection and classification of football players with automatic generation of models , 2010 .

[3]  Matthew Turk,et al.  View-based interpretation of real-time optical flow for gesture recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[4]  Michael Deschenes,et al.  Development of a Sense and Avoid System , 2005 .

[5]  Domenico Accardo,et al.  Performance Analysis and Design of an Obstacle Detection and Identification System , 2005 .

[6]  Giancarmine Fasano,et al.  Flight Test Results for a Multi Sensor Obstacle Detection and Tracking System for Sense and Avoid Applications , 2009 .

[7]  Shih-Chang Hsia,et al.  Single-object-based segmentation and coding technique for video surveillance system , 2009, J. Electronic Imaging.

[8]  B. Korn,et al.  UAS in civil airspace: Demonstrating “sense and avoid” capabilities in flight trials , 2008, 2008 IEEE/AIAA 27th Digital Avionics Systems Conference.

[9]  Giancarmine Fasano,et al.  Integrated Obstacle Detection System based on Radar and Optical Sensors , 2010 .

[10]  A. Moccia,et al.  A hardware in the loop facility for testing multisensor sense and avoid systems , 2009, 2009 IEEE/AIAA 28th Digital Avionics Systems Conference.

[11]  Giancarmine Fasano,et al.  Data fusion for UAS collision avoidance: results from flight testing , 2011 .

[12]  Patrick,et al.  The ONERA ReSSAC Unmanned Autonomous Helicopter : Visual Air-to-Ground Target Tracking in an Urban Environment , 2010 .

[13]  Experimentally Scoping the Range of UAS Sense and Avoid Capability , 2007 .

[14]  Kunsoo Huh,et al.  Vision-based vehicle detection and tracking algorithm design , 2009 .

[15]  Giancarmine Fasano,et al.  Multi-Sensor-Based Fully Autonomous Non-Cooperative Collision Avoidance System for Unmanned Air Vehicles , 2008, J. Aerosp. Comput. Inf. Commun..

[16]  Wright Patterson Afb,et al.  Test and Integration of a Detect and Avoid System , 2004 .

[17]  Hamid Hassanpour,et al.  Edge Detection Techniques: Evaluations and Comparison , 2008 .

[18]  Sanjiv Singh,et al.  Passive, Long-Range Detection of Aircraft: Towards a Field Deployable Sense and Avoid System , 2009, FSR.

[19]  Domenico Accardo,et al.  Laboratory Test Facility for Simulating a Sense and Avoid Flight System , 2010 .

[20]  Giancarmine Fasano,et al.  An Innovative Procedure for Calibration of Strapdown Electro-Optical Sensors Onboard Unmanned Air Vehicles , 2010, Sensors.

[21]  Omid Shakernia,et al.  Sense and Avoid (SAA) Flight Test and Lessons Learned , 2007 .

[22]  Yanning Zhang,et al.  Clustering method for counting passengers getting in a bus with single camera , 2010 .

[23]  Cheryl Yuhas,et al.  Earth Observations and the Role of UAVs: A Capabilities Assessment , 2006 .