Real Time Corner Detection for Miniaturized Electro-Optical Sensors Onboard Small Unmanned Aerial Systems

This paper describes the target detection algorithm for the image processor of a vision-based system that is installed onboard an unmanned helicopter. It has been developed in the framework of a project of the French national aerospace research center Office National d’Etudes et de Recherches Aérospatiales (ONERA) which aims at developing an air-to-ground target tracking mission in an unknown urban environment. In particular, the image processor must detect targets and estimate ground motion in proximity of the detected target position. Concerning the target detection function, the analysis has dealt with realizing a corner detection algorithm and selecting the best choices in terms of edge detection methods, filtering size and type and the more suitable criterion of detection of the points of interest in order to obtain a very fast algorithm which fulfills the computation load requirements. The compared criteria are the Harris-Stephen and the Shi-Tomasi, ones, which are the most widely used in literature among those based on intensity. Experimental results which illustrate the performance of the developed algorithm and demonstrate that the detection time is fully compliant with the requirements of the real-time system are discussed.

[1]  Ellen C. Hildreth,et al.  Edge Detection , 1985, Encyclopedia of Database Systems.

[2]  Krzysztof Kuchcinski,et al.  The WITAS Unmanned Aerial Vehicle Project , 2000, ECAI.

[3]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[4]  Larry S. Davis,et al.  Hydra: multiple people detection and tracking using silhouettes , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[5]  U. Seeger,et al.  Fast corner detection in grey-level images , 1994, Pattern Recognit. Lett..

[6]  Jitendra Malik,et al.  A real-time computer vision system for measuring traffic parameters , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Patrick,et al.  The ONERA ReSSAC Unmanned Autonomous Helicopter : Visual Air-to-Ground Target Tracking in an Urban Environment , 2010 .

[8]  F. Harris.  On the use of windows for harmonic analysis with the discrete Fourier transform , 1978, Proceedings of the IEEE.

[9]  S. Sastry,et al.  Autonomous Exploration in Unknown Urban Environments for Unmanned Aerial Vehicles , 2005 .

[10]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[11]  Gonzalo Pajares,et al.  Image-Based Airborne Sensors: A Combined Approach for Spectral Signatures Classification through Deterministic Simulated Annealing , 2009, Sensors.

[12]  William K. Pratt,et al.  Digital image processing (2nd ed.) , 1991 .

[13]  Han Wang,et al.  Real-time corner detection algorithm for motion estimation , 1995, Image Vis. Comput..

[14]  Guy Le Besnerais,et al.  Comparison of Terrain Characterization Methods for Autonomous UAVs , 2009 .

[15]  Edwin Olson,et al.  A General Purpose Feature Extractor for Light Detection and Ranging Data , 2010, Sensors.

[16]  Stephen M. Smith,et al.  ASSET-2: Real-Time Motion Segmentation and Shape Tracking , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Mark Hedley,et al.  Fast corner detection , 1998, Image Vis. Comput..

[18]  Francis Y. Enomoto,et al.  UAV Autonomous Operations for Airborne Science Missions , 2004 .

[19]  Juan López,et al.  Wildfire monitoring using a mixed air-ground mobile network , 2010, IEEE Pervasive Computing.

[20]  Aníbal Ollero,et al.  Automatic Forest-Fire Measuring Using Ground Stations and Unmanned Aerial Systems , 2011, Sensors.

[21]  B. Bethke,et al.  Real-time indoor autonomous vehicle test environment , 2008, IEEE Control Systems.

[22]  Tomaso A. Poggio,et al.  On Edge Detection , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Marcel Bergerman,et al.  Cascaded position and heading control of a robotic helicopter , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Giancarmine Fasano,et al.  An Innovative Procedure for Calibration of Strapdown Electro-Optical Sensors Onboard Unmanned Air Vehicles , 2010, Sensors.

[25]  Randal W. Beard,et al.  Cooperative forest fire monitoring using multiple UAVs , 2007, 2007 46th IEEE Conference on Decision and Control.

[26]  Dave Hale,et al.  Recursive Gaussian filters , 2006 .

[27]  Gonzalo Pajares,et al.  Environmental surface boundary tracking and description using a UAV with vision , 2009, 2009 IEEE Conference on Emerging Technologies & Factory Automation.

[28]  Proceedings of the Alvey Vision Conference, AVC 1989, Reading, UK, September, 1989 , 1989, Alvey Vision Conference.

[29]  Sonia Martínez,et al.  Monitoring Environmental Boundaries With a Robotic Sensor Network , 2006, IEEE Transactions on Control Systems Technology.

[30]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.