Performance prediction and selection of aerial perception functions during UAV missions

The increasing automation of unmanned aerial vehicles (UAV) for versatile mission scenarios claims the challenge of implementing sophisticated perception functions. Thereby, environmental conditions (e.g. weather conditions or landscape changes) affect the performance of such functions for navigational (e.g. sense & avoid) or surveillance (e.g. object detection or tracking) purposes. This paper proposes an algorithm selection method to maintain the overall performance for surveillance missions. The algorithm selection method uses fuzzy inference systems (FIS) trained on example data to predict the perception functions performance under different environmental conditions. The experimental setup comprises four different ground vehicle detection algorithms evaluated on an example observation mission. The results show that the method is able to estimate the algorithms performance and increases the overall performance over mission time compared with using only one algorithm.

[1]  E. H. Mamdani,et al.  An Experiment in Linguistic Synthesis with a Fuzzy Logic Controller , 1999, Int. J. Man Mach. Stud..

[2]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[3]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Il Hong Suh,et al.  Ontology-Based Unified Robot Knowledge for Service Robots in Indoor Environments , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[5]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[6]  Peter Stütz,et al.  Prototyping and training of computer vision algorithms in a synthetic UAV mission test bed , 2014 .

[7]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[8]  Terrence Fong,et al.  Vehicle detection from aerial imagery , 2011, 2011 IEEE International Conference on Robotics and Automation.

[9]  Frédéric Jurie,et al.  Vehicle detection in aerial imagery : A small target detection benchmark , 2016, J. Vis. Commun. Image Represent..

[10]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[11]  M. Eichner,et al.  Autonomous Real-time Vehicle Detection from a Medium-Level UAV , 2009 .

[12]  Moritz Tenorth,et al.  KNOWROB — knowledge processing for autonomous personal robots , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Peter Stütz,et al.  Airborne sensor and perception management: A conceptual approach for surveillance UAS , 2012, 2012 15th International Conference on Information Fusion.

[14]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  N. Georganas,et al.  A comparison of Mamdani and Sugeno fuzzy inference systems for evaluating the quality of experience of Hapto-Audio-Visual applications , 2008, 2008 IEEE International Workshop on Haptic Audio visual Environments and Games.

[16]  Moritz Tenorth,et al.  KnowRob: A knowledge processing infrastructure for cognition-enabled robots , 2013, Int. J. Robotics Res..

[17]  James J. Little,et al.  Play and Learn: Using Video Games to Train Computer Vision Models , 2016, BMVC.

[18]  Vladlen Koltun,et al.  Playing for Data: Ground Truth from Computer Games , 2016, ECCV.

[19]  Jonathan Cepeda-Negrete,et al.  Automatic selection of color constancy algorithms for dark image enhancement by fuzzy rule-based reasoning , 2015, Appl. Soft Comput..

[20]  Sebastian Türmer,et al.  Car detection in low frame-rate aerial imagery of dense urban areas , 2014 .

[21]  Nassir Navab,et al.  Edge-Based Template Matching with a Harmonic Deformation Model , 2008, VISIGRAPP.

[22]  Rudolf Kruse,et al.  Neuro-fuzzy systems for function approximation , 1999, Fuzzy Sets Syst..

[23]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[24]  Alun D. Preece,et al.  An Ontology-Centric Approach to Sensor-Mission Assignment , 2008, EKAW.

[25]  Jae-Young Choi,et al.  Vehicle Detection from Aerial Images Using Local Shape Information , 2009, PSIVT.

[26]  John R. Rice,et al.  The Algorithm Selection Problem , 1976, Adv. Comput..

[27]  Eoin O'Mahony,et al.  Using Case-based Reasoning in an Algorithm Portfolio for Constraint Solving ? , 2008 .

[28]  Peter Stütz,et al.  Application of a probabilistic market-based approach in UAV sensor & perception management , 2013, Proceedings of the 16th International Conference on Information Fusion.

[29]  Quan Sun,et al.  Pairwise meta-rules for better meta-learning-based algorithm ranking , 2013, Machine Learning.

[30]  Miguel A. Olivares-Méndez,et al.  Context-based selection and execution of robot perception graphs , 2015, 2015 IEEE 20th Conference on Emerging Technologies & Factory Automation (ETFA).

[31]  Kate Smith-Miles,et al.  Cross-disciplinary perspectives on meta-learning for algorithm selection , 2009, CSUR.

[32]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[33]  Padraig Cunningham,et al.  A Taxonomy of Similarity Mechanisms for Case-Based Reasoning , 2009, IEEE Transactions on Knowledge and Data Engineering.