A Concept for Testing Robustness and Safety of the Context-Aware Behaviour of Autonomous Systems

Autonomous systems are used nowadays in more and more sectors from vehicles to domestic robots. They can make decisions on their own or interact with humans, thus their robustness and safety are properties of crucial importance. Due to the adaptive and context-aware nature of these systems, the testing of such properties is especially challenging. In this paper, we propose a model-based testing approach to capture the context and requirements of such systems, to automatically generate test data representing complex situations, and to evaluate test traces and compute test coverage metrics.

[1]  Moritz Tenorth,et al.  KNOWROB — knowledge processing for autonomous personal robots , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Robert C. Michelson Test and Evaluation of Fully Autonomous Micro Air Vehicles , 2008 .

[3]  Stephen Balakirsky,et al.  MOAST and USARSim: a combined framework for the development and testing of autonomous systems , 2006, SPIE Defense + Commercial Sensing.

[4]  Nicolas Rivière,et al.  Mobile Systems from a Validation Perspective: a Case Study , 2007, Sixth International Symposium on Parallel and Distributed Computing (ISPDC'07).

[5]  Zoltán Szatmári,et al.  Ontology-based Test Data Generation using Metaheuristics , 2011, ICINCO.

[6]  Matthias Baldauf,et al.  A survey on context-aware systems , 2007, Int. J. Ad Hoc Ubiquitous Comput..

[7]  L. G. Weiss,et al.  Autonomous robots in the fog of war , 2011, IEEE Spectrum.

[8]  Alonzo Kelly,et al.  Toward Reliable Off Road Autonomous Vehicles Operating in Challenging Environments , 2006, Int. J. Robotics Res..

[9]  Michael Luck,et al.  Evolutionary testing of autonomous software agents , 2009, Autonomous Agents and Multi-Agent Systems.