Validating a UAV artificial intelligence control system using an autonomous test case generator

The validation of safety-critical applications, such as autonomous UAV operations in an environment which may include human actors, is an ill posed problem. To confidence in the autonomous control technology, numerous scenarios must be considered. This paper expands upon previous work, related to autonomous testing of robotic control algorithms in a two dimensional plane, to evaluate the suitability of similar techniques for validating artificial intelligence control in three dimensions, where a minimum level of airspeed must be maintained. The results of human-conducted testing are compared to this automated testing, in terms of error detection, speed and testing cost.

[1]  Victor W. Marek,et al.  Computing with Default Logic , 1999, Artif. Intell..

[2]  Jonathan Schaeffer,et al.  The challenge of poker , 2002, Artif. Intell..

[3]  Ioan Salomie,et al.  A Hybrid Firefly-inspired Approach for Optimal Semantic Web Service Composition , 2011, Scalable Comput. Pract. Exp..

[4]  Franz Wotawa,et al.  Debugging and test case generation using constraints and mutations , 2011, 2011 Proceedings of the Ninth International Workshop on Intelligent Solutions in Embedded Systems.

[5]  Sami M. Halawani Safety Issues of Computer Failure , 2005, Egypt. Comput. Sci. J..

[6]  Nancy G. Leveson,et al.  Medical Devices: the Therac-25 , 1985 .

[7]  Tecnica aeronautica e spaziale Mars Climate Orbiter , 2010 .

[8]  Jeremy Straub,et al.  A Characterization of the Utility of Using Artificial Intelligence to Test Two Artificial Intelligence Systems , 2013, Comput..

[9]  Xin-She Yang,et al.  Cuckoo Search via Lévy flights , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[10]  Jeremy Straub,et al.  A Human Proximity Operations System test case validation approach , 2013, 2013 IEEE Aerospace Conference.

[11]  Hamed Shah-Hosseini,et al.  Problem solving by intelligent water drops , 2007, 2007 IEEE Congress on Evolutionary Computation.