Automated Verification and Validation of an Onboard Mission Planning and Execution System for UAVs

Automated mission planning is one of the key components of an autonomous UAV. The software validation and verification for such decisional autonomy functions is a challenging problem. The software component includes the closed loop vehicle control as well as environment perception. As this is a safety-critical software component, it is important that this software works safely and within projected performance boundaries. This paper discusses the verification and validation approach for the sampling-based mission planner of an unmanned rotorcraft. A layered test strategy is presented, which utilizes different testing methods that complement and build upon each other. Its strengths as well as the possible improvement directions of this approach are discussed. An emphasis is given on automated software-in-the-loop simulations. The approach additionally utilizes benchmarks to assess the implementation performance and real time properties. Finally, to be able to assess the overall test quality, a set of different scalable test abstractions (SUT size, test effort, level of automation, coverage, test complexity and feedback time) is used to analyze the presented strategy.

[1]  Yu-Wen Tung,et al.  Automating test case generation for the new generation mission software system , 2000, 2000 IEEE Aerospace Conference. Proceedings (Cat. No.00TH8484).

[2]  Hui-Min Huang,et al.  Autonomy Levels For Unmanned Systems (ALFUS) framework, volume I :: terminology version 2.1 , 2008 .

[3]  Bernard Mettler,et al.  Benchmarking of obstacle field navigation algorithms for autonomous helicopters , 2010 .

[4]  Charles Pecheur Verification and Validation of Autonomy Software at NASA , 2000 .

[5]  Riley Duren Validation and verification of deep-space missions , 2004 .

[6]  Barry W. Boehm,et al.  A spiral model of software development and enhancement , 1986, Computer.

[7]  Erann Gat,et al.  Experiences with an architecture for intelligent, reactive agents , 1997, J. Exp. Theor. Artif. Intell..

[8]  Yannick Moy,et al.  Testing or Formal Verification: DO-178C Alternatives and Industrial Experience , 2013, IEEE Software.

[9]  G. Brat,et al.  Challenges in verification and validation of autonomous systems for space exploration , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[10]  Florian-Michael Adolf,et al.  Software Verification Considerations for the ARTIS Unmanned Rotorcraft , 2013 .

[11]  Frank Thielecke,et al.  Intelligent Systems Research Using a Small Autonomous Rotorcraft , 2003 .

[12]  Colin Flanagan,et al.  SUBSUMPTION ARCHITECTURE FOR THE CONTROL OF ROBOTS , 2000 .

[13]  Luca Maria Gambardella,et al.  Solving symmetric and asymmetric TSPs by ant colonies , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[14]  Tim Menzies,et al.  Verification and Validation and Artificial Intelligence , 2005, Adv. Comput..

[15]  Johann C. Dauer,et al.  Modular Simulation Framework for Unmanned Aircraft Systems , 2013 .

[16]  Per Olof Pettersson,et al.  Sampling-based Path Planning for an Autonomous Helicopter , 2006 .

[17]  John M. Rushby,et al.  New challenges in certification for aircraft software , 2011, 2011 Proceedings of the Ninth ACM International Conference on Embedded Software (EMSOFT).

[18]  Stephen A. Jacklin Certification of Safety-Critical Software Under DO-178C and DO-278A , 2012, Infotech@Aerospace.

[19]  Karen Gundy-Burlet Validation and Verification of LADEE Models and Software , 2013 .

[20]  Zhaodan Kong,et al.  A Survey of Motion Planning Algorithms from the Perspective of Autonomous UAV Guidance , 2010, J. Intell. Robotic Syst..

[21]  Patrick Cousot,et al.  Static Analysis and Verification of Aerospace Software by Abstract Interpretation , 2010, Found. Trends Program. Lang..

[22]  Janet M. Twomey,et al.  Validation and Verification , 1997 .

[23]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[24]  Florian-Michael Adolf,et al.  PROBABILISTIC ROADMAPS AND ANT COLONY OPTIMIZATION FOR UAV MISSION PLANNING , 2007 .

[25]  Florian-Michael Adolf,et al.  A Sequence Control System for Onboard Mission Management of an Unmanned Helicopter , 2007 .

[26]  R.M. Duren Validation (not just verification) of deep space missions , 2006, 2006 IEEE Aerospace Conference.