A Functional Testing Approach for Hybrid Safety Properties with Incomplete Information

This paper proposes a functional testing approach for safety properties formalized as hybrid automata. We first propose a formalism inspired from the concept of operational profile to specify test requirements for hybrid automata. We propose an associated parametric adequacy criterion that measures to what extent a given test suite satisfies these requirements. We also develop a set of hypothesis under which the proposed criterion can be evaluated when testing from a black box system when time is discretized and some signals of the automaton are not observable on the concrete system under test. We finally present the HyATT tool prototype that was developed to implement the proposed approach, and report practical feedback of applying it on a case study.

[1]  Vijay Kumar,et al.  An RRT-Based Algorithm for Testing and Validating Multi-Robot Controllers , 2005, Robotics: Science and Systems.

[2]  Tarik Nahhal,et al.  Using Disparity to Enhance Test Generation for Hybrid Systems , 2008, TestCom/FATES.

[3]  Pravin Varaiya,et al.  What's decidable about hybrid automata? , 1995, STOC '95.

[4]  Hong Zhu,et al.  Software unit test coverage and adequacy , 1997, ACM Comput. Surv..

[5]  Ioannis Parissis,et al.  Automatic generation of test data generators for synchronous programs: Lutess V2 , 2007, DOSTA '07.

[6]  15th International Symposium on Software Reliability Engineering (ISSRE 2004), 2-5 November 2004, Saint-Malo, Bretagne, France , 2004, ISSRE.

[7]  John D. Musa,et al.  Operational profiles in software-reliability engineering , 1993, IEEE Software.

[8]  Michiel van Osch Hybrid Input-Output Conformance and Test Generation , 2006, FATES/RV.

[9]  Jeffrey M. Voas,et al.  Toward a More Reliable Theory of Software Reliability , 2000, Computer.

[10]  Kim G. Larsen,et al.  Distances for Weighted Transition Systems: Games and Properties , 2011, QAPL.

[11]  Jan Tretmans,et al.  Model Based Testing with Labelled Transition Systems , 2008, Formal Methods and Testing.

[12]  Mariëlle Stoelinga,et al.  A Semantic Framework for Test Coverage , 2006, ATVA.

[13]  Nancy A. Lynch,et al.  Hybrid I/O automata , 1995, Inf. Comput..

[14]  Eric Thiémard,et al.  An Algorithm to Compute Bounds for the Star Discrepancy , 2001, J. Complex..

[15]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[16]  Kim G. Larsen,et al.  Monitoring Dynamical Signals While Testing Timed Aspects of a System , 2011, ICTSS.