Robust Test Generation and Coverage for Hybrid Systems

Testing is an important tool for validation of the system design and its implementation. Model-based test generation allows to systematically ascertain whether the system meets its design requirements, particularly the safety and correctness requirements of the system. In this paper, we develop a framework for generating tests from hybrid systems' models. The core idea of the framework is to develop a notion of robust test, where one nominal test can be guaranteed to yield the same qualitative behavior with any other test that is close to it. Our approach offers three distinct advantages. 1) It allows for computing and formally quantifying the robustness of some properties, 2) it establishes a method to quantify the test coverage for every test case, and 3) the procedure is parallelizable and therefore, very scalable. We demonstrate our framework by generating tests for a navigation benchmark application.

[1]  Joel M. Esposito.  Automated test trajectory for hybrid systems , 2003, Proceedings of the 35th Southeastern Symposium on System Theory, 2003..

[2]  Goran Frehse,et al.  PHAVer: algorithmic verification of hybrid systems past HyTech , 2005, International Journal on Software Tools for Technology Transfer.

[3]  Antoine Girard,et al.  Temporal Logic Verification Using Simulation , 2006, FORMATS.

[4]  Ansgar Fehnker,et al.  Benchmarks for Hybrid Systems Verification , 2004, HSCC.

[5]  Antoine Girard,et al.  Approximation Metrics for Discrete and Continuous Systems , 2006, IEEE Transactions on Automatic Control.

[6]  Ian Postlethwaite,et al.  American Control Conference, Minneapolis, USA , 2006 .

[7]  Steven M. LaValle,et al.  Planning algorithms , 2006 .

[8]  Rajeev Alur,et al.  A Temporal Logic of Nested Calls and Returns , 2004, TACAS.

[9]  Ali Jadbabaie,et al.  Safety Verification of Hybrid Systems Using Barrier Certificates , 2004, HSCC.

[10]  Pravin Varaiya,et al.  Ellipsoidal Techniques for Reachability Analysis , 2000, HSCC.

[11]  Michiel van Osch.  Automated Model-Based Testing of X Simulation Models with TorX , 2005, QoSA/SOQUA.

[12]  Ralf Reussner,et al.  Quality of Software Architectures and Software Quality, First International Conference on the Quality of Software Architectures, QoSA 2005 and Second International Workshop on Software Quality, SOQUA 2005, Erfurt, Germany, September 20-22, 2005, Proceedings , 2005, QoSA/SOQUA.

[13]  Max Donath,et al.  American Control Conference , 1993 .

[14]  Oded Maler,et al.  Reachability Analysis via Face Lifting , 1998, HSCC.

[15]  J. Esposito.  Randomized test case generation for hybrid systems: metric selection , 2004, Thirty-Sixth Southeastern Symposium on System Theory, 2004. Proceedings of the.

[16]  Ian M. Mitchell,et al.  Level Set Methods for Computation in Hybrid Systems , 2000, HSCC.

[17]  Rajeev Alur,et al.  Reachability Analysis of Hybrid Systems via Predicate Abstraction , 2002, HSCC.

[18]  Thomas A. Henzinger,et al.  The Algorithmic Analysis of Hybrid Systems , 1995, Theor. Comput. Sci..

[19]  Antoine Girard,et al.  Reachability of Uncertain Linear Systems Using Zonotopes , 2005, HSCC.

[20]  Erin M. Aylward,et al.  Algorithmic search for contraction metrics via SOS programming , 2006, 2006 American Control Conference.

[21]  Insup Lee,et al.  A Temporal Logic Based Theory of Test Coverage and Generation , 2002, TACAS.

[22]  Jirí Srba,et al.  Comparing the Expressiveness of Timed Automata and Timed Extensions of Petri Nets , 2008, FORMATS.

[23]  Insup Lee,et al.  Testing and Monitoring Model-based Generated Program , 2003, Electron. Notes Theor. Comput. Sci..

[24]  B. Krogh,et al.  Reachability analysis of hybrid control systems using reduced-order models , 2004, Proceedings of the 2004 American Control Conference.

[25]  Stefan Kowalewski,et al.  An Evaluation of two Recent Reachability Analysis Tools for Hybrid Systems , 2006, ADHS.

[26]  Michael M. Curtiss,et al.  RRTs for nonlinear, discrete, and hybrid planning and control , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[27]  Jean-Jacques E. Slotine,et al.  On Contraction Analysis for Non-linear Systems , 1998, Autom..

[28]  A. Agung Julius,et al.  Approximate Abstraction of Stochastic Hybrid Automata , 2006, HSCC.

[29]  Maria Domenica Di Benedetto,et al.  Observability of Hybrid Automata by Abstraction , 2006, HSCC.

[30]  Winfried Stefan Lohmiller,et al.  Contraction analysis of nonlinear systems , 1999 .

[31]  Thomas A. Henzinger,et al.  Hybrid Systems: Computation and Control , 1998, Lecture Notes in Computer Science.

[32]  Zdzislaw Bubnicki,et al.  Modern Control Theory , 2005 .