Towards a method for combined model-based testing and analysis

Efficient and effective verification and validation of complex embedded systems is challenging, and requires the use of various tools and techniques, such as model-based testing and analysis. The aim of this paper is to devise an overall method for how analysis and testing may be used in combination to increase the quality of embedded systems, and reduce development cost. The method is centered on a common verification planning and iteratively exploiting the established results to strengthen the verification activities. We conclude that the proposed method is general enough to capture most interesting combinations and workflows, but also that formulation of more specific combination patterns will be useful to encourage future tool collaborations.

[1]  Lori A. Clarke,et al.  A System to Generate Test Data and Symbolically Execute Programs , 1976, IEEE Transactions on Software Engineering.

[2]  Jean-Louis Boulanger.  Industrial Use of Formal Methods: Formal Verification , 2012 .

[3]  Jean-Raymond Abrial,et al.  The B-book - assigning programs to meanings , 1996 .

[4]  Doron A. Peled,et al.  Model checking, testing and verification working together , 2005, Formal Aspects of Computing.

[5]  Jean-Raymond Abrial,et al.  Modeling in event-b - system and software engineering by Jean-Raymond Abrial , 2010, SOEN.

[6]  D.R. Wallace,et al.  Software verification and validation: an overview , 1989, IEEE Software.

[7]  Tony Clark,et al.  Model-driven development - Guest editor's introduction , 2003 .

[8]  Axel Legay,et al.  Statistical Model Checking: An Overview , 2010, RV.

[9]  Avner Engel.  Verification, Validation, and Testing of Engineered Systems: Engel/Verification , 2010 .

[10]  Robert B. France,et al.  Model-driven development using UML 2.0: promises and pitfalls , 2006, Computer.

[11]  Kerstin Eder,et al.  Analysing and Closing Simulation Coverage by Automatic Generation and Verification of Formal Properties from Coverage Reports , 2012, IFM.

[12]  Jeff A. Estefan,et al.  of Model-Based Systems Engineering ( MBSE ) Methodologies , 2008 .

[13]  Alastair F. Donaldson,et al.  Software Model Checking , 2014, Computing Handbook, 3rd ed..

[14]  Michael E. Fagan.  Advances in software inspections , 1986, IEEE Transactions on Software Engineering.

[15]  James C. King,et al.  Symbolic execution and program testing , 1976, CACM.

[16]  Kim G. Larsen,et al.  Checking and Distributing Statistical Model Checking , 2012, NASA Formal Methods.

[17]  A. T. Bahill.  What is systems engineering , 1995 .

[18]  Hanno Wupper,et al.  The Construction of Verification Models for Embedded Systems , 2007 .

[19]  Daniel Kroening,et al.  A Survey of Automated Techniques for Formal Software Verification , 2008, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[20]  Kerstin Eder,et al.  A Design-for-Verification Framework for a Configurable Performance-Critical Communication Interface , 2011, FORMATS.

[21]  Bruno Legeard,et al.  A taxonomy of model‐based testing approaches , 2012, Softw. Test. Verification Reliab..

[22]  Thomas A. Henzinger,et al.  The Discipline of Embedded Systems Design , 2007, Computer.

[23]  Jan Peleska,et al.  Integrated and Automated Abstract Interpretation, Verification and Testing of C/C++ Modules , 2010, Concurrency, Compositionality, and Correctness.

[24]  Harry Foster.  Guidelines for creating a formal verification testplan , 2006 .

[25]  Christel Baier,et al.  Principles of Model Checking (Representation and Mind Series) , 2008 .

[26]  Frank Elberzhager,et al.  A systematic mapping study on the combination of static and dynamic quality assurance techniques , 2012, Inf. Softw. Technol..

[27]  R. Jewett,et al.  Systems Engineering , 1959, IRE Transactions on Military Electronics.

[28]  Kedar S. Namjoshi,et al.  On the completeness of compositional reasoning methods , 2010, TOCL.

[29]  Martin Leucker,et al.  A brief account of runtime verification , 2009, J. Log. Algebraic Methods Program..

[30]  Doron A. Peled,et al.  A Combined Testing and Verification Approach for Software Reliability , 2001, FME.