Test-case generation for embedded simulink via formal concept analysis

Mutation testing suffers from the high computational cost of automated test-vector generation, due to the large number of mutants that can be derived from programs and the cost of generating test-cases in a white-box manner. We propose a novel algorithm for mutation-based test-case generation for Simulink models that combines white-box testing with formal concept analysis. By exploiting similarity measures on mutants, we are able to effectively generate small sets of short test-cases that achieve high coverage on a collection of Simulink models from the automotive domain. Experiments show that our algorithm performs significantly better than random testing or simpler mutation-testing approaches.

[1]  Stephan Merz,et al.  Model Checking , 2000 .

[2]  A. Kuehlmann,et al.  Combinational and sequential equivalence checking , 2001 .

[3]  D.P. Siewiorek,et al.  Testing of digital systems , 1981, Proceedings of the IEEE.

[4]  Enrico Giunchiglia,et al.  Automatic Test Generation for Coverage Analysis Using CBMC , 2009, EUROCAST.

[5]  John A. Clark,et al.  A search-based framework for automatic testing of MATLAB/Simulink models , 2008, J. Syst. Softw..

[6]  S. Ramesh,et al.  AutoMOTGen: Automatic Model Oriented Test Generator for Embedded Control Systems , 2008, CAV.

[7]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[8]  Gregg Rothermel,et al.  Interactive fault localization techniques in a spreadsheet environment , 2006, IEEE Transactions on Software Engineering.

[9]  A Jeeerson Ooutt,et al.  Subsumption of Condition Coverage Techniques by Mutation Testing , 1996 .

[10]  Prasad Bokil,et al.  Masking Boundary Value Coverage: Effectiveness and Efficiency , 2010, TAIC PART.

[11]  Mark Harman,et al.  An Analysis and Survey of the Development of Mutation Testing , 2011, IEEE Transactions on Software Engineering.

[12]  L. Beran,et al.  [Formal concept analysis]. , 1996, Casopis lekaru ceskych.

[13]  Sanjit A. Seshia,et al.  A Theory of Mutations with Applications to Vacuity, Coverage, and Fault Tolerance , 2008, 2008 Formal Methods in Computer-Aided Design.

[14]  Daniel Kroening,et al.  Mutation-Based Test Case Generation for Simulink Models , 2009, FMCO.

[15]  Helmut Veith,et al.  FShell: Systematic Test Case Generation for Dynamic Analysis and Measurement , 2008, CAV.

[16]  Daniel Kroening,et al.  A Tool for Checking ANSI-C Programs , 2004, TACAS.

[17]  Niraj K. Jha,et al.  Testing of Digital Systems , 2003 .

[18]  Bernhard Ganter,et al.  Formal Concept Analysis , 2013 .