A Graph-Model-Based Testing Method Compared with the Classification Tree Method for Test Case Generation

In automotive industry, mechanic control units are more and more replaced by electronic devices that are often aggregated in electronic control units (ECU). Systematic testing is one of the preferred industrial validation methods to ensure functionality of those ECUs. It is imperative to reduce the costs and improve the effectiveness of testing by automating the testing process. This paper introduces a model-based testing method using event sequence graphs and compares this approach with the classification tree method which is popular in automotive industry. A case study applies both methods to the formal specification of an adaptive cruise control unit for generation and selection of test cases. To enable a meaningful comparison, test costs and number of faults revealed by both methods will be compared.

[1]  Mirko Conrad.  Systematic Testing of Embedded Automotive Software - The Classification-Tree Method for Embedded Systems (CTM/ES) , 2004, Perspectives of Model-Based Testing.

[2]  T. Kanade.  Model-Based Testing of Reactive Systems , 2005 .

[3]  Peter Jansen,et al.  Verification of Automotive Control Units , 1999, Correct System Design.

[4]  Shaoying Liu,et al.  Generating test data from state‐based specifications , 2003, Softw. Test. Verification Reliab..

[5]  Boris Beizer,et al.  Black Box Testing: Techniques for Functional Testing of Software and Systems , 1996, IEEE Software.

[6]  Neil R. Storey,et al.  Safety-critical computer systems , 1996 .

[7]  Fevzi Belli,et al.  Event‐based modelling, analysis and testing of user interactions: approach and case study , 2006, Softw. Test. Verification Reliab..

[8]  Andreas Krämer,et al.  Systematic testing of the continuous behavior of automotive systems , 2006, SEAS '06.

[9]  Mary Lou Soffa,et al.  Automated test oracles for GUIs , 2000, SIGSOFT '00/FSE-8.

[10]  Jürgen Großmann,et al.  Testing Embedded Control Systems with TTCN-3 , 2007, SEUS.

[11]  Alfred V. Aho,et al.  An optimization technique for protocol conformance test generation based on UIO sequences and rural Chinese postman tours , 1991, IEEE Trans. Commun..

[12]  J. J. Storey.  From memory to monitor-pixel display architectures , 1992 .

[13]  Alexandre Petrenko,et al.  Protocol testing: review of methods and relevance for software testing , 1994, ISSTA '94.

[14]  Axel Hollmann,et al.  Vergleich einer graphenbasierten Methode mit der Klassifikationsbaummethode für die Testfallermittlung anhand einer automotiven Fallstudie , 2008, Software Engineering.

[15]  Peter Neumann,et al.  Safeware: System Safety and Computers , 1995, SOEN.

[16]  Manfred Broy,et al.  Model-Based Testing of Reactive Systems, Advanced Lectures , 2005 .

[17]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[18]  Bernd Bertsche,et al.  Reliability in Automotive and Mechanical Engineering: Determination of Component and System Reliability , 2008 .

[19]  Mirko Conrad,et al.  Systematic Model-Based Testing of Embedded Automotive Software , 2004, MBT.

[20]  Jürgen Großmann,et al.  Continuous TTCN-3: testing of embedded control systems , 2006, SEAS '06.

[21]  Matthias Grochtmann,et al.  Classification trees for partition testing , 1993, Softw. Test. Verification Reliab..