A Controlled Experiment on Coverage Maximization of Automated Model-Based Software Test Cases in the Automotive Industry

In the automotive industry, as the complexity of electronic control units (ECUs) increase, there is a need for the creation of models that facilitate early tests to ensure functionality, but there is little guidance on how to write these tests in order to achieve maximum coverage. Our prototype CANoe+, which builds on the CANoe and GraphWalker tools, was evaluated against CANoe with regard to coverage maximization of generated test cases from the viewpoint of both software developers and software testers.

[1]  S. Ramesh,et al.  An integrated test generation tool for enhanced coverage of Simulink/Stateflow models , 2012, 2012 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[2]  Shari Lawrence Pfleeger,et al.  Experimental design and analysis in software engineering , 1995, Ann. Softw. Eng..

[3]  Lionel C. Briand,et al.  A practical guide for using statistical tests to assess randomized algorithms in software engineering , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[4]  Kai Petersen,et al.  Tester interactivity makes a difference in search-based software testing: A controlled experiment , 2015, Inf. Softw. Technol..

[5]  Thomas Pfeffer,et al.  A quantitative study on automatic validation of the diagnostic services of Electronic Control Units , 2008, 2008 IEEE International Conference on Emerging Technologies and Factory Automation.

[6]  Andrea Martelli,et al.  MaTeLo: Automated Testing Suite for Software Validation , 2003 .

[7]  Nils Niedermark,et al.  Automated Data-driven Validation of the Diagnostic Implementation , 2015 .

[8]  Andreas Krämer,et al.  Model-Based Testing of Automotive Systems , 2008, 2008 1st International Conference on Software Testing, Verification, and Validation.

[9]  Denes Fodor,et al.  Vehicle dynamics based ABS ECU verification on real-time hardware-in-the-loop simulator , 2014, 2014 16th International Power Electronics and Motion Control Conference and Exposition.

[10]  Reinhard German,et al.  Model-Driven Testing based on Markov Chain Usage Models in the Automotive Domain , 2009 .

[11]  Sandeep Sivanandan,et al.  Agile development cycle: Approach to design an effective Model Based Testing with Behaviour driven automation framework , 2014, 20th Annual International Conference on Advanced Computing and Communications (ADCOM).

[12]  Fevzi Belli,et al.  A Graph-Model-Based Testing Method Compared with the Classification Tree Method for Test Case Generation , 2009, 2009 Third IEEE International Conference on Secure Software Integration and Reliability Improvement.

[13]  Robert Eschbach,et al.  “Safety automata” — A new specification language for the development of PLC safety applications , 2012, Proceedings of 2012 IEEE 17th International Conference on Emerging Technologies & Factory Automation (ETFA 2012).

[14]  Alexander Pretschner,et al.  One evaluation of model-based testing and its automation , 2005, ICSE.

[15]  Yi Lin,et al.  Automated test system design of body control module , 2014, 2014 International Conference on Information Science, Electronics and Electrical Engineering.

[16]  Daniel Kroening,et al.  Test-case generation for embedded simulink via formal concept analysis , 2011, 2011 48th ACM/EDAC/IEEE Design Automation Conference (DAC).

[17]  Klaus Lamberg,et al.  Model-based Testing of Embedded Automotive Software Using Mtest , 2004 .

[18]  Franz Wotawa,et al.  Testing methods used in the automotive industry: results from a survey , 2014, JAMAICA 2014.

[19]  Claes Wohlin,et al.  Empirical Research Methods in Web and Software Engineering , 2006, Web Engineering.

[20]  Claes Wohlin,et al.  Experimentation in Software Engineering , 2000, The Kluwer International Series in Software Engineering.

[21]  Winfried Dulz,et al.  MaTeLo - statistical usage testing by annotated sequence diagrams, Markov chains and TTCN-3 , 2003, Third International Conference on Quality Software, 2003. Proceedings..

[22]  Harry Robinson.  Graph Theory Techniques in Model-Based Testing , 1999 .

[23]  Hocine Cherifi,et al.  Digital Information and Communication Technology and Its Applications: International Conference, DICTAP 2011, Dijon, France, June 21-23, 2011. ... in Computer and Information Science) , 2011 .

[24]  Dietmar Pfahl,et al.  Reporting Experiments in Software Engineering , 2008, Guide to Advanced Empirical Software Engineering.

[25]  Harry Robinson,et al.  Applying models in your testing process , 2000, Inf. Softw. Technol..

[26]  Nematollaah Shiri,et al.  Index-based join operations in Hive , 2013, 2013 IEEE International Conference on Big Data.

[27]  Mirko Conrad,et al.  Systematic Model-Based Testing of Embedded Automotive Software , 2004, MBT.