Risk-Based Testing of Safety-Critical Embedded Systems Driven by Fault Tree Analysis

One important aspect of the quality assurance process of safety-critical embedded systems is verifying the appropriateness, correctness of the implementation and effectiveness of safety functions. Due to the rapid growth in complexity, manual verification activities are no longer feasible. This holds especially for testing. A popular method for testing such complex systems is model-based testing. Recent techniques for model-based testing do not sufficiently take into consideration the information derived from the safety analyses like Failure Mode and Effect Analysis and Fault Tree Analyses (FTA). In this paper, we describe an approach to use the results of FTA during the construction of test models, such that test cases can be derived, selected and prioritized according to the severity of the identified risks and the number of basic events that cause it. This approach is demonstrated on an example from the automation domain, namely a modular production system. We find that the method provides a significant increase in coverage of safety functions, compared to regular model based testing.

[1]  Aaas News,et al.  Book Reviews , 1893, Buffalo Medical and Surgical Journal.

[2]  Osamu Mizuno,et al.  Generating test items for checking illegal behaviors in software testing , 2000, Proceedings of the Ninth Asian Test Symposium.

[3]  J. C. Cherniavsky,et al.  Validation through exclusion: techniques for ensuring software safety , 1989, Proceedings of the Fourth Annual Conference on Computer Assurance, 'Systems Integrity, Software Safety and Process Security.

[4]  P. Rodriguez Dapena,et al.  Software safety verification in critical software intensive systems , 2002 .

[5]  Jana Maria Heinsohn,et al.  Einführung in die ISO 26262 "Functional Safety - Road Vehicles" , 2011 .

[6]  H. S. Osborne,et al.  The international electrotechnical commission , 1953, Electrical Engineering.

[7]  W E Vesely,et al.  Fault Tree Handbook , 1987 .

[8]  Felix Redmill,et al.  Exploring risk‐based testing and its implications , 2004, Softw. Test. Verification Reliab..

[9]  M. W. Shields An Introduction to Automata Theory , 1988 .

[10]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[11]  Miguel Felder,et al.  A Systematic Approach to Generate Test Cases based on Faults , 2003 .

[12]  Gang Yu,et al.  Modeling and safety test of safety-critical software , 2010, 2010 IEEE International Conference on Intelligent Computing and Intelligent Systems.

[13]  Felix Redmill Exploring risk-based testing and its implications: Research Articles , 2004 .

[14]  S. Smith,et al.  Functional Safety Of Programmable Electronic Systems , 1990 .

[15]  Mirko Conrad,et al.  Evolutionary safety testing of embedded control software by automatically generating compact test data sequences , 2005 .