Incorporating ISO 26262 Concepts in an Automated Testing Toolchain Using Simulink Design Verifier

The introduction of ISO 26262 concepts has brought important changes in the software development process for automotive software. While making the process more robust by introducing various additional methods of verification and validation, there has been a substantial increase in the development time. Thus, test automation and front loading approaches have become important to meet product timelines and quality. This paper proposes automated testing methods using formal analysis tools like Simulink Design Verifier™ (SLDV) for boundary value testing and interface testing to address the demands of ISO 26262 concepts at unit and component level. In addition, the method of automated boundary value testing proposed differs from the traditional methods and the authors offer an argument as to why the traditional boundary value testing is not required at unit (function) level. There are two aspects of the proposed method: automated test case generation and automated test case execution. The paper discusses the benefits of automatic test case execution when combined with automatic test case generation. Traditional test automation implements the former and has limited advantages. One of the challenges with traditional application of the formal analysis tool is the time taken by the tool to reach to a conclusive decision for the triggered activity, i.e., the execution time of the tool. This shortcoming is overcome by an automated setup where the test framework is triggered during out of office hours, which saves developer’s work time. As a work product of the automated test execution, the developers receive test documentation which provides them with an overview of the results and specific test vectors for further analysis.

[1]  Klaus Lamberg,et al.  Hardware-in-the-Loop Testing in the Context of ISO 26262 , 2012 .

[2]  Jean-Frédéric Étienne,et al.  Using Simulink Design Verifier for Proving Behavioral Properties on a Complex Safety Critical System in the Ground Transportation Domain , 2010, CSDM.

[3]  Rodrigo Reis,et al.  Using Simulink Design Verifier for Automatic Generation of Requirements-Based Tests , 2015, FM.

[4]  Dietmar P. F. Möller,et al.  Systems and Software Engineering , 2016 .

[5]  Madhura Medikeri,et al.  Automated Verification and Validation Methods for Transmission Control Software , 2015 .

[6]  Ingo Stürmer,et al.  Efficient Testing Framework for Simulink Models with MTCD and Automated Test Assessments in the Context of ISO 26262 , 2014 .

[7]  R. Peter Jones,et al.  A critical analysis of model-based formal verification efforts within the automotive industry , 2008 .

[8]  A. C. Rajeev,et al.  Design Verification of Automotive Controller Models , 2013 .

[9]  Jörg Weber,et al.  ISO 26262 Conformant Verification Plan , 2010, GI Jahrestagung.

[10]  Ciaran MacNamee,et al.  Runtime verification monitoring for automotive embedded systems using the ISO 26262 functional safety standard as a guide for the definition of the monitored properties , 2014, IET Softw..

[11]  Daniel Carlsson Development of an ISO 26262 ASIL D compliant verification system , 2013 .

[12]  Rakesh Rana,et al.  Early Verification and Validation According to ISO 26262 by Combining Fault Injection and Mutation Testing , 2013, ICSOFT.

[13]  Rakesh Rana,et al.  Increasing Efficiency of ISO 26262 Verification and Validation by Combining Fault Injection and Mutation Testing with Model based Development , 2016, ICSOFT.

[14]  Mirko Conrad Verification and Validation According to ISO 26262: A Workflow to Facilitate the Development of High-Integrity Software , 2012 .

[15]  Franz Wotawa,et al.  Testing methods used in the automotive industry: results from a survey , 2014, JAMAICA 2014.