Early Verification and Validation According to ISO 26262 by Combining Fault Injection and Mutation Testing

Today software is core part of modern automobiles. The amount, complexity and importance of software components within Electrical/Electronics (E/E) systems of modern cars is only increasing with time. Several automotive functions carrying software provide or interact with safety critical systems such as systems steering and braking and thus assuring functional safety for such systems is of high importance. Requirements for the safety assurance are specified partially by such functional safety standards as ISO 26262. The standard provides the framework and guidelines for the development of hardware and software for components deemed to be safety critical. In this chapter we argue that traditional approaches for safety assurance such as fault injection and mutation testing can be adapted and applied to functional models to enable early verification and validation according to the requirements of ISO 26262. We show how to use fault injection in combination with mutation based testing to identify defects early in the development process - both theoretically and on a case of self-driving miniature vehicles. The argument is grounded upon the current best practices within the industry, a study of ISO 26262 standard, and academic and industrial case studies using fault injection and mutation based testing applied to the functional model level. In this paper we also provide the initial validation of this approach using software of a self-driving miniature vehicle.

[1]  Christian Berger,et al.  COTS-Architecture with a Real-Time OS for a Self-Driving Miniature Vehicle , 2013, ASCoMS@SAFECOMP.

[2]  Barry Boehm,et al.  Top 10 list [software development] , 2001 .

[3]  Raoul Velazco,et al.  A Survey on Fault Injection Techniques , 2004, Int. Arab J. Inf. Technol..

[4]  Daniel Kroening,et al.  Mutation-Based Test Case Generation for Simulink Models , 2009, FMCO.

[5]  Edward L. Jones,et al.  Integrating testing into the curriculum — arsenic in small doses , 2001, SIGCSE '01.

[6]  H Fennel,et al.  Achievements and exploitation of the AUTOSAR development partnership , 2006 .

[7]  Andrew Plummer,et al.  Model-in-the-Loop Testing , 2006 .

[8]  Frank D. Valencia,et al.  Formal Methods for Components and Objects , 2002, Lecture Notes in Computer Science.

[9]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[10]  J.H. Andrews,et al.  Is mutation an appropriate tool for testing experiments? [software testing] , 2005, Proceedings. 27th International Conference on Software Engineering, 2005. ICSE 2005..

[11]  Miroslaw Staron,et al.  A Light-Weight Defect Classification Scheme for Embedded Automotive Software and Its Initial Evaluation , 2012, 2012 IEEE 23rd International Symposium on Software Reliability Engineering.

[12]  J. Vinter,et al.  FISCADE - A Fault Injection Tool for SCADE Models , 2007 .

[13]  David Clark,et al.  Safety and Security Analysis of Object-Oriented Models , 2002, SAFECOMP.

[14]  Bernhard Schätz Certification of Embedded Software - Impact of ISO DIS 26262 in the Automotive Domain , 2010, ISoLA.

[15]  Henrik Eriksson,et al.  MODIFI: A MODel-Implemented Fault Injection Tool , 2010, SAFECOMP.

[16]  B. Boehm Defect Reduction Top 10 List , 2001 .

[17]  Mark Harman,et al.  An Analysis and Survey of the Development of Mutation Testing , 2011, IEEE Transactions on Software Engineering.

[18]  Christian Berger,et al.  Model-based, composable simulation for the development of autonomous miniature vehicles , 2013, SpringSim.

[19]  Rudolf van Megen,et al.  Costs and benefits of early defect detection: experiences from developing client server and host applications , 1995, Software Quality Journal.

[20]  Klaus D. Müller-Glaser,et al.  ISO/DIS 26262 in the Context of Electric and Electronic Architecture Modeling , 2010, ISARCS.

[21]  Rakesh Rana,et al.  Increasing Efficiency of ISO 26262 Verification and Validation by Combining Fault Injection and Mutation Testing with Model based Development , 2016, ICSOFT.

[22]  A. Jefferson Offutt,et al.  Investigations of the software testing coupling effect , 1992, TSEM.

[23]  Lionel C. Briand,et al.  Is mutation an appropriate tool for testing experiments? , 2005, ICSE.

[24]  Herbert Hanselmann,et al.  Challenges in automotive software engineering , 2008, ICSE Companion '08.