Towards a Coherent Terminology and Taxonomy for Evaluating Safety via Testing

One common challenge when partners from industry and academia collaborate to determine safety properties of systems, is that terms have different meanings in different domains. This paper provides a collection of relevant terms and explains it in the context of (but not limited to) testing for non-functional properties. The selected terms are connected in a taxonomy, painting the bigger picture, providing relevant references, and connecting the selected terms.

[1]  Matthew Hogan.  Understanding Automotive Reliability and ISO 26262 for Safety Critical Systems , 2014 .

[2]  Christopher Temple,et al.  Avoiding the babbling-idiot failure in a time-triggered communication system , 1998, Digest of Papers. Twenty-Eighth Annual International Symposium on Fault-Tolerant Computing (Cat. No.98CB36224).

[3]  Karl Stj,et al.  Brake by Wire System for Construction Vehicles , 2014 .

[4]  Martin Fränzle,et al.  Confidence Bounds for Statistical Model Checking of Probabilistic Hybrid Systems , 2012, FORMATS.

[5]  J. Armstrong.  Concurrency Oriented Programming in Erlang , .

[6]  Peter J. Denning,et al.  Fault Tolerant Operating Systems , 1976, CSUR.

[7]  Carl E. Landwehr,et al.  Basic concepts and taxonomy of dependable and secure computing , 2004, IEEE Transactions on Dependable and Secure Computing.

[8]  Efim Pelinovsky,et al.  Physical Mechanisms of the Rogue Wave Phenomenon , 2003 .

[9]  L. Shemer,et al.  An experimental study of spatial evolution of statistical parameters in a unidirectional narrow‐banded random wavefield , 2009 .

[10]  Bowen Alpern,et al.  Defining Liveness , 1984, Inf. Process. Lett..

[11]  Ian Sommerville,et al.  Software Engineering (7th Edition) , 2004 .

[12]  Nils Mullner,et al.  Unmasking fault tolerance : Quantifying deterministic recovery dynamics in probabilistic environments , 2014 .

[13]  Marco Bozzano,et al.  Design and Safety Assessment of Critical Systems , 2010 .

[14]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[15]  Barry W. Boehm,et al.  Quantitative evaluation of software quality , 1976, ICSE '76.

[16]  Max Crochemore,et al.  Algorithms and Theory of Computation Handbook , 2010 .

[17]  Edsger W. Dijkstra,et al.  Self-stabilizing systems in spite of distributed control , 1974, CACM.

[18]  Leslie Lamport,et al.  Specifying Systems: The TLA+ Language and Tools for Hardware and Software Engineers [Book Review] , 2002, Computer.

[19]  Peter G. Neumann,et al.  Practical Architectures for Survivable Systems and Networks , 1999 .

[20]  Wasif Afzal,et al.  Metrics in Software Test Planning and Test Design Processes , 2007 .

[21]  Klaus Echtle.  Entwurf von Fehlertoleranz-Verfahren , 1990 .

[22]  Leslie Lamport,et al.  Proving the Correctness of Multiprocess Programs , 1977, IEEE Transactions on Software Engineering.

[23]  Eduardo Pinheiro,et al.  DRAM errors in the wild: a large-scale field study , 2009, SIGMETRICS '09.

[24]  Kishor S. Trivedi.  Probability and Statistics with Reliability, Queuing, and Computer Science Applications , 1984 .

[25]  Shlomi Dolev,et al.  Self Stabilization , 2004, J. Aerosp. Comput. Inf. Commun..