Confidence Assessment Framework for Safety Arguments

Confidence in safety critical systems is often justified by safety arguments. The excessive complexity of systems nowadays introduces more uncertainties for the arguments reviewing. This paper proposes a framework to support the argumentation assessment based on experts’ decision and confidence in the decision for the lowest level claims of the arguments. Expert opinion is extracted and converted in a quantitative model based on Dempster-Shafer theory. Several types of argument and associated formulas are proposed. A preliminary validation of this framework is realized through a survey for safety experts.

[1]  John A. McDermid,et al.  Safety Case Construction and Reuse Using Patterns , 1997, SAFECOMP.

[2]  T. Govier.  A practical study of argument , 1985 .

[3]  Tim Kelly,et al.  Arguing Safety - A Systematic Approach to Managing Safety Cases , 1998 .

[4]  Insup Lee,et al.  Assessing the Overall Suffic iency of Safety Arguments , 2013 .

[5]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[6]  Audun Jøsang,et al.  A Logic for Uncertain Probabilities , 2001, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[7]  Peter G. Bishop,et al.  A Methodology for Safety Case Development , 2000, SSS.

[8]  Jérémie Guiochet,et al.  A Model for Safety Case Confidence Assessment , 2015, SAFECOMP.

[9]  Lukasz Cyra,et al.  Supporting Compliance with Security Standards by Trust Case Templates , 2007, 2nd International Conference on Dependability of Computer Systems (DepCoS-RELCOMEX '07).

[10]  Ewen Denney,et al.  Towards Measurement of Confidence in Safety Cases , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[11]  Rui Wang,et al.  D-S Theory for Argument Confidence Assessment , 2016, BELIEF.

[12]  Lukasz Cyra,et al.  Support for argument structures review and assessment , 2011, Reliab. Eng. Syst. Saf..

[13]  Richard Hawkins,et al.  A New Approach to creating Clear Safety Arguments , 2011, SSS.

[14]  Neil Walkinshaw,et al.  An evidential reasoning approach for assessing confidence in safety evidence , 2015, 2015 IEEE 26th International Symposium on Software Reliability Engineering (ISSRE).

[15]  Insup Lee,et al.  A Systematic Approach to Justifying Sufficient Confidence in Software Safety Arguments , 2012, SAFECOMP.

[16]  Patrick Graydon,et al.  An investigation of proposed techniques for quantifying confidence in assurance arguments , 2017 .

[17]  David Wright,et al.  Confidence: Its Role in Dependability Cases for Risk Assessment , 2007, 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07).