Representing Confidence in Assurance Case Evidence

When evaluating assurance cases, being able to capture the confidence one has in the individual evidence nodes is crucial, as these values form the foundation for determining the confidence one has in the assurance case as a whole. Human opinions are subjective, oftentimes with uncertainty—it is difficult to capture an opinion with a single probability value. Thus, we believe that a distribution best captures a human opinion such as confidence. Previous work used a doubly-truncated normal distribution or a Dempster-Shafer theory-based belief mass to represent confidence in the evidence nodes, but we argue that a beta distribution is more appropriate. The beta distribution models a variety of shapes and we believe it provides an intuitive way to represent confidence. Furthermore, there exists a duality between the beta distribution and subjective logic, which can be exploited to simplify mathematical calculations. This paper is the first to apply this duality to assurance cases.

[1]  James Inge Defence Standard 00-56 Issue 4: Safety Management Requirements for Defence Systems , 2007 .

[2]  Lukasz Cyra,et al.  Supporting Expert Assessment of Argument Structures in Trust Cases , 2008 .

[3]  Edgar C Merkle,et al.  The disutility of the hard-easy effect in choice confidence , 2009, Psychonomic bulletin & review.

[4]  Silja Renooij,et al.  Probability elicitation for belief networks: issues to consider , 2001, The Knowledge Engineering Review.

[5]  Jakub Miler,et al.  Supporting Assurance by Evidence-Based Argument Services , 2012, SAFECOMP Workshops.

[6]  Fabio Gagliardi Cozman,et al.  Axiomatizing Noisy-OR , 2004, ECAI.

[7]  David Wright,et al.  Toward a Formalism for Conservative Claims about the Dependability of Software-Based Systems , 2011, IEEE Transactions on Software Engineering.

[8]  Norman E. Fenton,et al.  Using Ranked Nodes to Model Qualitative Judgments in Bayesian Networks , 2007, IEEE Transactions on Knowledge and Data Engineering.

[9]  Steven P. Miller,et al.  Applicability of modified condition/decision coverage to software testing , 1994, Softw. Eng. J..

[10]  Anthony O'Hagan,et al.  Eliciting expert beliefs in substantial practical applications , 1998 .

[11]  Walter Stechele,et al.  Forensic reasoning upon pre-obtained surveillance metadata using uncertain spatio-temporal rules and subjective logic , 2010, 11th International Workshop on Image Analysis for Multimedia Interactive Services WIAMIS 10.

[12]  Silja Renooij,et al.  How to Elicit Many Probabilities , 1999, UAI.

[13]  T. Kurfess,et al.  Sampling uncertainty in coordinate measurement data analysis , 1998 .

[14]  Karin Baier,et al.  The Uses Of Argument , 2016 .

[15]  Richard Hawkins,et al.  A New Approach to creating Clear Safety Arguments , 2011, SSS.

[16]  Audun Jøsang,et al.  Trust network analysis with subjective logic , 2006, ACSC.

[17]  Orin S. Kerr Why Courts Should Not Quantify Probable Cause , 2011 .

[18]  A. Jøsang,et al.  Filtering Out Unfair Ratings in Bayesian Reputation Systems , 2004 .

[19]  Insup Lee,et al.  Assessing the Overall Sufficiency of Safety Arguments , 2013 .

[20]  A. Jøsang Artificial Reasoning with Subjective Logic , 2008 .

[21]  WILLIAM J. STUNTZ THE POLITICAL HEART OF CRIMINAL PROCEDURE : ESSAYS ON THEMES OF , 2011 .

[22]  Audun Jøsang,et al.  Dirichlet Reputation Systems , 2007, The Second International Conference on Availability, Reliability and Security (ARES'07).

[23]  Chris Hobbs,et al.  The Application of Bayesian Belief Networks to Assurance Case Preparation , 2012, SSS.

[24]  Marek J. Druzdzel,et al.  Elicitation of Probabilities for Belief Networks: Combining Qualitative and Quantitative Information , 1995, UAI.

[25]  Ewen Denney,et al.  Towards Measurement of Confidence in Safety Cases , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[26]  Insup Lee,et al.  Reasoning About Confidence and Uncertainty in Assurance Cases: A Survey , 2014, FHIES/SEHC.

[27]  David A. Skeel,et al.  The political heart of criminal procedure : essays on themes of William J. Stuntz , 2011 .