Exploration of Quantitative Assessment in Systems Architecture using Evidential Reasoning

A key issue in successful developing complex systems is how to assess the performance of architecture model during the development process. Traditional assessment techniques are subjective and usually highlight weaknesses rather than provide quantitative and objective results. In addition, the increasing complexity of systems nowadays; has led to a move from federated systems which were closed and target unique to embedded open systems, which extends new criteria to be considered in the assessment. This paper provides an insight into how Evidential Reasoning (ER) approach as the specific Multi-Attribute Decision Making (MADM) method can be used as a type of system assessment technique. The theory and implementation details of ER with an initial case study are presented.

[1]  Jian-Bo Yang,et al.  Rule and utility based evidential reasoning approach for multiattribute decision analysis under uncertainties , 2001, Eur. J. Oper. Res..

[2]  John A. McDermid,et al.  High Level Failure Analysis for Integrated Modular Avionics , 2001, SCS.

[3]  H. Raiffa,et al.  Decisions with Multiple Objectives , 1993 .

[4]  Jian-Bo Yang,et al.  Nonlinear information aggregation via evidential reasoning in multiattribute decision analysis under uncertainty , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[5]  Mario R. Barbacci.  SEI Architecture Analysis Techniques and When to Use them , 2002 .

[6]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[7]  Jian-Bo Yang,et al.  The evidential reasoning approach for multiple attribute decision analysis using interval belief degrees , 2006, Eur. J. Oper. Res..

[8]  Paul Clements,et al.  The U.S. Army's Common Avionics Architecture System (CAAS) Product Line: A Case Study , 2005 .

[9]  Jian-Bo Yang,et al.  The evidential reasoning approach for multi-attribute decision analysis under interval uncertainty , 2006, Eur. J. Oper. Res..

[10]  J. Siskos.  Assessing a set of additive utility functions for multicriteria decision-making , 1982 .

[11]  Jian-Bo Yang,et al.  Nonlinear Regression to Estimate Both Weights and Utilities Via Evidential Reasoning for MADM , 2001 .

[12]  J. M. Borky,et al.  Architectures for next generation military avionics systems , 1998, 1998 IEEE Aerospace Conference Proceedings (Cat. No.98TH8339).

[13]  M. Singh,et al.  An Evidential Reasoning Approach for Multiple-Attribute Decision Making with Uncertainty , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[14]  Jian-Bo Yang,et al.  The evidential reasoning approach for MADA under both probabilistic and fuzzy uncertainties , 2006, Eur. J. Oper. Res..

[15]  Jian-Bo Yang,et al.  A General Multi-Level Evaluation Process for Hybrid MADM With Uncertainty , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[16]  Jian-Bo Yang,et al.  Introduction to Multi-Criteria Decision Making and the Evidential Reasoning Approach , 2004 .

[17]  T. L. Saaty.  A Scaling Method for Priorities in Hierarchical Structures , 1977 .

[18]  James M. Totans,et al.  Carnegie Mellon University's CERT Coordination Center , 2005 .

[19]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[20]  Jian-Bo Yang,et al.  On the evidential reasoning algorithm for multiple attribute decision analysis under uncertainty , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[21]  Theodor J. Stewart,et al.  Multiple criteria decision analysis - an integrated approach , 2001 .

[22]  T. Saaty,et al.  The Analytic Hierarchy Process , 1985 .

[23]  Lili Yang,et al.  Quantitative Assessment of Quality Attributes in Systems Architecture using Evidential Reasoning , 2009 .

[24]  Jian-Bo Yang,et al.  Evidential Reasoning Approach for Multiattribute Decision Analysis Under Both Fuzzy and Interval Uncertainty , 2009, IEEE Transactions on Fuzzy Systems.