A software trustworthiness evaluation model using objective weight based evidential reasoning approach

Evaluation of software trustworthiness is an extensively investigated topic. A lot of software trustworthiness evaluation (STE) models and systems have been proposed in the literature. While scholars have concentrated their efforts on the design and development of trustworthiness metrics, other STE characteristics have been neglected, such as various types of uncertainties and objective of the attribute weights determination. This paper focuses on the STE problems that include both quantitative and qualitative indicators with uncertainties. We propose an objective weight based evidential reasoning approach that employs total uncertainty measure to solve STE problems with specific trustworthiness requirements. A complex software is evaluated by the proposed STE model to demonstrate its applicability and effectiveness.

[1]  Jaideep Srivastava,et al.  An Ontology-Based Integrated Assessment Framework for High-Assurance Systems , 2008, 2008 IEEE International Conference on Semantic Computing.

[2]  Thong Nguyen,et al.  Dependability of Software in Airborne Mission Systems Executive Summary , 2008 .

[3]  M. Singh,et al.  An Evidential Reasoning Approach for Multiple-Attribute Decision Making with Uncertainty , 1994, IEEE Trans. Syst. Man Cybern. Syst..

[4]  Jeffrey M. Voas,et al.  Dependability certification of software components , 2000, J. Syst. Softw..

[5]  A. Immonen,et al.  Trustworthiness Evaluation and Testing of Open Source Components , 2007 .

[6]  Fereidoon Shams Aliee,et al.  An AHP-based approach toward enterprise architecture analysis based on enterprise architecture quality attributes , 2011, Knowledge and Information Systems.

[7]  Paolo Donzelli,et al.  A unified model of dependability: capturing dependability in context , 2004, IEEE Software.

[8]  Brian Whitworth,et al.  The web of system performance , 2006, CACM.

[9]  Jian-Bo Yang,et al.  Rule and utility based evidential reasoning approach for multiattribute decision analysis under uncertainties , 2001, Eur. J. Oper. Res..

[10]  Tien-Chin Wang,et al.  Developing a fuzzy TOPSIS approach based on subjective weights and objective weights , 2009, Expert Syst. Appl..

[11]  Shanlin Yang,et al.  The group consensus based evidential reasoning approach for multiple attributive group decision analysis , 2010, Eur. J. Oper. Res..

[12]  Gui-Wu Wei,et al.  Extension of TOPSIS method for 2-tuple linguistic multiple attribute group decision making with incomplete weight information , 2010, Knowledge and Information Systems.

[13]  Wilhelm Hasselbring,et al.  Trustworthy software systems: a discussion of basic concepts and terminology , 2006, SOEN.

[14]  Shanlin Yang,et al.  Assessment of Strategic R&D Projects for Car Manufacturers Based on the Evidential Reasoning Approach , 2008, Int. J. Comput. Intell. Syst..

[15]  Min Zhang,et al.  A Computation Model of Trustworthy Degree , 2008, 2008 International Symposium on Intelligent Information Technology Application Workshops.

[16]  Walter J. Gutjahr,et al.  Software dependability evaluation based on Markov usage models , 2000, Perform. Evaluation.

[17]  Shigeru Yamada,et al.  Relationship between software availability measurement and the number of restorations with imperfect debugging , 2003 .

[18]  Andrzej M. Goscinski,et al.  Toward dynamic and attribute based publication, discovery and selection for cloud computing , 2010, Future Gener. Comput. Syst..

[19]  R. V. Rao,et al.  A subjective and objective integrated multiple attribute decision making method for material selection , 2010 .

[20]  Raimo P. Hämäläinen,et al.  On the convergence of multiattribute weighting methods , 2001, Eur. J. Oper. Res..

[21]  Barry W. Johnson,et al.  Dependability metrics to assess safety-critical systems , 2005, IEEE Transactions on Reliability.

[22]  Ronald R. Yager,et al.  Entropy and Specificity in a Mathematical Theory of Evidence , 2008, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[23]  Paolo Donzelli,et al.  A practical framework for eliciting and modeling system dependability requirements: Experience from the NASA high dependability computing project , 2006, J. Syst. Softw..

[24]  Wilhelm Hasselbring,et al.  Toward trustworthy software systems , 2006, Computer.

[25]  Wen-Xiu Zhang,et al.  Attribute reduction in ordered information systems based on evidence theory , 2010, Knowledge and Information Systems.

[26]  N. Reid,et al.  On the Software Reliability Models of Jelinski-Moranda and Littlewood , 1985, IEEE Transactions on Reliability.

[27]  Jian-Bo Yang,et al.  On the evidential reasoning algorithm for multiple attribute decision analysis under uncertainty , 2002, IEEE Trans. Syst. Man Cybern. Part A.

[28]  Ma Jun,et al.  Software Dependability Evaluation Model Based on Fuzzy Theory , 2008, 2008 International Conference on Computer Science and Information Technology.

[29]  Khaled M. Khan,et al.  A security characterisation framework for trustworthy component based software systems , 2003, Proceedings 27th Annual International Computer Software and Applications Conference. COMPAC 2003.

[30]  Shuo-Yan Chou,et al.  A fuzzy simple additive weighting system under group decision-making for facility location selection with objective/subjective attributes , 2008, Eur. J. Oper. Res..

[31]  Carl E. Landwehr,et al.  Basic concepts and taxonomy of dependable and secure computing , 2004, IEEE Transactions on Dependable and Secure Computing.

[32]  Jian-Bo Yang,et al.  Failure mode and effects analysis using a group-based evidential reasoning approach , 2009, Comput. Oper. Res..

[33]  Aldo de Moor,et al.  Argumentation support , 2006 .

[34]  Jian-Bo Yang,et al.  The evidential reasoning approach for MADA under both probabilistic and fuzzy uncertainties , 2006, Eur. J. Oper. Res..

[35]  James C. Bezdek,et al.  Uncertainty measures for evidential reasoning II: A new measure of total uncertainty , 1993, Int. J. Approx. Reason..

[36]  Tang Yang-bin,et al.  Trustworthiness of Internet-based software , 2006 .

[37]  Jian-Bo Yang,et al.  An Evidential-Reasoning-Interval-Based Method for New Product Design Assessment , 2009, IEEE Transactions on Engineering Management.

[38]  Fei Tao,et al.  Resource service optimal-selection based on intuitionistic fuzzy set and non-functionality QoS in manufacturing grid system , 2010, Knowledge and Information Systems.

[39]  Jeffrey M. Voas.  Trusted Software's Holy Grail , 2004, Software Quality Journal.

[40]  Quan Long,et al.  Uncertainty Analysis in Software Reliability Modeling by Bayesian Analysis with Maximum-Entropy Principle , 2007, IEEE Transactions on Software Engineering.

[41]  Ting-Yu Chen,et al.  Determining objective weights with intuitionistic fuzzy entropy measures: A comparative analysis , 2010, Inf. Sci..

[42]  Bo Zhao,et al.  Research on trusted computing and its development , 2010, Science China Information Sciences.

[43]  Ho-Won Jung,et al.  Measuring software product quality: a survey of ISO/IEC 9126 , 2004, IEEE Software.

[44]  Bin Fang,et al.  Trustworthy metrics models for internetware , 2008, Wuhan University Journal of Natural Sciences.

[45]  YongSen Xu,et al.  An adaptive dependability model of component-based software , 2003, SOEN.