iTrustEval: A framework for software trustworthiness evaluation with an intelligent AHP-based method

Software trustworthiness is a composite reflection of software quality and dependability attributes that are defined in industrial standards (e.g., ISO 25010), indicating a software system is constructed and operated as expected. Trustworthiness evaluation has become increasingly vital for software production and its permission being used in industry. However, trustworthiness evaluation is challenging due to the absence of comprehensive models, systematic methods, and efficient tools. We present iTrustEval a framework for software trustworthiness evaluation with an intelligent analytic hierarchy process (AHP)based method. In iTrustEval an extensible trustworthiness model enabling on-demand integration with industrial trustworthy standards (such as ISO 25010 and Automotive SPICE in the current model) is proposed; an AHP based method is designed for the bottom-up measuring data fusion (where a hybrid missing-value recommendation engine is developed using both temporal-attenuation-mechanism based history data recommendation and matrix factorisation-based recommender system); and a prototypical tool has been developed. The applicability of iTrustEval is validated through a case study, and the results show it is sound in efficiency and effectiveness.

[1]  A. A. Zaidan,et al.  Dempster–Shafer theory for classification and hybridised models of multi-criteria decision analysis for prioritisation: a telemedicine framework for patients with heart diseases , 2021, Journal of Ambient Intelligence and Humanized Computing.

[2]  MengChu Zhou,et al.  A Deep Latent Factor Model for High-Dimensional and Sparse Matrices in Recommender Systems , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[3]  Shouhuai Xu,et al.  STRAM: Measuring the Trustworthiness of Computer-Based Systems , 2019, ACM Comput. Surv..

[4]  Max Mühlhäuser,et al.  M-STAR: A Modular, Evidence-based Software Trustworthiness Framework , 2018, ArXiv.

[5]  Steven B. Lipner,et al.  The Birth and Death of the Orange Book , 2015, IEEE Annals of the History of Computing.

[6]  Xin Wu,et al.  Quantitative Evaluation across Software Development Life Cycle Based on Evidence Theory , 2013, ICIC.

[7]  A. Culyer,et al.  Analytic hierarchy process , 2013 .

[8]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[9]  Wilhelm Hasselbring,et al.  Toward trustworthy software systems , 2006, Computer.

[10]  J-C. Laprie,et al.  DEPENDABLE COMPUTING AND FAULT TOLERANCE : CONCEPTS AND TERMINOLOGY , 1995, Twenty-Fifth International Symposium on Fault-Tolerant Computing, 1995, ' Highlights from Twenty-Five Years'..

[11]  Alec Dorling,et al.  SPICE: Software Process Improvement and Capability Determination , 1993, Software Quality Journal.

[12]  James P Anderson,et al.  Computer Security Technology Planning Study , 1972 .

[13]  Yuqiang Feng,et al.  A dynamic framework of multi-attribute decision making under Pythagorean fuzzy environment by using Dempster-Shafer theory , 2021, Eng. Appl. Artif. Intell..

[14]  Yi Peng,et al.  Estimating the missing values for the incomplete decision matrix and consistency optimization in emergency management , 2016 .

[15]  Cai Ming,et al.  Trustworthy software evaluation based on QFD , 2010 .

[16]  Zhang Yu-jin,et al.  A Survey on Algorithms of Non-Negative Matrix Factorization , 2008 .

[17]  Wang Ji,et al.  High Confidence Software Engineering Technologies , 2003 .

[18]  Kurt Matzler,et al.  THE KANO MODEL: HOW TO DELIGHT YOUR CUSTOMERS , 1996 .