An automated software reliability prediction system for safety critical software

Software reliability is one of the most important software quality indicators. It is concerned with the probability that the software can execute without any unintended behavior in a given environment. In previous research we developed the Reliability Prediction System (RePS) methodology to predict the reliability of safety critical software such as those used in the nuclear industry. A RePS methodology relates the software engineering measures to software reliability using various models, and it was found that RePS’s using Extended Finite State Machine (EFSM) models and fault data collected through various software engineering measures possess the most satisfying prediction capability. In this research the EFSM-based RePS methodology is improved and implemented into a tool called Automated Reliability Prediction System (ARPS). The features of the ARPS tool are introduced with a simple case study. An experiment using human subjects was also conducted to evaluate the usability of the tool, and the results demonstrate that the ARPS tool can indeed help the analyst apply the EFSM-based RePS methodology with less number of errors and lower error criticality.

[1]  Chin-Yu Huang,et al.  Performance analysis of software reliability growth models with testing-effort and change-point , 2005, J. Syst. Softw..

[2]  Joanne Bechta Dugan,et al.  A continuous-time Bayesian network reliability modeling, and analysis framework , 2006, IEEE Transactions on Reliability.

[3]  Hoang Pham,et al.  System Software Reliability , 1999 .

[4]  Shih-Wei Huang,et al.  CARATS: A Computer-Aided Reliability Assessment Tool for Software Based on Object-Oriented Design , 2006, TENCON 2006 - 2006 IEEE Region 10 Conference.

[5]  W. J. Dixon,et al.  Power Functions of the Sign Test and Power Efficiency for Normal Alternatives , 1953 .

[6]  Swapna S. Gokhale,et al.  SREPT: software reliability estimation and prediction tool , 1998, Performance evaluation (Print).

[7]  Forrest Shull,et al.  Using the ISO/IEC 9126 product quality model to classify defects: A controlled experiment , 2012, EASE.

[8]  Fuqun Huang,et al.  Study on the Correlations Between Program Metrics and Defect Rate by a Controlled Experiment , 2013 .

[9]  Wen-Li Wang,et al.  An Architecture-Based Software Reliability Modeling Tool and Its Support for Teaching , 2005, Proceedings Frontiers in Education 35th Annual Conference.

[10]  A. Stuart,et al.  Non-Parametric Statistics for the Behavioral Sciences. , 1957 .

[11]  Neeraj Kumar Goyal,et al.  Early Software Reliability Prediction - A Fuzzy Logic Approach , 2013, Studies in Fuzziness and Soft Computing.

[12]  LiuBin,et al.  The impact of software process consistency on residual defects , 2015 .

[13]  John D. Musa,et al.  Software reliability - measurement, prediction, application , 1987, McGraw-Hill series in software engineering and technology.

[14]  Helge Langseth,et al.  Bayesian Networks in Reliability: Some Recent Developments , 2004 .

[15]  Jeffrey M. Voas,et al.  PIE: A Dynamic Failure-Based Technique , 1992, IEEE Trans. Software Eng..

[16]  Norman E. Fenton,et al.  A Critique of Software Defect Prediction Models , 1999, IEEE Trans. Software Eng..

[17]  Ming Li,et al.  A Ranking of Software Engineering Measures Based on Expert Opinion , 2003, IEEE Trans. Software Eng..

[18]  Michael R. Lyu,et al.  An Assessment of Testing-Effort Dependent Software Reliability Growth Models , 2007, IEEE Transactions on Reliability.

[19]  Michael R. Lyu,et al.  CASRE: a computer-aided software reliability estimation tool , 1992, [1992] Proceedings of the Fifth International Workshop on Computer-Aided Software Engineering.

[20]  Bin Li,et al.  Software Reliability Models , 2002 .

[21]  Ming T. Liu,et al.  Generating test cases for EFSM with given fault models , 1993, IEEE INFOCOM '93 The Conference on Computer Communications, Proceedings.

[22]  Beat Kleiner,et al.  Graphical Methods for Data Analysis , 1983 .

[23]  Jeffrey C. Carver,et al.  The Effect of the Number of Defects on Estimates Produced by Capture-Recapture Models , 2008, 2008 19th International Symposium on Software Reliability Engineering (ISSRE).

[24]  Ivar Jacobson,et al.  Unified Modeling Language User Guide, The (2nd Edition) (Addison-Wesley Object Technology Series) , 2005 .

[25]  Bin Liu,et al.  The impact of software process consistency on residual defects , 2015, J. Softw. Evol. Process..

[26]  Nenad Medvidovic,et al.  Early prediction of software component reliability , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[27]  John D. Musa,et al.  Operational profiles in software-reliability engineering , 1993, IEEE Software.

[28]  C. Smidts,et al.  A Method for Quantifying the Dependability Attributes of Software-Based Safety Critical Instrumentation and Control Systems in Nuclear Power Plants , 2014 .

[29]  Ming Li,et al.  Validation of a methodology for assessing software reliability , 2004, 15th International Symposium on Software Reliability Engineering.

[30]  John D. Musa,et al.  A theory of software reliability and its application , 1975, IEEE Transactions on Software Engineering.

[31]  Carol Smidts.  Integrating Software into Pra: A Software-Related Failure Mode Taxonomy , 2006, Risk analysis : an official publication of the Society for Risk Analysis.

[32]  Swapna S. Gokhale,et al.  Analytical Models for Architecture-Based Software Reliability Prediction: A Unification Framework , 2006, IEEE Transactions on Reliability.

[33]  Bin Liu,et al.  The links between human error diversity and software diversity: Implications for fault diversity seeking , 2014, Sci. Comput. Program..

[34]  Q. P. Hu,et al.  Early Software Reliability Prediction with ANN Models , 2006, 2006 12th Pacific Rim International Symposium on Dependable Computing (PRDC'06).