A new approach for software testability analysis

Software testability analysis has been an important research direction since 1990s and becomes more pervasive when entering 21st century. In this paper, we summarize problems in existing research work. We propose to use beta distribution to indicate software testability. When incorporating testing effectiveness information, we theoretically prove that the distribution can express testing effort and test value at the same time. We conduct experiment and validate our results on Siemens programs. Future work concentrate on deducing a prior estimation of the distribution for given software and testing criterion pair from program slicing and semantic analysis.

[1]  Elaine J. Weyuker,et al.  Predicting the location and number of faults in large software systems , 2005, IEEE Transactions on Software Engineering.

[2]  Poong-Hyun Seong,et al.  Quantitative evaluation of safety critical software testability based on fault tree analysis and entropy , 2004, J. Syst. Softw..

[3]  Jeffrey M. Voas,et al.  Estimating the Probability of Failure When Testing Reveals No Failures , 1992, IEEE Trans. Software Eng..

[4]  W. Eric Wong,et al.  Applying testability to reliability estimation , 1998, Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257).

[5]  William E. Howden,et al.  Confidence-based reliability and statistical coverage estimation , 1997, Proceedings The Eighth International Symposium on Software Reliability Engineering.

[6]  Standard Glossary of Software Engineering Terminology , 1990 .

[7]  Jerry Zeyu Gao,et al.  A component testability model for verification and measurement , 2005, 29th Annual International Computer Software and Applications Conference (COMPSAC'05).

[8]  Roger T. Alexander,et al.  Design-for-Testability for Object-Oriented Software 1 , 1997 .

[9]  Roy S. Freedman,et al.  Testability of Software Components , 1991, IEEE Trans. Software Eng..

[10]  N. Cox.  Statistical Models in Engineering , 1970 .

[11]  Anita Goel,et al.  Probe Mechanism for Object-Oriented Software Testing , 2003, FASE.

[12]  Anthony Finkelstein,et al.  Software engineering: a roadmap , 2000, ICSE '00.

[13]  Shari Lawrence Pfleeger,et al.  Software Metrics : A Rigorous and Practical Approach , 1998 .

[14]  Sandro Morasca,et al.  Deriving models of software fault-proneness , 2002, SEKE '02.

[15]  Richard Bache,et al.  Measures of testability as a basis for quality assurance , 1990, Softw. Eng. J..

[16]  Arie van Deursen,et al.  Predicting class testability using object-oriented metrics , 2004, Source Code Analysis and Manipulation, Fourth IEEE International Workshop on.

[17]  Norman E. Fenton,et al.  Software metrics: roadmap , 2000, ICSE '00.

[18]  Haifeng Shi,et al.  A preliminary testability model for object-oriented software , 1998, Proceedings. 1998 International Conference Software Engineering: Education and Practice (Cat. No.98EX220).

[19]  Jeffrey M. Voas,et al.  Semantic metrics for software testability , 1993, J. Syst. Softw..

[20]  Simeon C. Ntafos,et al.  An Evaluation of Random Testing , 1984, IEEE Transactions on Software Engineering.

[21]  Elaine J. Weyuker.  Can we measure software testing effectiveness? , 1993, [1993] Proceedings First International Software Metrics Symposium.

[22]  Shari Lawrence Pfleeger,et al.  Software metrics (2nd ed.): a rigorous and practical approach , 1997 .

[23]  David Wright,et al.  Some Conservative Stopping Rules for the Operational Testing of Safety-Critical Software , 1997, IEEE Trans. Software Eng..

[24]  Bev Littlewood,et al.  Software reliability and dependability: a roadmap , 2000, ICSE '00.

[25]  Vadim Okun,et al.  Comparison of fault classes in specification-based testing , 2004, Inf. Softw. Technol..

[26]  Barry Boehm,et al.  Characteristics of software quality , 1978 .

[27]  Yves Le Traon,et al.  Testability analysis of a UML class diagram , 2002, Proceedings Eighth IEEE Symposium on Software Metrics.

[28]  Lorenzo Strigini,et al.  On the Use of Testability Measures for Dependability Assessment , 1996, IEEE Trans. Software Eng..

[29]  Jeffrey M. Voas,et al.  PIE: A Dynamic Failure-Based Technique , 1992, IEEE Trans. Software Eng..