The effect of testing on the reliability of single version and 1-out-of-2 software systems

Some experimental results related to the effect of testing on the reliability of software systems are presented. The experiments were performed on a simulator designed for behavioral modelling of software systems in the presence of design faults. The topics of the experiments are defined as: the influence of the testing profile on the reliability evolution of a single version system, the influence of the design faults size on the evolution of system reliability in different testing profiles and the effect of the testing strategy on the reliability of 1-out-of-2 fault-tolerant scheme. In the last topic, three testing strategies are considered: individual, in coalition and back-to-back testing.

[1]  John D. Musa,et al.  Operational profiles in software-reliability engineering , 1993, IEEE Software.

[2]  Bev Littlewood,et al.  Conceptual Modeling of Coincident Failures in Multiversion Software , 1989, IEEE Trans. Software Eng..

[3]  Sarah Brocklehurst,et al.  New Ways to Get Accurate Reliability Measures , 1992, IEEE Softw..

[4]  B. Littlewood Software Reliability Model for Modular Program Structure , 1979, IEEE Transactions on Reliability.

[5]  Peter Popov,et al.  Software Design-Faults Simulation , 1997 .

[6]  Roger C. Cheung A User-Oriented Software Reliability Model , 1980, IEEE Trans. Software Eng..

[7]  Roger C. Cheung,et al.  A User-Oriented Software Reliability Model , 1978, IEEE Transactions on Software Engineering.

[8]  Sarah Brocklehurst,et al.  Recalibrating Software Reliability Models , 1990, IEEE Trans. Software Eng..

[9]  Nancy G. Leveson,et al.  An experimental evaluation of the assumption of independence in multiversion programming , 1986, IEEE Transactions on Software Engineering.

[10]  Min Xie,et al.  Software Reliability Modelling , 1991, Series on Quality, Reliability and Engineering Statistics.

[11]  Elaine J. Weyuker,et al.  An Extended Domain-Bases Model of Software Reliability , 1988, IEEE Trans. Software Eng..

[12]  Dave E. Eckhardt,et al.  A Theoretical Basis for the Analysis of Multiversion Software Subject to Coincident Errors , 1985, IEEE Transactions on Software Engineering.