A reply to the criticisms of the Knight & Leveson experiment

In July 1985, we presented a paper at the Fifteenth International Symposium on Fault-Tolerant Computing [KNI85] describing the results of an experiment that we performed examining an hypothesis about one aspect of N-version programming, i.e., the statistical independence of version failure. A longer journal paper on that research appeared in the IEEE Transactions on Software Engineering in January 1986 [KNI86].

[1]  Algirdas Avizienis,et al.  Fault Tolerance by Design Diversity: Concepts and Experiments , 1984, Computer.

[2]  David F. McAllister,et al.  An Experimental Evaluation of Software Redundancy as a Strategy For Improving Reliability , 1991, IEEE Trans. Software Eng..

[3]  Algirdas Avizienis,et al.  Software Fault Tolerance , 1989, IFIP Congress.

[4]  Mark Kenneth Joseph.  Architectural issues in fault-tolerant, secure computing systems , 1988 .

[5]  Nancy G. Leveson,et al.  An Empirical Comparison of Software Fault Tolerance and Fault Elimination , 1991, IEEE Trans. Software Eng..

[6]  Nancy G. Leveson,et al.  An experimental evaluation of the assumption of independence in multiversion programming , 1986, IEEE Transactions on Software Engineering.

[7]  Larry J. Yount,et al.  Fault effect protection and partitioning for fly-by-wire/fly-by-light avionics systems , 1985 .

[8]  P. J. Traverse,et al.  Safe and Reliable Computing on Board the Airbus and ATR Aircraft , 1986 .

[9]  Michael R. Lyu,et al.  On the effectiveness of multi-version software in digital avionics , 1988 .

[10]  John P. J. Kelly.  Current Experiences with Fault Tolerant Software Design: Dependability Through Diverse Formal Specifications? , 1989, Fehlertolerierende Rechensysteme.

[11]  K. S. Tso,et al.  Multi-Version Software Development , 1986 .

[12]  Michael R. Lyu,et al.  In search of effective diversity: a six-language study of fault-tolerant flight control software , 1988, [1988] The Eighteenth International Symposium on Fault-Tolerant Computing. Digest of Papers.

[13]  Dave E. Eckhardt,et al.  A Theoretical Basis for the Analysis of Multiversion Software Subject to Coincident Errors , 1985, IEEE Transactions on Software Engineering.

[14]  Algirdas Avizienis,et al.  The N-Version Approach to Fault-Tolerant Software , 1985, IEEE Transactions on Software Engineering.

[15]  David F. McAllister,et al.  Fault-Tolerant SoFtware Reliability Modeling , 1987, IEEE Transactions on Software Engineering.

[16]  P. M. Nagel,et al.  Software reliability: Repetitive run experimentation and modeling , 1982 .

[17]  Peter G. Bishop,et al.  Project on Diverse Software — An Experiment in Software Reliability , 1985 .