Interface Robustness Testing: Experience and Lessons Learned from the Ballista Project

This chapter contains sections titled: Introduction Previous Robustness Testing Work Evolution of Ballista Lessons Learned Conclusions Acknowledgments References

[1]  Jean Arlat,et al.  Fault Injection for Dependability Validation: A Methodology and Some Applications , 1990, IEEE Trans. Software Eng..

[2]  Henrique Madeira,et al.  Xception: A Technique for the Experimental Evaluation of Dependability in Modern Computers , 1998, IEEE Trans. Software Eng..

[3]  Daniel P. Siewiorek,et al.  Fault Injection Experiments Using FIAT , 1990, IEEE Trans. Computers.

[4]  Philip Koopman,et al.  Robust software - no more excuses , 2002, Proceedings International Conference on Dependable Systems and Networks.

[5]  Daniel P. Siewiorek,et al.  Development of a benchmark to measure system robustness , 1993, FTCS-23 The Twenty-Third International Symposium on Fault-Tolerant Computing.

[6]  Daniel P. Siewiorek,et al.  Comparing operating systems using robustness benchmarks , 1997, Proceedings of SRDS'97: 16th IEEE Symposium on Reliable Distributed Systems.

[7]  Simeon C. Ntafos,et al.  An Evaluation of Random Testing , 1984, IEEE Transactions on Software Engineering.

[8]  John B. Goodenough,et al.  Exception handling: issues and a proposed notation , 1975, CACM.

[9]  Yi-Min Wang,et al.  Xept: a software instrumentation method for exception handling , 1997, Proceedings The Eighth International Symposium on Software Reliability Engineering.

[10]  Frank Feather,et al.  Fault-free performance validation of avionic multiprocessors , 1986 .

[11]  Daniel P. Siewiorek,et al.  Measuring Software Dependability by Robustness Benchmarking , 1997, IEEE Trans. Software Eng..

[12]  Philip Koopman,et al.  High performance robust computer systems , 2001 .

[13]  Barton P. Miller,et al.  Fuzz Revisited: A Re-examination of the Reliability of UNIX Utilities and Services , 1995 .

[14]  Barton P. Miller,et al.  An Empirical Study of the Reliability of Operating System Utilities , 1989 .

[15]  Algirdas Avizienis,et al.  The N-Version Approach to Fault-Tolerant Software , 1985, IEEE Transactions on Software Engineering.

[16]  Daniel P. Siewiorek,et al.  Automated robustness testing of off-the-shelf software components , 1998, Digest of Papers. Twenty-Eighth Annual International Symposium on Fault-Tolerant Computing (Cat. No.98CB36224).

[17]  Philip Koopman,et al.  Performance evaluation of exception handling in I/O libraries , 2001, 2001 International Conference on Dependable Systems and Networks.

[18]  Daniel P. Siewiorek,et al.  A dimensionality model approach to testing and improving software robustness , 1999, 1999 IEEE AUTOTESTCON Proceedings (Cat. No.99CH36323).

[19]  Jean Arlat,et al.  MAFALDA-RT: a tool for dependability assessment of real-time systems , 2002, Proceedings International Conference on Dependable Systems and Networks.

[20]  Flaviu Cristian,et al.  Exception Handling and Tolerance of Software Faults , 1995 .

[21]  Daniel P. Siewiorek,et al.  Robustness testing and hardening of CORBA ORB implementations , 2001, 2001 International Conference on Dependable Systems and Networks.

[22]  Henrique Madeira,et al.  Multidimensional Characterization of the Impact of Faulty Drivers on the Operating Systems Behavior , 2003 .

[23]  Philip Koopman,et al.  Comparing the robustness of POSIX operating systems , 1999, Digest of Papers. Twenty-Ninth Annual International Symposium on Fault-Tolerant Computing (Cat. No.99CB36352).

[24]  Philip Koopman,et al.  The Exception Handling Effectiveness of POSIX Operating Systems , 2000, IEEE Trans. Software Eng..

[25]  Narain H. Gehani,et al.  Exceptional C or C with exceptions , 1992, Softw. Pract. Exp..

[26]  Philip Koopman,et al.  Robustness testing of a distributed simulation backplane , 1999, Proceedings 10th International Symposium on Software Reliability Engineering (Cat. No.PR00443).

[27]  Philip Koopman.  Toward a scalable method for quantifying aspects of fault tolerance, software assurance, and computer security , 1998, Proceedings Computer Security, Dependability, and Assurance: From Needs to Solutions (Cat. No.98EX358).

[28]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.

[29]  David F. McAllister,et al.  An Experimental Evaluation of Software Redundancy as a Strategy For Improving Reliability , 1991, IEEE Trans. Software Eng..

[30]  Michael R. Lyu,et al.  In search of effective diversity: a six-language study of fault-tolerant flight control software , 1988, [1988] The Eighteenth International Symposium on Fault-Tolerant Computing. Digest of Papers.

[31]  I. D. Hill.  Faults in Functions, in ALGOL and FORTRAN , 1971, Comput. J..

[32]  Ravishankar K. Iyer,et al.  Measuring Fault Tolerance with the FTAPE Fault Injection Tool , 1995, MMB.

[33]  Joe Marshall,et al.  Measuring robustness of a fault tolerant aerospace system , 1995, Twenty-Fifth International Symposium on Fault-Tolerant Computing. Digest of Papers.

[34]  David G. Korn,et al.  SFIO: Safe/Fast String/File IO , 1991, USENIX Summer.

[35]  Charles P. Shelton,et al.  Robustness testing of the Microsoft Win32 API , 2000, Proceeding International Conference on Dependable Systems and Networks. DSN 2000.

[36]  Mark Russinovich,et al.  Application transparent fault management in fault tolerant Mach , 1993, FTCS-23 The Twenty-Third International Symposium on Fault-Tolerant Computing.

[37]  John D. Musa,et al.  The operational profile , 1996 .

[38]  Jacob A. Abraham,et al.  FERRARI: a tool for the validation of system dependability properties , 1992, [1992] Digest of Papers. FTCS-22: The Twenty-Second International Symposium on Fault-Tolerant Computing.