Benchmarking the dependability of Windows NT4, 2000 and XP

The aim of this paper is to compare the dependability of three operating systems (Windows NT4, Windows 2000 and Windows XP) with respect to erroneous behavior of the application layer. The results show a similar behavior of the three OSs with respect to robustness and a noticeable difference in OS reaction and restart times. They also show that the application state (mainly the hang and abort states) significantly impacts the restart time for the three OSs.

[1]  Daniel P. Siewiorek,et al.  Measuring Software Dependability by Robustness Benchmarking , 1997, IEEE Trans. Software Eng..

[2]  Marco Vieira,et al.  A Dependability Benchmark for OLTP Application Environments , 2003, VLDB.

[3]  Neeraj Suri,et al.  DBench (Dependability Benchmarking) , 2001 .

[4]  Junfeng Yang,et al.  An empirical study of operating systems errors , 2001, SOSP.

[5]  Mark Russinovich,et al.  Inside Microsoft Windows 2000 , 2000 .

[6]  Aaron B. Brown,et al.  Availability Benchmarking of a Database System , 2000 .

[7]  Mario Dal Cin,et al.  Reproducible dependability benchmarking experiments based on unambiguous benchmark setup descriptions , 2003, 2003 International Conference on Dependable Systems and Networks, 2003. Proceedings..

[8]  Galen C. Hunt,et al.  Detours: binary interception of Win32 functions , 1999 .

[9]  Charles P. Shelton,et al.  Robustness testing of the Microsoft Win32 API , 2000, Proceeding International Conference on Dependable Systems and Networks. DSN 2000.

[10]  Henrique Madeira,et al.  Characterization of operating systems behavior in the presence of faulty drivers through software fault emulation , 2002, 2002 Pacific Rim International Symposium on Dependable Computing, 2002. Proceedings..

[11]  Marco Vieira,et al.  Definition of fault loads based on operator faults for DMBS recovery benchmarking , 2002, 2002 Pacific Rim International Symposium on Dependable Computing, 2002. Proceedings..

[12]  Ravishankar K. Iyer,et al.  An approach towards benchmarking of fault-tolerant commercial systems , 1996, Proceedings of Annual Symposium on Fault Tolerant Computing.

[13]  Philip Koopman,et al.  Comparing the robustness of POSIX operating systems , 1999, Digest of Papers. Twenty-Ninth Annual International Symposium on Fault-Tolerant Computing (Cat. No.99CB36352).

[14]  Jean Arlat,et al.  Characterization of the impact of faulty drivers on the robustness of the Linux kernel , 2004, International Conference on Dependable Systems and Networks, 2004.

[15]  Jean Arlat,et al.  Analysis of the effects of real and injected software faults: Linux as a case study , 2002, 2002 Pacific Rim International Symposium on Dependable Computing, 2002. Proceedings..

[16]  Daniel P. Siewiorek,et al.  Comparing operating systems using robustness benchmarks , 1997, Proceedings of SRDS'97: 16th IEEE Symposium on Reliable Distributed Systems.

[17]  Jean Arlat,et al.  Benchmarking operating system dependability: Windows 2000 as a case study , 2004, 10th IEEE Pacific Rim International Symposium on Dependable Computing, 2004. Proceedings..