Sensitivity Analysis of Combined Software and Hardware Performance Models: Open Queueing Networks

Contemporary approaches to software performance engineering suffer from weak integration with the design process and provide little feedback to developers. An approach to software performance modelling is presented, based on annotating design specifications with performance parameters and operational analysis of queueing networks representing the hardware. Analytical sensitivity analysis is provided to (1) point out where model refinement and parameter capture effort should be focused, and (2) suggest performance optimisations in the design specification. Sensitivities are obtained by differentiation of the combined software (workload) and hardware performance model. Only open queueing networks are considered at the hardware level. The results are validated, and it is pointed out that further work is particularly needed in the areas of dynamic software performance modelling and distributed systems.

[1]  Jon Atle Gulla,et al.  PPP: A Integrated CASE Environment , 1991, CAiSE.

[2]  Philippe Nain,et al.  Sensitivity Results in Open, Closed and Mixed Product Form Queueing Networks , 1991, Perform. Evaluation.

[3]  Kishor S. Trivedi,et al.  On the Solution of GSPN Reward Models , 1991, Perform. Evaluation.

[4]  Andreas L. Opdahl,et al.  Conceptual Integration of Information System and Performance Modelling , 1992, International Symposium on Combinatorial Optimization.

[5]  Ray Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[6]  Kishor S. Trivedi,et al.  Sensitivity analysis of reliability and performability measures for multiprocessor systems , 1988, SIGMETRICS '88.

[7]  Arne Sølvberg,et al.  Data base design constrained by traffic load estimates , 1981, Inf. Syst..

[8]  Andreas L. Opdahl,et al.  A Framework for Performance Engineering During Information System Development , 1992, CAiSE.

[9]  Connie U. Smith,et al.  Performance Engineering of Software Systems , 1990, SIGMETRICS Perform. Evaluation Rev..

[10]  C. U. Smith,et al.  The prediction and evaluation of the performance of software from extended design specifications , 1980 .

[11]  Peter J. Denning,et al.  Operational Analysis of Queueing Networks , 1977, Performance.

[12]  Edward D. Lazowska,et al.  Quantitative system performance - computer system analysis using queueing network models , 1983, Int. CMG Conference.