Performance validation tools for software/hardware systems

Abstract It is common for software/hardware systems to be fully designed and functionally tested before an attempt is made to verify performance characteristics. Unsatisfactory performance, when discovered late in a system’s development, can cause a costly redesign and implementation of software or hardware and is likely to result in late system delivery. The goal of system performance validation is to provide assurance that a system as a whole is likely to meet its quantitative goals before the system is complete. It exploits performance engineering methods and tools to systematically construct and evaluate predictive system models. The tools must correctly predict system performance at some useful abstraction. This paper compares layered queueing models (LQMs) and stochastic process algebras (SPAs) and their support for system performance validation. In particular, we focus on abstraction and level detail within models and automated model building.

[1]  Hubert Garavel,et al.  OPEN/CÆSAR: An OPen Software Architecture for Verification, Simulation, and Testing , 1998, TACAS.

[2]  C. Murray Woodside,et al.  Performance of multi-level client-server systems with parallel service operations , 1998, WOSP '98.

[3]  Holger Hermanns,et al.  A Construction and Analysis Tool Based on the Stochastic Process Algebra TIPP , 1996, TACAS.

[4]  Jerome A. Rolia,et al.  A Toolset for Performance Engineering and Software Design of Client-Server Systems , 1995, Perform. Evaluation.

[5]  M. Reiser,et al.  A Queueing Network Analysis of Computer Communication Networks with Window Flow Control , 1979, IEEE Trans. Commun..

[6]  Tommaso Bolognesi,et al.  Tableau methods to describe strong bisimilarity on LOTOS processes involving pure interleaving and enabling , 1994, FORTE.

[7]  Roberto Gorrieri,et al.  An Algebraic Model for Evaluating the Performance of an ATM Switch with Explicit Rate Marking , 1999 .

[8]  Hesham El-Sayed,et al.  Automated Performance Modeling from Scenarios and SDL Designs of Distributed Systems , 1998, PDSE.

[9]  Sridhar Ramesh,et al.  A multi-layer client-server queueing network model with synchronous and asynchronous messages , 1998, WOSP '98.

[10]  Franz Hartleb,et al.  Performance Evaluation of Parallel Programs - Modeling and Monitoring with the Tool PEPP , 1993, MMB.

[11]  Xin Wang,et al.  Deriving Software Performance Models from Architectural Patterns by Graph Transformations , 1998, TAGT.

[12]  Joost-Pieter Katoen,et al.  Automated compositional Markov chain generation for a plain-old telephone system , 2000, Sci. Comput. Program..

[13]  Alain Kerbrat,et al.  Protocol verification with the ALDÉBARAN toolset , 1997, International Journal on Software Tools for Technology Transfer.

[14]  Dorina C. Petriu,et al.  Applying performance modelling to a telecommunication system , 1998, WOSP '98.

[15]  C. Murray Woodside,et al.  Layered analytic performance modelling of a distributed database system , 1997, Proceedings of 17th International Conference on Distributed Computing Systems.

[16]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[17]  Holger Hermanns,et al.  Compositional performance modelling with the TIPPtool , 2000, Perform. Evaluation.

[18]  Jerome A. Rolia,et al.  Web Server Performance Measurement and Modeling Techniques , 1998, Performance evaluation (Print).

[19]  Edward D. Lazowska,et al.  Quantitative system performance - computer system analysis using queueing network models , 1983, Int. CMG Conference.

[20]  R. J. Friedrich,et al.  Performance evaluation of a distributed application performance monitor , 1996 .

[21]  Diego Latella,et al.  Partial Order Models for Quantitative Extensions of LOTOS , 1998, Comput. Networks.

[22]  Jerome A. Rolia,et al.  Trace-Based Load Characterization for Gernerating Performance Software Models , 1999, IEEE Trans. Software Eng..

[23]  Shikharesh Majumdar,et al.  Analytic performance estimation of client-server systems with multi-threaded clients , 1994, Proceedings of International Workshop on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[24]  Shikharesh Majumdar,et al.  The Stochastic Rendezvous Network Model for Performance of Synchronous Client-Server-like Distributed Software , 1995, IEEE Trans. Computers.

[25]  C. M. Woodside,et al.  Trace-based load characterization for the automated development of software performance models , 1998 .

[26]  Dorina C. Petriu,et al.  Approximate MVA from Markov model of software client/server systems , 1991, Proceedings of the Third IEEE Symposium on Parallel and Distributed Processing.

[27]  Jane Hillston,et al.  A Simple Time Scale Decomposition Technique for Stochastic Process Algebras , 1995, Comput. J..

[28]  Jerome A. Rolia,et al.  The Method of Layers , 1995, IEEE Trans. Software Eng..

[29]  Rance Cleaveland,et al.  TwoTowers: A Tool Integrating Functional and Performance Analysis of Concurrent Systems , 1998, FORTE.

[30]  V. Mersiotakis,et al.  Throughput approximation of decision free processes using decomposition , 1997, Proceedings of the Seventh International Workshop on Petri Nets and Performance Models.

[31]  Stephen Gilmore,et al.  The PEPA Workbench: A Tool to Support a Process Algebra-based Approach to Performance Modelling , 1994, Computer Performance Evaluation.