Enhanced Modeling and Solution of Layered Queueing Networks

Layered queues are a canonical form of extended queueing network for systems with nested multiple resource possession, in which successive depths of nesting define the layers. The model has been applied to most modern distributed systems, which use different kinds of client-server and master-slave relationships, and scales up well. The layered queueing network (LQN) model is described here in a unified fashion, including its many more extensions to match the semantics of sophisticated practical distributed and parallel systems. These include efficient representation of replicated services, parallel and quorum execution, and dependability analysis under failure and reconfiguration. The full LQN model is defined here and its solver is described. A substantial case study to an air traffic control system shows errors (compared to simulation) of a few percent. The LQN model is compared to other models and solutions, and is shown to cover all their features.

[1]  Dorina C. Petriu.  Approximate Mean Value Analysis of Client-Server Systems with Multi-class Requests , 1994, SIGMETRICS.

[2]  Akhil Kumar,et al.  Performance analysis of a hierarchical quorum consensus algorithm for replicated objects , 1990, Proceedings.,10th International Conference on Distributed Computing Systems.

[3]  C. Murray Woodside,et al.  Performance analysis of distributed server systems , 2000 .

[4]  Kishor S. Trivedi,et al.  Performance and Reliability Analysis Using Directed Acyclic Graphs , 1987, IEEE Transactions on Software Engineering.

[5]  Jerome A. Rolia,et al.  The Method of Layers , 1995, IEEE Trans. Software Eng..

[6]  Stephen F. Lundstrom,et al.  Predicting Performance of Parallel Computations , 1990, IEEE Trans. Parallel Distributed Syst..

[7]  Kishor S. Trivedi,et al.  Analytic Queueing Models for Programs with Internal Concurrency , 1983, IEEE Transactions on Computers.

[8]  K. Mani Chandy,et al.  Linearizer: a heuristic algorithm for queueing network models of computing systems , 1982, CACM.

[9]  Michael L. Fontenot.  Software Congestion, Mobile Servers, and the Hyperbolic Model , 1989, IEEE Trans. Software Eng..

[10]  M. Reiser,et al.  A Queueing Network Analysis of Computer Communication Networks with Window Flow Control , 1979, IEEE Trans. Commun..

[11]  Stephen S. Lavenberg,et al.  Mean-Value Analysis of Closed Multichain Queuing Networks , 1980, JACM.

[12]  C. Murray Woodside,et al.  Dependable LQNS: a performability modeling tool for layered systems , 2003, 2003 International Conference on Dependable Systems and Networks, 2003. Proceedings..

[13]  A. Rauzy,et al.  Exact and truncated computations of prime implicants of coherent and non-coherent fault trees within Aralia , 1997 .

[14]  C. Murray Woodside,et al.  Performance of multi-level client-server systems with parallel service operations , 1998, WOSP '98.

[15]  C. Murray Woodside,et al.  Performance Modeling of a Quorum Pattern in Layered Service Systems , 2007, Fourth International Conference on the Quantitative Evaluation of Systems (QEST 2007).

[16]  C. Murray Woodside,et al.  Solving layered queueing networks of large client-server systems with symmetric replication , 2005, WOSP '05.

[17]  C. Murray Woodside,et al.  Effectiveness of Early Replies in Client-Server Systems , 1999, Perform. Evaluation.

[18]  C. Murray Woodside,et al.  Layered Modeling of Hardware and Software, with Application to a LAN Extension Router , 2000, Computer Performance Evaluation / TOOLS.

[19]  C. Murray Woodside,et al.  An "Active Server" model for the performance of parallel programs written using rendezvous , 1986, J. Syst. Softw..

[20]  Connie U. Smith,et al.  Performance Engineering of Software Systems , 1990, SIGMETRICS Perform. Evaluation Rev..

[21]  Sridhar Ramesh,et al.  A multi-layer client-server queueing network model with synchronous and asynchronous messages , 1998, WOSP '98.

[22]  C. Murray Woodside,et al.  Efficient performance models for layered server systems with replicated servers and parallel behaviour , 2007, J. Syst. Softw..

[23]  Daniel A. Menascé,et al.  Two-level iterative queuing modeling of software contention , 2002, Proceedings. 10th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems.

[24]  C. Murray Woodside,et al.  Dependability Modeling of Self-healing Client-Server Applications , 2003, WADS.

[25]  Pekka Kähkipuro,et al.  Performance Modeling Framework for CORBA Based Distributed Systems , 2000 .

[26]  C. Murray Woodside.  Throughput Calculation for Basic Stochastic Rendezvous Networks , 1989, Perform. Evaluation.

[27]  A. Bayen.  Computational Control of Networks of Dynamical Systems: Application to the National Airspace System , 2003 .

[28]  Dorina C. Petriu,et al.  Approximate MVA from Markov model of software client/server systems , 1991, Proceedings of the Third IEEE Symposium on Parallel and Distributed Processing.

[29]  C. Murray Woodside,et al.  Multiclass multiservers with deferred operations in layered queueing networks, with software system applications , 2004, The IEEE Computer Society's 12th Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, 2004. (MASCOTS 2004). Proceedings..

[30]  C. Murray Woodside,et al.  Dependability modelling of layered systems , 2004 .

[31]  Issei Kino,et al.  Approximation Methods for Two-Layer Queueing Models , 1999, Perform. Evaluation.

[32]  Amy Pan,et al.  Solving Stochastic Rendezvous Networks of Large Client-Server Systems with Symmetric Replication , 2001 .

[33]  Greg Franks,et al.  Deriving distribution of thread service time in layered queueing networks , 2007, WOSP '07.

[34]  Shikharesh Majumdar,et al.  The Stochastic Rendezvous Network Model for Performance of Synchronous Client-Server-like Distributed Software , 1995, IEEE Trans. Computers.