Throughput and bottleneck analysis of tandem queues with nested sessions

Various types of systems across a broad range of disciplines contain tandem queues with nested sessions. Strong dependence between the servers has proved to make such networks complicated and difficult to study. Exact analysis is in most of the cases intractable. Moreover, even when performance metrics such as the saturation throughput and the utilization rates of the servers are known, determining the limiting factor of such a network can be far from trivial. In our work, we present a simple, tractable and nevertheless relatively accurate method for approximating the above mentioned performance measurements for any server in a given network. In addition, we propose an extension to the intuitive “slowest server rule” for identification of the bottleneck, and show through extensive numerical experiments that this method works very well.

[1]  Minoru Tanaka,et al.  A practical bottleneck detection method , 2001, Proceeding of the 2001 Winter Simulation Conference (Cat. No.01CH37304).

[2]  Jerome A. Rolia,et al.  The Method of Layers , 1995, IEEE Trans. Software Eng..

[3]  Ji-Bo Wang,et al.  Makespan Minimization on Three-Machine Flow shop with deteriorating jobs , 2013, Asia Pac. J. Oper. Res..

[4]  Uri Yechiali,et al.  On Customers Acting as Servers , 2013, Asia Pac. J. Oper. Res..

[5]  Mirco Tribastone,et al.  A fluid model for layered queueing networks , 2013, IEEE Transactions on Software Engineering.

[6]  K. Mani Chandy,et al.  Linearizer: a heuristic algorithm for queueing network models of computing systems , 1982, CACM.

[7]  Yonathan Bard,et al.  Some Extensions to Multiclass Queueing Network Analysis , 1979, Performance.

[8]  Maria Vlasiou,et al.  SERVER WAITING TIMES IN INFINITE SUPPLY POLLING SYSTEMS WITH PREPARATION TIMES , 2015, Probability in the Engineering and Informational Sciences.

[9]  Dorina C. Petriu,et al.  Applying performance modelling to a telecommunication system , 1998, WOSP '98.

[10]  C. Murray Woodside,et al.  Enhanced Modeling and Solution of Layered Queueing Networks , 2009, IEEE Transactions on Software Engineering.

[11]  Shikharesh Majumdar,et al.  The Stochastic Rendezvous Network Model for Performance of Synchronous Client-Server-like Distributed Software , 1995, IEEE Trans. Computers.

[12]  W. H. M. Zijm,et al.  AMVA‐based solution procedures for open queueing networks with population constraints , 2000, Ann. Oper. Res..

[13]  Stephen S. Lavenberg,et al.  Mean-Value Analysis of Closed Multichain Queuing Networks , 1980, JACM.

[14]  Robert D. van der Mei,et al.  Analysis of a two-layered network by means of the power-series algorithm , 2013, Perform. Evaluation.

[15]  Uri Yechiali,et al.  FINITE TWO LAYERED QUEUEING SYSTEMS , 2016, Probability in the Engineering and Informational Sciences.

[16]  Marcel F. Neuts,et al.  Matrix-geometric solutions in stochastic models - an algorithmic approach , 1982 .

[17]  Uri Yechiali,et al.  Queues where customers of one queue act as servers of the other queue , 2008, Queueing Syst. Theory Appl..

[18]  Mirco Tribastone,et al.  Relating layered queueing networks and process algebra models , 2010, WOSP/SIPEW '10.

[19]  Jing Xu,et al.  Layered Bottlenecks and Their Mitigation , 2006, Third International Conference on the Quantitative Evaluation of Systems - (QEST'06).

[20]  Jerome A. Rolia,et al.  Performance validation tools for software/hardware systems , 2001, Perform. Evaluation.