A measurement study regarding quality of service and its impact on multiplayer online games

In this paper we study the impact of network parameters including delay, delay jitter, and packet loss on the outcome of multiplayer online games. We use a measurement methodology that allows for automating game experiments using an artificial intelligence that runs on the game clients and eliminates the need for human interaction. Thus, we were able to perform thousands of experiments with different network configurations to investigate their influence on the game outcome systematically. Complementary to previous studies, we provide a solid data basis for statistical analysis. We derive probabilistic models that allow for calculating score and win probabilities and verify their accuracy using our measurements. As a result we are able to predict the outcome statistics of an ideal game with respect to network conditions.

[1]  Debanjan Saha,et al.  Characterizing Online Games , 2010, IEEE/ACM Transactions on Networking.

[2]  Martina Zitterbart,et al.  Subjective quality assessment for multiplayer real-time games , 2002, NetGames '02.

[3]  Grenville J. Armitage,et al.  A synthetic traffic model for Quake3 , 2004, ACE '04.

[4]  Wu-chi Feng,et al.  Provisioning on-line games: a traffic analysis of a busy counter-strike server , 2002, CCRV.

[5]  Lars C. Wolf,et al.  Analysis of factors affecting players' performance and perception in multiplayer games , 2005, NetGames '05.

[6]  Wim Lamotte,et al.  Objective and subjective evaluation of the influence of small amounts of delay and jitter on a recent first person shooter game , 2004, NetGames '04.

[7]  Averill M. Law,et al.  Simulation Modeling and Analysis , 1982 .

[8]  Grenville Armitage,et al.  Towards a General Model of First Person Shooter Game Traffic , 2005 .

[9]  Michel Mandjes,et al.  Pna Probability, Networks and Algorithms Probability, Networks and Algorithms Modeling Ping times in First Person Shooter Games Modeling Ping times in First Person Shooter Games Modeling Ping times in First Person Shooter Games , 2022 .

[10]  Tristan Henderson,et al.  Networked games: a QoS-sensitive application for QoS-insensitive users? , 2003, RIPQoS '03.

[11]  Lars C. Wolf,et al.  On the impact of delay on real-time multiplayer games , 2002, NOSSDAV '02.

[12]  Tristan Henderson,et al.  Latency and User Behaviour on a Multiplayer Game Server , 2001, Networked Group Communication.

[13]  Grenville J. Armitage,et al.  An experimental estimation of latency sensitivity in multiplayer Quake 3 , 2003, The 11th IEEE International Conference on Networks, 2003. ICON2003..

[14]  Michael S. Borella,et al.  Source models of network game traffic , 2000, Comput. Commun..

[15]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[16]  John G. Proakis,et al.  Probability, random variables and stochastic processes , 1985, IEEE Trans. Acoust. Speech Signal Process..

[17]  M. Rupp,et al.  Empirical study of subjective quality for Massive Multiplayer Games , 2008, 2008 15th International Conference on Systems, Signals and Image Processing.

[18]  D. Karlis,et al.  Analysis of sports data by using bivariate Poisson models , 2003 .

[19]  Manuel Menezes de Oliveira Neto,et al.  What online gamers really think of the Internet? , 2003, NetGames '03.

[20]  Johannes Färber,et al.  Traffic Modelling for Fast Action Network Games , 2004, Multimedia Tools and Applications.

[21]  S. Zander,et al.  Empirically Measuring the QoS Sensitivity of Interactive Online Game Players , 2004 .

[22]  Sheldon M. Ross,et al.  Introduction to Probability Models, Eighth Edition , 1972 .

[23]  Yahn W. Bernier,et al.  Latency Compensating Methods in Client/Server In-game Protocol Design and Optimization , 2003 .

[24]  Sheldon M. Ross,et al.  Introduction to probability models , 1975 .

[25]  Wu-chi Feng,et al.  Provisioning on-line games: a traffic analysis of a busy counter-strike server , 2002, Comput. Commun. Rev..

[26]  Averill Law,et al.  Simulation Modeling and Analysis (McGraw-Hill Series in Industrial Engineering and Management) , 2006 .

[27]  Johannes Färber,et al.  Network game traffic modelling , 2002, NetGames '02.

[28]  Hartmut Ritter,et al.  The effect of latency and network limitations on MMORPGs: a field study of everquest2 , 2005, NetGames '05.

[29]  Sebastian Zander,et al.  Achieving fairness in multiplayer network games through automated latency balancing , 2005, ACE '05.

[30]  Kuan-Ta Chen,et al.  Effect of Network Quality on Player Departure Behavior in Online Games , 2009, IEEE Transactions on Parallel and Distributed Systems.

[31]  A. F. Wattimena.  Performance Modeling Of Interactive Gaming , 2006 .

[32]  Mark Claypool,et al.  The effects of loss and latency on user performance in unreal tournament 2003® , 2004, NetGames '04.