Adaptive virtual environments in modern multi-player computer games

Most modern computer games provide a virtual environment as a context for player interaction. Recently, many multi-player online games have adopted the persistent-state gaming model, which provides a central virtual environment with essentially infinite lifetime. However, a displeasing part of these long-lasting environments is that, like their predecessors, they are still assumed to be static, unchanging even in the long-term. In response to this fact, we introduce the adaptive virtual environment which automatically adapts based on activity occurring within the environment. In computer games, adaptive virtual environments are systems that correspond to real-world physical or social systems. These systems are computationally formalized by adhering to a generic adaptation model containing abstract components and procedures. Herein, as a proof of concept, we design and analyze the behavior of two adaptive versions of such systems commonly found in persistent-state games. To achieve this, we build an implementation of an abstract interactive simulator that applies the adaptation process to our example systems. Each system is internally represented as a plug-in module containing system-specific implementations of the model's abstractly-defined procedures. Performance of the adaptation process is then evaluated using simulation data. Finally, improvements such as optimizations and better movement models for agent simulation are investigated, and the general usefulness and applicability of the concepts is discussed.

[1]  Bernard P. Zeigler,et al.  Multifacetted Modelling and Discrete Event Simulation , 1984 .

[2]  John P. Lewis,et al.  Generalized stochastic subdivision , 1987, TOGS.

[3]  Eric Cronin,et al.  A Distributed Multiplayer Game Server System , 2001 .

[4]  DAVID P. HELMBOLD,et al.  Modeling Speedup (n) Greater than n , 1990, IEEE Trans. Parallel Distributed Syst..

[5]  Craig W. Reynolds Competition, Coevolution and the Game of Tag , 1994 .

[6]  Stephen Marsh,et al.  Formalising Trust as a Computational Concept , 1994 .

[7]  David Wright,et al.  Adaptive Cooperative Fuzzy Logic Controller , 2004, ACSC.

[8]  Brian Mac Namee,et al.  A Proposal for an Agent Architecture for Proactive Persistent Non Player Characters , 2001 .

[9]  Steven H. Strogatz,et al.  Nonlinear Dynamics and Chaos , 2024 .

[10]  Gregory M. Nielson,et al.  Terrain simulation using a model of stream erosion , 1988, SIGGRAPH.

[11]  Arcwise Isometries,et al.  A Course in Metric Geometry , 2001 .

[12]  Adrian Court,et al.  A Distributed Architecture for Multiplayer Interactive Applications on the Internet , 1999 .

[13]  M. Carter Computer graphics: Principles and practice , 1997 .

[14]  Franco Bagnoli,et al.  Cellular Automata , 2002, Lecture Notes in Computer Science.

[15]  Roger L. Wainwright,et al.  A simulation of adaptive agents in a hostile environment , 1995, SAC '95.

[16]  Thomas A. Funkhouser,et al.  Network topologies for scalable multi-user virtual environments , 1996, Proceedings of the IEEE 1996 Virtual Reality Annual International Symposium.

[17]  Steven H. Strogatz,et al.  Nonlinear Dynamics and Chaos: With Applications to Physics, Biology, Chemistry, and Engineering , 1994 .

[18]  G. Wahba,et al.  Adaptive Tuning of Numerical Weather Prediction Models: Simultaneous Estimation of Weighting, Smoothing, and Physical Parameters , 1998 .

[19]  Stephen Wolfram,et al.  Theory and Applications of Cellular Automata , 1986 .

[20]  Marc J. V. Ponsen,et al.  Improving Adaptive Game Ai with Evolutionary Learning , 2004 .

[21]  Ramesh Govindan,et al.  The Design of A Distributed Rating Scheme for Peer-to-peer Systems , 2007 .

[22]  John von Neumann,et al.  Theory Of Self Reproducing Automata , 1967 .

[23]  Stephen A. Billings,et al.  The Identification of Cellular Automata , 2006, J. Cell. Autom..

[24]  Ebrahim Mamdani,et al.  Applications of fuzzy algorithms for control of a simple dynamic plant , 1974 .

[25]  Rudy Rucker,et al.  Software Engineering And Computer Games , 2002 .

[26]  Master Gardener,et al.  Mathematical games: the fantastic combinations of john conway's new solitaire game "life , 1970 .

[27]  Michael Hadjimichael,et al.  MEDEX: a fuzzy system for forecasting Mediterranean gale force winds , 1996, Proceedings of IEEE 5th International Fuzzy Systems.

[28]  T. Kaukoranta,et al.  A Review on Networking and Multiplayer Computer Games , 2002 .

[29]  E. F. Codd,et al.  Cellular automata , 1968 .

[30]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[31]  Gérard Y. Vichniac Cellular-Automata Fluids , 1989 .

[32]  Hans Vangheluwe,et al.  The cellular automata formalism and its relationship to DEVS , 2000, ESM.

[33]  Bernard P. Zeigler,et al.  Modeling multi-scale spatial ecological processes under the discrete event systems paradigm , 1993, Landscape Ecology.

[34]  David Carmel,et al.  Model-based learning of interaction strategies in multi-agent systems , 1998, J. Exp. Theor. Artif. Intell..

[35]  K. Ramachandran,et al.  Mathematical Statistics with Applications. , 1992 .

[36]  Gregory A. Baxes,et al.  Digital image processing - principles and applications , 1994 .

[37]  David S. Ebert,et al.  Texturing and Modeling: A Procedural Approach , 1994 .

[38]  S. Wolfram,et al.  Two-dimensional cellular automata , 1985 .

[39]  Mikael Jakobsson,et al.  The Sopranos Meets EverQuest Social Networking in Massively Multiplayer Online Games , 2003 .

[40]  Georg Lausen,et al.  Spreading activation models for trust propagation , 2004, IEEE International Conference on e-Technology, e-Commerce and e-Service, 2004. EEE '04. 2004.

[41]  Bill Hirst,et al.  Fractal Landscapes: from the Real World , 1994 .

[42]  Li-Xin Wang,et al.  A Course In Fuzzy Systems and Control , 1996 .

[43]  Jun-ichi Hasegawa,et al.  Visualization of dominant region in team games and its application to teamwork analysis , 2000, Proceedings Computer Graphics International 2000.

[44]  R. Guha,et al.  Open Rating Systems , 2002 .

[45]  Hyun-Jin Choi,et al.  Security issues in online games , 2002, Electron. Libr..

[46]  Godfried T. Toussaint Some Unsolved Problems on Proximity Graphs , 1991 .

[47]  Eric O. Postma,et al.  On-Line Adaptation of Game Opponent AI in Simulation and in Practice , 2003, GAME-ON.

[48]  Nils J. Nilsson,et al.  Artificial Intelligence , 1974, IFIP Congress.

[49]  Peter L. Reiher,et al.  An Active Self-Optimizing Multiplayer Gaming Architecture , 2006, Cluster Computing.

[50]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[51]  Gabriel A. Wainer,et al.  A Framework for Remote Execution and Visualization of Cell-DEVS Models , 2003, Simul..

[52]  Gordon Hayward,et al.  Fuzzy logic applications. , 2003, The Analyst.

[53]  Chrysanthos Dellarocas,et al.  Analyzing the economic efficiency of eBay-like online reputation reporting mechanisms , 2011, EC '01.

[54]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[55]  Luc Steels,et al.  The Artificial Life Roots of Artificial Intelligence , 1994, Artif. Life.

[56]  Brian Neil Levine,et al.  Cheat-proof playout for centralized and distributed online games , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[57]  Leonardo Dagum,et al.  Three-dimensional direct particle simulation on the Connection Machine , 1991 .

[58]  Hans Vangheluwe,et al.  Processing causal block diagrams with graph-grammars in AToM3 , 2002 .

[59]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[60]  Gabriel Wainer,et al.  Timed cell-DEVS: modeling and simulation of cell spaces , 2001 .

[61]  Godfried T. Toussaint,et al.  The relative neighbourhood graph of a finite planar set , 1980, Pattern Recognit..

[62]  Martin Mauve,et al.  How to Keep a Dead Man from Shooting , 2000, IDMS.

[63]  Adriano J. de O. Cruz,et al.  Online Coevolution for Action Games , 2002, Int. J. Intell. Games Simul..

[64]  Lotfi A. Zadeh,et al.  Fuzzy Sets , 1996, Inf. Control..

[65]  Chrysanthos Dellarocas,et al.  The Design of Reliable Trust Management Systems for Electronic Trading Communities , 2000 .

[66]  Charles E. McDowell,et al.  Modeling Speedup greater than n , 1989, International Conference on Parallel Processing.

[67]  Hector Garcia-Molina,et al.  The Eigentrust algorithm for reputation management in P2P networks , 2003, WWW '03.

[68]  Alex M. Andrew,et al.  Reinforcement Learning: : An Introduction , 1998 .

[69]  Michael Zyda,et al.  Networked virtual environments - desgin and implementation , 1999 .

[70]  Sugih Jamin,et al.  An Efficient Synchronization Mechanism for Mirrored Game Architectures , 2002, NetGames '02.

[71]  Munindar P. Singh,et al.  A Social Mechanism of Reputation Management in Electronic Communities , 2000, CIA.

[72]  Barbara Liskov,et al.  Program Development in Java - Abstraction, Specification, and Object-Oriented Design , 1986 .

[73]  Jörg Widmer,et al.  A generic proxy system for networked computer games , 2002, NetGames '02.

[74]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.