Solving the Balance Problem of On-Line Role-Playing Games Using Evolutionary Algorithms

In on-line role-playing games (RPG), each race holds some attributes and skills. Each skill contains several abilities such as physical damage, hit rate, etc. Parts of the attributes and all the abilities are a function of the character’s level, which are called Ability-Increasing Functions (AIFs). A well-balanced on-line RPG is characterized by having a set of well-balanced AIFs. In this paper, we propose an evolutionary design method, including integration with an improved Probabilistic Incremental Program Evolution (PIPE) and a Cooperative Coevolutionary Algorithm (CCEA), for on-line RPGs to maintain the game balance. Moreover, we construct a simplest turn-based game model and perform a series of experiments based on it. The results indicate that the proposed method is able to obtain a set of well-balanced AIFs efficiently. They also show that in this case the CCEA outperforms the simple genetic algorithm, and that the capability of PIPE has been significantly improved through the improvement work.

[1]  K. Dejong,et al.  An analysis of the behavior of a class of genetic adaptive systems , 1975 .

[2]  Kao-Shing Hwang,et al.  Dynamic Patrol Planning in a Cooperative Multi-robot System , 2011, FIRA RoboWorld Congress.

[3]  Lothar M. Schmitt,et al.  Theory of genetic algorithms , 2001, Theor. Comput. Sci..

[4]  Liviu Panait,et al.  Theoretical Convergence Guarantees for Cooperative Coevolutionary Algorithms , 2010, Evolutionary Computation.

[5]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[6]  Jeffrey K. Bassett,et al.  An Analysis of Cooperative Coevolutionary Algorithms A dissertation submitted in partial fulfillment of the requirements for the degree of Doctor of Philosophy at George Mason University , 2003 .

[7]  R. Paul Wiegand,et al.  An empirical analysis of collaboration methods in cooperative coevolutionary algorithms , 2001 .

[8]  Hua Xu,et al.  A cooperative coevolution-based pittsburgh learning classifier system embedded with memetic feature selection , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[9]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[10]  Moshe Sipper,et al.  Fuzzy CoCo: a cooperative-coevolutionary approach to fuzzy modeling , 2001, IEEE Trans. Fuzzy Syst..

[11]  Kenneth A. De Jong,et al.  A Cooperative Coevolutionary Approach to Function Optimization , 1994, PPSN.

[12]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[13]  Rafal Salustowicz,et al.  Probabilistic Incremental Program Evolution , 1997, Evolutionary Computation.

[14]  Rudolf Paul Wiegand,et al.  An analysis of cooperative coevolutionary algorithms , 2004 .

[15]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[16]  Thomas Jansen,et al.  Exploring the Explorative Advantage of the Cooperative Coevolutionary (1+1) EA , 2003, GECCO.

[17]  Sushil J. Louis,et al.  Using coevolution to understand and validate game balance in continuous games , 2008, GECCO '08.

[18]  Colin R. Reeves,et al.  Genetic Algorithms: Principles and Perspectives: A Guide to Ga Theory , 2002 .

[19]  Nichael Lynn Cramer,et al.  A Representation for the Adaptive Generation of Simple Sequential Programs , 1985, ICGA.

[20]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[21]  Kenneth A. De Jong,et al.  Cooperative Coevolution: An Architecture for Evolving Coadapted Subcomponents , 2000, Evolutionary Computation.

[22]  Dave Morris,et al.  Game Architecture and Design: A New Edition , 2003 .

[23]  M. Vose.  The Simple Genetic Algorithm , 1999 .

[24]  Mengjie Zhang,et al.  Cooperative coevolution of Elman recurrent neural networks for chaotic time series prediction , 2012, Neurocomputing.

[25]  Kenneth A. De Jong,et al.  The Coevolution of Antibodies for Concept Learning , 1998, PPSN.

[26]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[27]  DebK.,et al.  A fast and elitist multiobjective genetic algorithm , 2002 .

[28]  Toshimitsu Tobita,et al.  An elevator group control system with floor attribute control method and system optimization using genetic algorithms , 1995, Proceedings of IECON '95 - 21st Annual Conference on IEEE Industrial Electronics.

[29]  Mitchell A. Potter,et al.  The design and analysis of a computational model of cooperative coevolution , 1997 .

[30]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[31]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[32]  Alan C. Schultz,et al.  Heterogeneity in the Coevolved Behaviors of Mobile Robots: The Emergence of Specialists , 2001, IJCAI.

[33]  Larry Bull,et al.  Evolution in Multi-agent Systems: Evolving Communicating Classifier Systems for Gait in a Quadrupedal Robot , 1995, ICGA.

[34]  Phil Husbands,et al.  Simulated Co-Evolution as the Mechanism for Emergent Planning and Scheduling , 1991, ICGA.