Creating a multi-purpose first person shooter bot with reinforcement learning

Reinforcement learning is well suited to first person shooter bot artificial intelligence as it has the potential to create diverse behaviors without the need to implicitly code them. This paper compares three different reinforcement learning approaches to create a bot with a universal behavior set. Results show that using a hierarchical or rule based approach, combined with reinforcement learning, is a promising solution to creating first person shooter bots that offer a rich and diverse behavior set.

[1]  Brahim Chaib-draa,et al.  Reducing the complexity of multiagent reinforcement learning , 2007, AAMAS '07.

[2]  Christopher M. Vigorito.  Distributed path planning for mobile robots using a swarm of interacting reinforcement learners , 2007, AAMAS '07.

[3]  Marcus Gallagher,et al.  Learning to be a Bot: Reinforcement Learning in Shooter Games , 2008, AIIDE.

[4]  Shahar Cohen,et al.  Reinforcement Learning with Hierarchical Decision-Making , 2006, Sixth International Conference on Intelligent Systems Design and Applications.

[5]  Thore Graepel,et al.  LEARNING TO FIGHT , 2004 .

[6]  Manfred Huber,et al.  A hybrid architecture for hierarchical reinforcement learning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[7]  Hector Muñoz-Avila,et al.  RETALIATE: Learning Winning Policies in First-Person Shooter Games , 2007, AAAI.

[8]  Toshihiko Watanabe,et al.  Hierarchical reinforcement learning using a modular fuzzy model for multi-agent problem , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[9]  Shin Ishii,et al.  A multi-agent reinforcement learning method for a partially-observable competitive game , 2001, AGENTS '01.

[10]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[11]  Kathryn E. Merrick,et al.  Modeling motivation for adaptive nonplayer characters in dynamic computer game worlds , 2008, CIE.

[12]  Shimon Whiteson,et al.  Evolutionary Function Approximation for Reinforcement Learning , 2006, J. Mach. Learn. Res..