A Turing Test for Computer Game Bots

In this paper, a version of the Turing Test is proposed, to test the ability of computer game playing agents (ldquobotsrdquo) to imitate human game players. The proposed test has been implemented as a bot design and programming competition, the 2K BotPrize Contest. The results of the 2008 competition are presented and analyzed. We find that the Test is challenging, but that current techniques show promise. We also suggest probable future directions for developing improved bots.

[1]  M. V. Wilkes,et al.  Can Machines Think? , 1953, Proceedings of the IRE.

[2]  K. Gunderson.  VII.—THE IMITATION GAME , 1964 .

[3]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[4]  N. Block.  Psychologism and Behaviorism , 1981 .

[5]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[6]  John R. Searle,et al.  Minds, brains, and programs , 1980, Behavioral and Brain Sciences.

[7]  R. French.  Subcognition and the Limits of the TuringTest , 1990 .

[8]  A. M. Turing,et al.  Computing Machinery and Intelligence , 1950, The Philosophy of Artificial Intelligence.

[9]  Donald Michie,et al.  Turing's Test and Conscious Thought , 1993, Artif. Intell..

[10]  Stuart M. Shieber,et al.  Lessons from a restricted Turing test , 1994, CACM.

[11]  Ned Block,et al.  The Mind as the Software of the Brain , 1995 .

[12]  Ronald C. Arkin,et al.  An Behavior-based Robotics , 1998 .

[13]  John E. Laird,et al.  Creating Human-like Synthetic Characters with Multiple Skill Levels: A Case Study using the Soar Quakebot , 2001 .

[14]  Aaron Khoo,et al.  Efficient, Realistic NPC Control Systems using Behavior-Based Techniques , 2002 .

[15]  Andrew Stern,et al.  A Behavior Language for Story-Based Believable Agents , 2002, IEEE Intell. Syst..

[16]  Ricardo Ribeiro Gudwin,et al.  Using a semiotics-inspired tool for the control of intelligent opponents in computer games , 2003, IEMC '03 Proceedings. Managing Technologically Driven Organizations: The Human Side of Innovation and Change (IEEE Cat. No.03CH37502).

[17]  S. Shieber.  Subcognition and the Limits of the Turing Test , 2004 .

[18]  Varol Akman,et al.  Turing Test: 50 Years Later , 2000, Minds and Machines.

[19]  Stuart M. Shieber,et al.  On the Point of the Imitation Game , 2004 .

[20]  S. Shieber.  Beating the Imitation Game , 2004 .

[21]  Ah-Hwee Tan,et al.  FALCON: a fusion architecture for learning, cognition, and navigation , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[22]  Christian Bauckhage,et al.  Believability Testing and Bayesian Imitation in Interactive Computer Games , 2006, SAB.

[23]  Rudolf Kadlec,et al.  POGAMUT 2 - A PLATFORM FOR FAST DEVELOPMENT OF VIRTUAL AGENTS' BEHAVIOR , 2007 .

[24]  Ah-Hwee Tan,et al.  Integrating Temporal Difference Methods and Self-Organizing Neural Networks for Reinforcement Learning With Delayed Evaluative Feedback , 2008, IEEE Transactions on Neural Networks.

[25]  Philip Hingston,et al.  Bots trained to play like a human are more fun , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[26]  Vadim Bulitko,et al.  An evaluation of models for predicting opponent positions in first-person shooter video games , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[27]  Bobby D. Bryant,et al.  Visual control in quake II with a cyclic controller , 2008, 2008 IEEE Symposium On Computational Intelligence and Games.

[28]  Shelly Li.  The imitation game , 2009, Nature.

[29]  Cyrill Stachniss,et al.  Robotic Mapping and Exploration , 2009, Springer Tracts in Advanced Robotics.

[30]  Ah-Hwee Tan,et al.  Creating Human-like Autonomous Players in Real-time First Person Shooter Computer Games , 2009 .

[31]  V. Shaygannejad.  In response , 2009, Journal of research in medical sciences : the official journal of Isfahan University of Medical Sciences.