High-Level Language to Build Poker Agents

On the last decade Poker has been one of the most interesting subjects for artificial intelligence, because it is a game that requires game playing agents to deal with an incomplete information and stochastic scenario. The development of Poker agents has seen significant advances but it is still hard to evaluate agents’ performance against human players. This is either because it is illicit to use agents in online games, or because human players cannot create agents that play like themselves due to lack of knowledge on computer science and/or AI. The purpose of this work is to fill the gap between poker players and AI in Poker by allowing players without programming skills to build their own agents. To meet this goal, a high-level language of poker concepts – PokerLang – was created, whose structure is easy to read and interpret for domain experts. This language allows for the quick definition of an agent strategy. A graphical application was also created to support the writing of PokerLang strategies. To validate this approach, some Poker players created their agents using the graphical application. Results validated the usability of the application and the language that supports it. Moreover, the created agents showed very good results against agents developed by other experts.

[1]  Michael R Cohen,et al.  Two Plus Two , 1990 .

[2]  Jonathan Schaeffer,et al.  A World Championship Caliber Checkers Program , 1992, Artif. Intell..

[3]  Dione. Brunson.  Super/System A Course in Power Poker , 1994 .

[4]  Gerald Tesauro,et al.  Temporal difference learning and TD-Gammon , 1995, CACM.

[5]  Monty Newborn,et al.  Kasparov versus Deep Blue - computer chess comes of age , 1996 .

[6]  Michael Buro,et al.  The Othello Match of the Year: Takeshi Murakami vs. Logistello , 1997, J. Int. Comput. Games Assoc..

[7]  D. Papp.  Dealing with imperfect information in poker , 1998 .

[8]  Jonathan Schaeffer,et al.  Opponent Modeling in Poker , 1998, AAAI/IAAI.

[9]  Jonathan Schaeffer,et al.  Using Selective-Sampling Simulations in Poker , 1999 .

[10]  Luís Paulo Reis,et al.  FC Portugal Team Description: RoboCup 2000 Simulation League Champion , 2000, RoboCup.

[11]  Luís Paulo Reis,et al.  A Language for Specifying Complete Timetabling Problems , 2000, PATAT.

[12]  C. Cheeseman,et al.  University of Alberta. , 2000, Academic medicine : journal of the Association of American Medical Colleges.

[13]  Luís Paulo Reis,et al.  Situation Based Strategic Positioning for Coordinating a Team of Homogeneous Agents , 2000, Balancing Reactivity and Social Deliberation in Multi-Agent Systems.

[14]  Enrico Pagello,et al.  Balancing Reactivity and Social Deliberation in Multi-Agent Systems , 2001, Lecture Notes in Computer Science.

[15]  Luís Paulo Reis,et al.  COACH UNILANG - A Standard Language for Coaching a (Robo)Soccer Team , 2001, RoboCup.

[16]  Edmund K. Burke,et al.  Practice and Theory of Automated Timetabling III , 2001, Lecture Notes in Computer Science.

[17]  Maarten van Someren,et al.  Advances in Machine Learning , 2021, Advances in Computational Intelligence and Learning.

[18]  Jonathan Schaeffer,et al.  Approximating Game-Theoretic Optimal Strategies for Full-scale Poker , 2003, IJCAI.

[19]  Luís Paulo Reis,et al.  ECOLANG - A communication language for simulations of complex ecological systems , 2005 .

[20]  Tuomas Sandholm,et al.  A Competitive Texas Hold'em Poker Player via Automated Abstraction and Real-Time Equilibrium Computation , 2006, AAAI.

[21]  Michael L. Littman,et al.  The 2006 AAAI Computer Poker Competition , 2006 .

[22]  Darse Billings.  Algorithms and assessment in computer poker , 2006 .

[23]  Michael H. Bowling,et al.  A New Algorithm for Generating Equilibria in Massive Zero-Sum Games , 2007, AAAI.

[24]  Gerson Zaverucha,et al.  Advances in Artificial Intelligence - SBIA 2008, 19th Brazilian Symposium on Artificial Intelligence, Savador, Brazil, October 26-30, 2008. Proceedings , 2008, SBIA.

[25]  Dinis Félix,et al.  Opponent Modelling in Texas Hold'em Poker as the Key for Success , 2008, ECAI.

[26]  Dinis Félix,et al.  An Experimental Approach to Online Opponent Modeling in Texas Hold'em Poker , 2008, SBIA.

[27]  Dinis Félix.  Artificial Intelligence Techniques in Games with Incomplete Information : Opponent Modelling in Texas Hold'em , 2008 .

[28]  Guy Van den Broeck,et al.  Monte-Carlo Tree Search in Poker Using Expected Reward Distributions , 2009, ACML.

[29]  Michael H. Bowling,et al.  Data Biased Robust Counter Strategies , 2009, AISTATS.

[30]  Ian D. Watson,et al.  Computer poker: A review , 2011, Artif. Intell..

[31]  Luís Paulo Reis,et al.  Multi-robot coordination using Setplays in the middle-size and simulation leagues , 2011, Mechatronics.

[32]  Luís Paulo Reis,et al.  Building a No Limit Texas Hold'em Poker Agent Based on Game Logs Using Supervised Learning , 2011, AIS.

[33]  Luis Paulo Reis,et al.  HoldemML: A framework to generate No Limit Hold'em Poker agents from human player strategies , 2011, 6th Iberian Conference on Information Systems and Technologies (CISTI 2011).

[34]  Luís Paulo Reis,et al.  Adapting Strategies to Opponent Models in Incomplete Information Games: A Reinforcement Learning Approach for Poker , 2012, AIS.

[35]  Rosaldo J. F. Rossetti,et al.  A simulation system to support computer poker research , 2012 .

[36]  L. P. Reis,et al.  A multi-agent system to help Farmville players on game management tasks , 2012, 7th Iberian Conference on Information Systems and Technologies (CISTI 2012).

[37]  Ian D. Watson,et al.  Case-based strategies in computer poker , 2012, AI Commun..

[38]  Luís Paulo Reis,et al.  Performance analysis in soccer: a Cartesian coordinates based approach using RoboCup data , 2011, Soft Computing.

[39]  Dinis Félix,et al.  Computer Poker Research at LIACC , 2013, ArXiv.