Probabilistic opponent-model search

Abstract A new approach for heuristic game-tree search, probabilistic opponent-model search (PrOM search), is proposed. It is based on standard opponent-model search (OM search). The new approach takes into account a multiple-opponent model. It incorporates uncertainty which mimics the uncertainty of a player about the behaviour of the opponent. Some theoretical results on PrOM search are derived. Implementations of both OM and PrOM search (both with β -passing) are presented and best-case analyses are given. To investigate the computational efficiency, experiments are performed on random game trees. PrOM search appears to lead to serious computational costs when the search depth increases. To test the effectiveness of OM and PrOM search in practice, three tournaments in the game of LOA are performed. The tournaments suggest that PrOM search is more effective than α – β search when search trees of the same depth are used. The tournaments also show that OM search performs not very good and sometimes even disastrous. In spite of the computational costs, the encouraging results of the tournaments and the opportunity that PrOM search offers for actual opponent modelling during the search makes PrOM search a viable alternative to minimax-based search algorithms.

[1]  Hiroyuki Iida,et al.  Potential Applications of Opponent-Model Search , 1994, J. Int. Comput. Games Assoc..

[2]  M. M. Newborn,et al.  The Efficiency of the Alpha-Beta Search on Trees with Branch-Dependent Terminal Node Scores , 1977, Artif. Intell..

[3]  David Carmel,et al.  Pruning Algorithms for Multi-Model Adversary Search , 1998, Artif. Intell..

[4]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[5]  Bruce W. Ballard,et al.  Non-Minimax Search Strategies for Use Against Fallible Opponents , 1983, AAAI.

[6]  Hiroyuki Iida,et al.  Tutoring Strategies in Game-Tree Search , 1995, J. Int. Comput. Games Assoc..

[7]  H. Jaap van den Herik,et al.  Learning Time Allocation Using Neural Networks , 2000, Computers and Games.

[8]  Hiroyuki Iida,et al.  Opponent-model search , 1993 .

[9]  Peter J. Jansen,et al.  Using knowledge about the opponent in game-tree search , 1992 .

[10]  James R. Slagle,et al.  Experiments with the M & N tree-searching program , 1970, CACM.

[11]  Andreas Junghanns,et al.  Are there Practical Alternatives to Alpha-Beta? , 1998, J. Int. Comput. Games Assoc..

[12]  James R. Slagle,et al.  Experiments With Some Programs That Search Game Trees , 1969, JACM.

[13]  Sid Sackson,et al.  A Gamut of Games , 1969 .

[14]  Peter J. Jansen KQKR: Speculatively Thwarting a Human Opponent , 1993, J. Int. Comput. Games Assoc..

[15]  David Carmel,et al.  Incorporating Opponent Models into Adversary Search , 1996, AAAI/IAAI, Vol. 1.

[16]  Hiroyuki Iida,et al.  Potential Applications of Opponent-Model Search , 1994, J. Int. Comput. Games Assoc..

[17]  Bruce W. Ballard,et al.  The *-Minimax Search Procedure for Trees Containing Chance Nodes , 1983, Artif. Intell..

[18]  Donald E. Knuth,et al.  The Solution for the Branching Factor of the Alpha-Beta Pruning Algorithm , 1981, ICALP.