Skill rating by Bayesian inference

Systems Engineering often involves computer modelling the behaviour of proposed systems and their components. Where a component is human, fallibility must be modelled by a stochastic agent. The identification of a model of decision-making over quantifiable options is investigated using the game-domain of Chess. Bayesian methods are used to infer the distribution of players' skill levels from the moves they play rather than from their competitive results. The approach is used on large sets of games by players across a broad FIDE Elo range, and is in principle applicable to any scenario where high-value decisions are being made under pressure.

[1]  Tom Minka,et al.  TrueSkillTM: A Bayesian Skill Rating System , 2006, NIPS.

[2]  Guy Haworth.  Gentlemen, Stop Your Engines! , 2007, J. Int. Comput. Games Assoc..

[3]  Peter J. Jansen.  KQKR: Speculatively Thwarting a Human Opponent , 1993, J. Int. Comput. Games Assoc..

[4]  A. Elo.  The rating of chessplayers, past and present , 1978 .

[5]  Peter J. Jansen.  KQKR: Awareness of a Fallible Opponent , 1992, J. Int. Comput. Games Assoc..

[6]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS THE METHOD OF PAIRED COMPARISONS , 1952 .

[7]  M. Glickman.  Parameter Estimation in Large Dynamic Paired Comparison Experiments , 1999 .

[8]  Neil Charness,et al.  Expertise in chess , 2006 .

[9]  Guy Haworth.  Reference Fallible Endgame Play , 2003, J. Int. Comput. Games Assoc..

[10]  Paul Abelson.  Stop your engines , 2005 .

[11]  P. J. Jansen.  Problematic Positions and Speculative Play , 1990 .

[12]  Peter J. Jansen,et al.  Using knowledge about the opponent in game-tree search , 1992 .

[13]  Peter J. Jansen.  KQKR: Assessing the Utility of Heuristics , 1992, J. Int. Comput. Games Assoc..

[14]  Tom Minka,et al.  TrueSkill Through Time: Revisiting the History of Chess , 2007, NIPS.

[15]  Thomas Hofmann,et al.  TrueSkill™: A Bayesian Skill Rating System , 2007 .

[16]  Ivan Bratko,et al.  Computer Analysis of World Chess Champions , 2006, J. Int. Comput. Games Assoc..

[17]  J. Beasley.  The mathematics of games , 1989 .

[18]  Rémi Coulom,et al.  Whole-History Rating: A Bayesian Rating System for Players of Time-Varying Strength , 2008, Computers and Games.

[19]  Fernand Gobet,et al.  Chess players' thinking revisited , 1998 .