Evolving Neural Networks to cus imax Search

Neural networks were evolved through genetic algorithms to focus minimax search in the game of Othello. At each level of the search tree, the focus networks decide which moves are promising enough to be explored further. The networks effectively hide problem states from minimax based on the knowledge they have evolved about the limitations of minimax and the evaluation function. Focus networks were encoded in markerbased chromosomes and were evolved against a full-width minimax opponent that used the same evaluation function. The networks were able to guide the search away from poor information, resulting in stronger play while examining fewer states. When evolved with a highly sophisticated evaluation function of the Bill program, the system was able to match Bill’s performance while only searching a subset of the moves.

[1]  Claude E. Shannon,et al.  Programming a computer for playing chess , 1950 .

[2]  Geoffrey E. Hinton,et al.  Learning internal representations by error propagation , 1986 .

[3]  Paul S. Rosenbloom,et al.  A World-Championship-Level Othello Program , 1982, Artif. Intell..

[4]  Kai-Fu Lee,et al.  The Development of a World Class Othello Program , 1990, Artif. Intell..

[5]  Brad Fullmer,et al.  Evolving Finite State Behavior using Marker-Based Genetic Encoding of Neural Networks , 1991 .

[6]  David A. McAllester Conspiracy Numbers for Min-Max Search , 1988, Artif. Intell..

[7]  Ronald L. Rivest,et al.  Game Tree Searching by Min/Max Approximation , 1987, Artif. Intell..

[8]  R. E. Korf,et al.  Search: A survey of recent results , 1988 .

[9]  Richard E. Korf,et al.  Best-First Minimax Search: Othello Results , 1994, AAAI.

[10]  Donald E. Knuth,et al.  The Solution for the Branching Factor of the Alpha-Beta Pruning Algorithm , 1981, ICALP.

[11]  Daniel Edwards,et al.  The Alpha-Beta Heuristic , 1963 .

[12]  Risto Miikkulainen,et al.  Evolving Complex Othello Strategies Using Marker-Based Genetic Encoding ofNeural Networks , 1993 .

[13]  Risto Miikkulainen,et al.  Improving game-tree search with evolutionary neural networks , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[14]  Othar Hansson,et al.  Heuristic Search as Evidential Reasoning , 2013, UAI 1989.

[15]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[16]  Jesfis Peral,et al.  Heuristics -- intelligent search strategies for computer problem solving , 1984 .

[17]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .