COMPUTING “ELO RATINGS” OF MOVE PATTERNS IN THE GAME OF GO¹

Article type: Research Article

Authors: Coulom, Rémi²

Affiliations: Lille, France

Note: [1] This article is a revised version of a contribution with the same title to the Computer Games Workshop 2007 held in Amsterdam, The Netherlands, June 15-17, 2007. The revised version has been subjected to the Journal’s normal refereeing procedure.

Note: [2] Université Charles de Gaulle, INRIA SEQUEL, CNRS GRAPPA, Lille, France. Email: [email protected]

Abstract: Move patterns are an essential method to incorporate domain knowledge into Go-playing programs. This article presents a new Bayesian technique for supervised learning of such patterns from game records. The technique is based on a generalization of Elo ratings. Each sample move in the training data is considered as a victory of a team of pattern features. The “Elo ratings” of individual pattern features are computed from these victories, and will be used in previously unseen positions to compute a probability distribution over legal moves. In this approach, several pattern features may be combined, without an exponential cost in the number of features. Despite a very small number of training games (652), this algorithm outperforms most previous pattern-learning algorithms, both in terms of mean log-evidence (–2.69), and prediction rate (34.9%). By using these patterns, the 19 × 19 Monte-Carlo program CRAZY STONE reached the level of the strongest classical programs.

DOI: 10.3233/ICG-2007-30403

Journal: ICGA Journal, vol. 30, no. 4, pp. 198-208, 2007