標題: An investigation of strength analysis metrics for game-playing programs: A case study in Chinese dark chess
作者: Hsueh, Chu-Hsuan
Wu, I-Chen
Hsu, Tsan-Sheng
Chen, Jr-Chang
資訊工程學系
Department of Computer Science
關鍵字: Chinese dark chess;strength analysis;optimal player;game-playing program
公開日期: 1-Jan-2018
摘要: For developers of game-playing programs, it is an important but non-trivial task to measure the strengths of the programs, especially with respect to the theoretically optimal players. The optimal players are hard to obtain in practice since many real-world games are too hard to solve entirely. In this paper, a reduced version of Chinese dark chess (CDC), 2 x 4 CDC, which has been solved, is used as a testbed to analyze the strengths of game-playing programs for CDC, a non-deterministic game. Absolute strength is then defined to be the win rates against the optimal player. Experiment results show that win rates against designated baseline programs are a good metric, since these win rates are highly correlated to absolute strengths. The stronger the designated baseline programs are, the higher the correlations of win rates are to the absolute strengths. In addition, it is shown that prediction rates and mean squared errors are other good metrics and have high correlations to the absolute strengths. The experiment results also show that the win rates obtained in 2 x 4 CDC have a high correlation to those in the original 4 x 8 CDC, except for those using the technique of progressive bias.
URI: http://dx.doi.org/10.3233/ICG-180046
http://hdl.handle.net/11536/148285
ISSN: 1389-6911
DOI: 10.3233/ICG-180046
期刊: ICGA JOURNAL
Volume: 40
起始頁: 77
結束頁: 104
Appears in Collections:Articles