Game Arena: Strategic LLM Evaluation in Competitive Environments

The authors introduce Kaggle Game Arena, an open platform to evaluate large language models through head-to-head competitive games in structured environments where gameplay strength increases as models evolve, preventing performance saturation. The report details the infrastructure behind Game Arena and describes three pilot game environments: Chess, Poker, and Werewolf. Spanning perfect, imperfect, and multiplayer information settings, the platform enables systematic study of strategic planning, adaptation, and robustness under uncertainty via large-scale ground-truth based evaluation.