Game Arena: Strategic LLM Evaluation in Competitive Environments

Source facts

The technical report describes Kaggle Game Arena, an open platform for head-to-head LLM evaluation in structured competitive environments. It covers pilot environments for chess, poker, and Werewolf, spanning perfect information, imperfect information, and multiplayer settings, with metrics and full competitions across models. The report emphasizes ground-truth-based evaluation and extensibility to new games and variants.

Analysis

Competitive environments provide a moving evaluation target that can test planning, adaptation, and robustness under uncertainty without relying only on static benchmark scores. The platform is a first-party technical project description, not evidence of a commercial financing or deployment event.

Uncertainty/Doubt

• This is an arXiv technical report. The report's reproducibility and generalization claims, and the relationship between game performance and real-world task performance, were not independently audited here.