FIELD NOTES TOPIC
statistics
3 notes, newest first.
AV-AIVAT: 74x Cheaper Agent Evaluation with Certified Anytime-Valid Stopping in Imperfect-Information Games
Researchers present AV-AIVAT, a tool that uses AIVAT for variance reduction in imperfect-information games and combines it with Confidence Sequences (CS) for anytime-valid evaluation. The new method reduces the number…
Solution of the Hempel's statistical ambiguity problem and Causal AI
The paper presents a solution to Hempel's statistical ambiguity problem in inductive-statistical inference by introducing the concept of Maximally Specific Causal Relationships (MSCRs). The MSCRs are derived from a…
When Does Combining Language Models Help? A Co-Failure Ceiling on Routing, Voting, and Mixture-of-Agents Across 67 Frontier Models
The text discusses multi-model language model systems and their potential to outperform single-models in terms of accuracy. The study shows that the gain is limited by a quantity called 'beta', which represents the…
