Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
2 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on statistical models
2 notes
Can We Trust Item Response Theory for AI Evaluation?
The paper examines the reliability of using Item Response Theory (IRT) for evaluating AI systems in large-scale benchmarks. The authors simulate response matrices under three common IRT models, comparing four…
Can We Trust Item Response Theory for AI Evaluation?
This research investigates the reliability of using Item Response Theory (IRT) for evaluating Artificial Intelligence (AI). The study finds that classical estimators can become infeasible in large benchmark settings…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
