Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
2 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on performance metrics
2 notes
Grouping the Stochastic Machine: Precision, Not Capability, as the Frontier Metric for AI Systems
The author argues that precision, rather than capability, should be the focus when comparing and measuring AI systems. Precision refers to how consistently an AI system performs the same task, while capability is where…
What Current AI Benchmarks Leave Unmeasured: Modality, Search, Citations, and Implications (for Safety Evaluations)
The study compares two access modalities of a large language model (LLM), ChatGPT's chat UI and OpenAI's API, with and without web search enabled. The research shows that the accuracy of responses varies between the…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
