Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
3 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on failure analysis
3 notes
How Benchmarks Mis-Score Computer-Use Agents
A research paper discusses issues with the scoring system of computer-use agents (software that navigates the web and operates desktop software). The authors argue that current scores are often inaccurate due to…
Failures Reveal What Metrics Miss: An Evidence-Driven Agent for Recursive Refinement of ECG Classifiers
Researchers present a new framework called RecursiveECG that uses a language model (LLM) to automatically design ECG classifiers by learning from specific failures and objective ECG evidence. The LLM is used as an…
Concept-Guided Spatial Regularization for World Models in Atari Pong
Researchers evaluate five world model agents in Atari Pong and find inconsistencies and failures in the generated video trajectories. They hypothesize that insufficient modeling of task-critical concepts may contribute…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
