Field notes

2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.

Every note is in the list below. The web of topics draws here once the page has loaded.

1 of 2,343 notes matches.

Question answered
Source note
Topic
Shared notes

Notes on brittle scripted oracles

1 note

How Benchmarks Mis-Score Computer-Use Agents
Source note · Jul 30, 2026 · computer-use agents, audit
The paper discusses issues with the scoring of Computer-Use Agents (CUAs) using brittle scripted oracles, highlighting problems such as outdated tasks, omitted decisive visual evidence, and hidden failure causes in…

An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.

Notes on brittle scripted oracles

How Benchmarks Mis-Score Computer-Use Agents