FIELD NOTES TOPIC
oversight
2 notes, newest first.
What Did the Agent Actually Do? Evidence-Grounded Oversight for Long-Horizon Agents
The preprint introduces AgentMonBench, a software-engineering benchmark for judging requirement/behavior alignment and identifying consequential autonomous decisions that warrant verification. Its Evidence-Grounded…
Beyond Accuracy: How Procedural Traces Shift the Decision Criterion of LLM Overseers
The authors audit five LLM overseers on 19 compliance tasks and 4,551 judgments while varying trace detail and evidence labeling. They report that elaborate traces can shift susceptible overseers toward rejection and…
