FIELD NOTES TOPIC
miscalibrated confidence
2 notes, newest first.
One Human, $N$ Agents: Audit-Budget Allocation for LLM Agent Fleets under Miscalibrated, Correlated Confidence
Researchers propose a model for auditing a large number of LLM agents with limited budget, where agents' self-reported confidence may be misleading. The study finds that when the confidence is adversarially…
One Human, $N$ Agents: Audit-Budget Allocation for LLM Agent Fleets under Miscalibrated, Correlated Confidence
The paper discusses a scenario where a single human auditor has to evaluate multiple LLM (Language Learning Models) agents under a limited budget. The authors model this process as a noisy inspection over a two-level…
