FIELD NOTES TOPIC

benchmark scoring

1 note, newest first.

  1. How Benchmarks Mis-Score Computer-Use Agents

    Source note ·

    A research paper discusses issues with the scoring system of computer-use agents (software that navigates the web and operates desktop software). The authors argue that current scores are often inaccurate due to…