audit
4 notes, newest first.
Linguistic Triggers of Gender and Racial Bias in Open-Weight LLMs Applied to Recruitment
The authors evaluate six open-weight models across recruiter- and job-seeker-simulation tasks, varying job-posting language and persona conditions. The abstract reports gender and racial effects linked to agentic and…
How Benchmarks Mis-Score Computer-Use Agents
The paper discusses issues with the scoring of Computer-Use Agents (CUAs) using brittle scripted oracles, highlighting problems such as outdated tasks, omitted decisive visual evidence, and hidden failure causes in…
One Human, $N$ Agents: Audit-Budget Allocation for LLM Agent Fleets under Miscalibrated, Correlated Confidence
The paper presents a study on auditing multiple Language Learning Models (LLMs) with limited budgets, where human auditors have to evaluate self-reported confidence that may be miscalibrated and correlated. The…
BrainPilot: Automating Brain Discovery with Agentic Research
BrainPilot is a multi-agent system designed to accelerate brain science research using AI agents grounded in curated domain knowledge, traceable logs, and auditable records for transparency. The system is fully…
