Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
2 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on bias in ai
2 notes
When the Judge Changes, So Does the Measurement: Auditing LLM-as-Judge Reliability
The paper investigates how changes in the evaluators used by large language models (LLMs) to score candidate responses can impact the model's performance and reliability. The study examines two common upgrade paths for…
The Blind Curator: How a Biased Judge Silently Disables Skill Retirement in Self-Evolving Agents
The authors investigate how a biased judge affects the retirement of skills in self-evolving agents, particularly in reference-free tasks. They show that a biased judge can cause a mechanism failure they call 'silent…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
