Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
2 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on security evaluation
2 notes
Beyond Success Rate: Cost-Aware Evaluation of Offensive and Defensive Security Agents
The authors propose a new approach for evaluating security agents, focusing on cost-effectiveness rather than just success rate. They evaluate language models on offensive and defensive tasks, comparing performance at…
Beyond Attack-Success Rate: Action-Graded Severity Scale for Tool-Using AI Agents
The paper proposes an action-graded harm rubric for evaluating AI agents' behavior during cybersecurity attacks. This scale assesses the severity of an agent's actions based on factors like reversibility, scope…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
