FIELD NOTES TOPIC
agent behavior
2 notes, newest first.
Beyond Attack-Success Rate: Action-Graded Severity Scale for Tool-Using AI Agents
The paper proposes an action-graded harm rubric for evaluating AI agents' behavior during cybersecurity attacks. This scale assesses the severity of an agent's actions based on factors like reversibility, scope…
SkillFuzz: Fuzzing Skill Composition for Implicit Intents Discovery in Open Skill Marketplaces
The paper presents SkillFuzz, an execution-free testing approach that helps detect unintended objectives (implicit intents) in large language model (LLM)-based agents operating on open skill marketplaces. SkillFuzz…
