FIELD NOTES TOPIC

red-team evaluation

1 note, newest first.

  1. Beyond Attack-Success Rate: Action-Graded Severity Scale for Tool-Using AI Agents

    Source note ·

    The paper introduces an action-graded harm rubric for evaluating AI agents in a red-teaming scenario. This new method rates the severity of an agent's actions on a seven-level scale, considering factors such as…