FIELD NOTES TOPIC
security agents
2 notes, newest first.
Beyond Success Rate: Cost-Aware Evaluation of Offensive and Defensive Security Agents
The authors propose a new approach for evaluating security agents by focusing on their cost-effectiveness instead of just their success rate in offensive and defensive tasks. They demonstrate this using language models…
Beyond Success Rate: Cost-Aware Evaluation of Offensive and Defensive Security Agents
The researchers evaluated language model security agents based on cost efficiency in addition to their success rates, focusing on offensive CTF challenges and defensive Splunk BOTS v1 investigation challenges. They…
