PROBE: Learning to Audit Policy Compliance in Tool-Using LLM Agents

Source facts

PROBE trains LLM-based auditors to interact with deployed agents as realistic users and probe for policy violations across multi-turn, tool-mediated dialogue. It formulates auditing as a two-player Markov game and balances violation discovery, behavioral plausibility, conversation progress, and policy diversity. The abstract reports broader and higher-yield violation discovery than same-architecture zero-shot adversaries in controlled experiments.

Analysis

The paper separates policy-compliance auditing from capability benchmarks and content-safety red-teaming. Multi-turn probes may reveal violations that only appear after tool calls or downstream state changes, but the audit quality still depends on the policy formalization and reward design used to train the auditor.

Uncertainty/Doubt

• This is an arXiv preprint. The controlled setting, reward comparisons, and transfer to deployed agents were not independently reproduced here.