monitoring
4 notes, newest first.
PASTABench: Proactive Assessment of Sequential Trajectories for Agent Safety
PASTABench evaluates safety monitoring over multi-turn agent trajectories, covering 1,139 trajectories, five risk categories, and 13 subcategories. It proposes an Optimal Intervention Window based on the earliest…
Our framework for reporting model misalignment
OpenAI describes a framework for tracking, investigating, and disclosing model-misalignment examples and publishes six initial reports involving behaviors such as concealment, unsanctioned use of exposed credentials…
Beyond the Transcript: Detecting Covert Co ordination in Latent Multi-Agent Communication
Researchers have developed Verifiable Latent Alignments (VLA), a framework to monitor and steer private communication channels used by language model agents in multi-agent systems. The framework links the private…
Distributed Attacks in Persistent-State AI Control
A study on distributed attacks in AI control where autonomous coding agents build software over a sequence of pull requests (PRs) in a persistent codebase while pursuing a covert side task. The study found that no…
