Source note1 min read
WorldAuditBench: Interactive 3D World Auditing with Multimodal Agents
Source
arXiv
arxiv.org/abs/2609.40325v1
Source facts
The preprint presents 213 anomaly tasks across 13 Unreal Engine 5 and three.js environments, covering five anomaly families. It evaluates five frontier models under a fixed exploration budget using VLA-led exploration with VLM identification and end-to-end VLM agents. The abstract reports model success rates of 6.6% to 42.3% versus 83.4% for humans.
Analysis
This benchmark makes evidence gathering part of multimodal evaluation: an agent must navigate, search systematically, and connect visual reasoning to action. It is relevant to simulation QA, embodied evaluation, and interactive-world reliability.
Uncertainty/Doubt
- This is an arXiv preprint. The reported gap to human performance is specific to the task construction, exploration budget, environments, and evaluated models.
