HyperBrowseComp: A Multilingual and Multimodal Stress Test for Web-Browsing Agents

Source facts

The preprint presents 423 manually authored and human-validated questions across 13 languages. Items require obscure evidence discovery, multi-step clue chains, and heterogeneous sources such as videos, scanned documents, images, or maps. The authors evaluate provider-native search and a shared retrieval harness under a common protocol, with human evaluation on a sample.

Analysis

The benchmark frames browsing ability as persistent evidence acquisition across languages and modalities, not only answer generation. It is relevant to production agents whose failure modes include missed evidence, brittle source chaining, and overreliance on parametric knowledge.

Uncertainty/Doubt

• This is an arXiv preprint. The benchmark's task difficulty, language balance, and reported model comparisons were not independently reproduced here.