FIELD NOTES TOPIC
api evaluation
1 note, newest first.
VAKRA: Evaluating Multi-Hop Reasoning Across APIs and Retrieval Under Tool-Use Policies
The study introduces VAKRA, a benchmark for evaluating the ability of agents to reason across APIs and document collections in enterprise settings. The benchmark includes over 8000 executable APIs across 62 domains…
