retrieval
8 notes, newest first.
RATED: Reliability-Aware AI Agent Tool Retrieval via Execution Dynamics
RATED combines a frozen dual encoder for semantic matching with a lightweight contextual-bandit module that reranks tools using real-time execution feedback. The authors introduce EcoAgent, a benchmark of 5,172 tools…
HyperBrowseComp: A Multilingual and Multimodal Stress Test for Web-Browsing Agents
The preprint presents 423 manually authored and human-validated questions across 13 languages. Items require obscure evidence discovery, multi-step clue chains, and heterogeneous sources such as videos, scanned…
ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research
The preprint builds a benchmark from judgments by 184 lead authors of 207 recent computer-science papers, who identified prior papers that advanced or could have advanced their projects and provided rationales. The…
A Living Benchmark for Information Retrieval from Electronic Health Records
The paper presents BRIE, a continuously maintainable benchmark for retrieving information from longitudinal electronic health records. The framework automatically generates question-answer pairs from EHR notes; 19…
BackTrend: Evaluating Scientific Weak-Signal Prediction via Backward Reconstruction
BackTrend is a retrospective benchmark that asks systems to recover early problem-space and solution-space precursors for mature AI/ML topics under temporal evidence constraints. It contains 25 mature topics and 66…
RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents
RAFT models each closed support case as a directed chain of timeline entries and retrieves at the entry level, returning the parent-case trajectory anchored at a matching state. It evaluates against a synthetic…
Bypassing inference bottlenecks: Accelerating complex AI search with Retrieve-for-Train
Google Research describes Retrieve-for-Train as an offline reinforcement-learning process that compiles set-level rewards into training data for a lightweight diffusion retriever. The associated arXiv paper describes…
ProjAgent: Procedural Similarity Retrieval for Repository-Level Code Generation
The paper proposes ProjAgent, a new system for generating code at the repository level by introducing 'procedural similarity' as a retrieval signal. This method decomposes the target function into steps and retrieves…
