applications
14 notes, newest first.
BrickBench: Evaluating Agentic Brick Design
The preprint introduces BrickBench, a benchmark for text-conditioned LEGO-set design. Agents must produce assemblies that satisfy semantic and design criteria while remaining physically buildable, selecting parts from…
Use and Disuse: Intent-Structured Experience Consolidation for Memory and Learning in LLM Agents
The preprint proposes Hippocam, a hierarchical memory and continual-learning architecture that organizes ongoing work as nested intents. Active context stays centered on the current intent, while completed intents are…
nanoMuse: An Open-Source Personal Agent for Every Device You Own
The preprint presents nanoMuse as an open-source counterpart to persistent personal agents that operate across a user's accounts and devices. It describes a shared conversation over a user-runnable relay, a Sentinel…
Sherpa: Teaching LLMs to Teach Adaptively
The preprint introduces Sherpa, a multi-turn reinforcement-learning framework that trains an LLM teacher against multiple student archetypes with distinct learning preferences. The teacher is optimized directly against…
Agent in a Bottle: Can LLM Agents Turn Their Capabilities Into Cheap, Scalable Artifacts?
The preprint introduces BOTTLED, a benchmark in which agents receive an unlabelled workload and must complete it under fixed time, compute, and LLM API budgets. Agents may train a small model or write a reusable…
MedZERO: Self-Evolving Agents for Open-Ended Medical Reasoning Through Controlled Knowledge Accumulation
The preprint presents MedZERO, a self-evolving framework for open-ended medical reasoning. An Examiner generates medical question-option pairs, while a Reasoner solves them with evidence-grounded multi-turn reasoning…
WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?
The preprint introduces WorldSolver, a benchmark of 168 simulation tasks derived from physical phenomena in 61 classic computer-graphics papers across seven physical domains. Each task provides a code scaffold while…
From Benchmarks to Production: A Text-to-SQL System for Complex Financial Data
The preprint describes Financial LINking Text-to-SQL (FLINT), a domain-specialized system for financial databases whose concepts are stored as opaque integer keys. It combines a lookup agent for question-specific…
HazardWeaver: Scientific Route Selection for Hazard Analysis Agents
The preprint formulates hazard-analysis automation as state-dependent scientific route selection. HazardWeaver combines an evidence-linked Hazard Knowledge Compiler with a Hazard Capability Graph that checks…
Mimir: Physics-Grounded LLM Agents for Long-Horizon Irrigation Control
The preprint studies long-running irrigation decisions where actions change future states and errors compound. Mimir combines a structured physical interface, deterministic simulation, verified revision, bounded action…
OpenMTB-Audit: Exposing Over-Refusal and Clinical Expert Perspectives in LLM-Based Molecular Tumor Board Safety Evaluation
The preprint introduces a benchmark of 500 synthetic non-small-cell lung-cancer cases with four safety labels, including Supported, Partially Supported, Unsupported, and Insufficient Information. Across eight model…
A Living Benchmark for Information Retrieval from Electronic Health Records
The paper presents BRIE, a continuously maintainable benchmark for retrieving information from longitudinal electronic health records. The framework automatically generates question-answer pairs from EHR notes; 19…
StudentBench: AI and human tutoring yield equivalent GRE learning gains
StudentBench is a public AI-tutoring evaluation platform built from more than 175,000 student-AI messages. The preprint reports a study of 2,383 human participants assigned to AI tutoring, expert human tutoring, or no…
The future of practice: Enabling teachers to create learning interactives with generative UI
Google Research describes a system that generates guided, interactive STEM simulations from teacher objectives using generative UI and pedagogical guardrails. It released a library of more than 30 teacher-vetted…
