Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
100 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on agents
100 notes, page 2 of 5
What Did the Agent Actually Do? Evidence-Grounded Oversight for Long-Horizon Agents
The preprint introduces AgentMonBench, a software-engineering benchmark for judging requirement/behavior alignment and identifying consequential autonomous decisions that warrant verification. Its Evidence-Grounded…
Can Agent Harnesses and Inference Engines Hear Each Other? The HEAR Protocol for Agentic LLM Serving
The preprint proposes HEAR, a bidirectional Harness–Engine Pairing protocol that lets an agent harness communicate workflow intent and execution requirements while the inference engine returns runtime state…
HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstention
The preprint introduces HERA, a framework that constructs verifiable feasible/infeasible task pairs through controlled environment mutations and adapts the agent harness toward prior weaknesses. The abstract reports…
Credit Where It Matters: Dependency-Aware Policy Optimization for Terminal Agents
The preprint proposes Dependency-Aware Group Policy Optimization (DepGPO) for multi-step terminal tasks. It builds a command dependency graph from execution traces, traces backward from resources inspected by a…
From Benchmarks to Production: A Text-to-SQL System for Complex Financial Data
The preprint describes Financial LINking Text-to-SQL (FLINT), a domain-specialized system for financial databases whose concepts are stored as opaque integer keys. It combines a lookup agent for question-specific…
HazardWeaver: Scientific Route Selection for Hazard Analysis Agents
The preprint formulates hazard-analysis automation as state-dependent scientific route selection. HazardWeaver combines an evidence-linked Hazard Knowledge Compiler with a Hazard Capability Graph that checks…
HyperBrowseComp: A Multilingual and Multimodal Stress Test for Web-Browsing Agents
The preprint presents 423 manually authored and human-validated questions across 13 languages. Items require obscure evidence discovery, multi-step clue chains, and heterogeneous sources such as videos, scanned…
Recursive Harness Self-Improvement for Frontier Reasoning Data Synthesis
The preprint introduces task-harness co-evolution for recursive reasoning-data synthesis. Online self-improvement turns solver failures into reusable skills, while post-task updates revise skills, prompts, and…
Agents Are Systems, Not Models: Rethinking Agentic Evaluation
The preprint evaluates agents as configurable systems whose task information, reasoning settings, self-verification, time budget, and backbone model all affect outcomes. On four scientific tasks, the abstract reports…
Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval
The preprint identifies a retrieval-level positivity problem: memories that are never retrieved cannot have their utility identified by store-level interventions. It proposes Causal Memory Policy, which reserves…
Mingbird: A Local-First Agent Harness Enabling Small Open Models to Complete Real Tasks
The preprint argues that many failures of 2B–9B open models on real tasks arise from the harness rather than the model. Mingbird is a local-first harness for Windows and Ollama with mechanisms including a byte-level…
ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research
The preprint builds a benchmark from judgments by 184 lead authors of 207 recent computer-science papers, who identified prior papers that advanced or could have advanced their projects and provided rationales. The…
VISTA: A Visual Harness for Reasoning in an Interactive World
The technical report introduces a visual harness that gives a multimodal model long-horizon visual context through direct perception, lossless visual memory, active retrieval, and input reorganization. The abstract…
Mimir: Physics-Grounded LLM Agents for Long-Horizon Irrigation Control
The preprint studies long-running irrigation decisions where actions change future states and errors compound. Mimir combines a structured physical interface, deterministic simulation, verified revision, bounded action…
Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Training
The preprint introduces 50,228 error-diagnosis pairs from 9,961 tasks across 33 environments, 19 harness families, and 23 policy models. Its Agentic Error-to-Training pipeline preserves traces and execution metadata…
PivotOPD: Learning to Recover from Pivotal Mistakes in Multi-Turn Agents
The technical report studies pivotal mistakes that move an agent farther from task completion during multi-turn interaction. Across three Qwen3 models, the abstract reports that more than half of failed rollouts…
Turbo Harness: Instance-Adaptive Harness Optimization
The preprint introduces Turbo Harness, which reuses artifacts from a completed global harness-optimization run, summarizes them into a structured playbook, and trains a harness editor to generate instance-specific…
WorldAuditBench: Interactive 3D World Auditing with Multimodal Agents
The preprint presents 213 anomaly tasks across 13 Unreal Engine 5 and three.js environments, covering five anomaly families. It evaluates five frontier models under a fixed exploration budget using VLA-led exploration…
Thinking Before Thinking: Scaling Agentic Inference Through Meta-Reasoning
The preprint introduces an inference-time harness in which a controller explicitly decides what partial work to reuse, whether to restart, when to stop, and which next work to dispatch. Workers perform task-level…
Learning Meta-Skills for Agent Harness Design in Test-Time AI4AI
The preprint studies a Builder model that learns to construct better execution environments for a frozen Target model. Its Meta-Skill encodes when support is needed and what resources to provide; the Builder learns…
Do LLM Agents Execute the Plans They Declare? From Planning-Mode Declaration to Pattern-Specific Execution
The preprint defines a Plan Declaration–Execution Gap and evaluates four declared planning modes: Predefined, Sequential, Hierarchical, and Search. Across four benchmarks and three LLMs, the abstract reports that only…
Failure-Transparent Agents: Benchmarking Post-Failure Reporting in Tool-Using Language Models
The preprint introduces a controlled benchmark for cases where a required tool fails and an agent may report success without supporting evidence. The benchmark contains 100 tasks with deterministic failure traces…
Reinforcing Agentic Creativity in Scientific Ideation with Night Science
The preprint introduces AI Night-Scientist, an agentic framework that uses reinforcement learning to shape when and how a model departs from predictable reasoning. It models creativity along action, process, and…
Report: Progressive Disclosure of Agent Skills
The report describes a Workday deployment context in which named procedures, or skills, are added to an LLM agent's context. It evaluates progressive disclosure (lazy-loading) of skills as a way to control the cost of…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
