Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
2,343 notes and 295 topics.
- Question answered
- Source note
- Topic
- Shared notes
All notes, newest first
2,343 notes, page 2 of 98
VeriFine: Scaling Verification for Self-Improvement in Embodied Reasoning
The preprint proposes an agent harness that co-evolves the policy, training curriculum, and judge. A Policy Improvement Loop diagnoses recurring failures and builds an adaptive curriculum; when verification becomes a…
Agent in a Bottle: Can LLM Agents Turn Their Capabilities Into Cheap, Scalable Artifacts?
The preprint introduces BOTTLED, a benchmark in which agents receive an unlabelled workload and must complete it under fixed time, compute, and LLM API budgets. Agents may train a small model or write a reusable…
MedZERO: Self-Evolving Agents for Open-Ended Medical Reasoning Through Controlled Knowledge Accumulation
The preprint presents MedZERO, a self-evolving framework for open-ended medical reasoning. An Examiner generates medical question-option pairs, while a Reasoner solves them with evidence-grounded multi-turn reasoning…
ParanoiaEval: Benchmarking Unnecessary Defensive Work in Agentic Coding
The preprint introduces a benchmark for unified evaluation of risk-treatment capabilities in coding agents. It maps Avoidance, Transfer, Mitigation, and Acceptance from software risk management to 200…
SquidAgent: Parallelize Wisely, Coordinate Efficiently
The preprint identifies re-exploration and alignment as hidden costs that can make parallel multi-agent systems slower than a single-agent baseline. It proposes a token-based decision criterion, direct forking from the…
WorldSolver: Can LLM Agents Simulate the Physical Dynamics via Solver Generation?
The preprint introduces WorldSolver, a benchmark of 168 simulation tasks derived from physical phenomena in 61 classic computer-graphics papers across seven physical domains. Each task provides a code scaffold while…
AgentPrivArena: Evaluating and Auditing Real-world AI Agent Privacy
The preprint introduces AgentPrivArena, a reproducible environment that integrates authentic MCP tools and self-hosted services to evaluate privacy risks during realistic multi-step agent execution. It proposes…
What Did the Agent Actually Do? Evidence-Grounded Oversight for Long-Horizon Agents
The preprint introduces AgentMonBench, a software-engineering benchmark for judging requirement/behavior alignment and identifying consequential autonomous decisions that warrant verification. Its Evidence-Grounded…
Can Agent Harnesses and Inference Engines Hear Each Other? The HEAR Protocol for Agentic LLM Serving
The preprint proposes HEAR, a bidirectional Harness–Engine Pairing protocol that lets an agent harness communicate workflow intent and execution requirements while the inference engine returns runtime state…
HERA: Harness-Environment Co-Evolution for Reliable Agentic Abstention
The preprint introduces HERA, a framework that constructs verifiable feasible/infeasible task pairs through controlled environment mutations and adapts the agent harness toward prior weaknesses. The abstract reports…
ImproveAnyTask: An Autonomous Post-Training Harness for Iterative Model Self-Improvement
The preprint describes an autonomous post-training harness that attributes errors, selects update directions, and executes model updates under a limited compute budget. It combines metric- and case-level analysis…
Credit Where It Matters: Dependency-Aware Policy Optimization for Terminal Agents
The preprint proposes Dependency-Aware Group Policy Optimization (DepGPO) for multi-step terminal tasks. It builds a command dependency graph from execution traces, traces backward from resources inspected by a…
From Benchmarks to Production: A Text-to-SQL System for Complex Financial Data
The preprint describes Financial LINking Text-to-SQL (FLINT), a domain-specialized system for financial databases whose concepts are stored as opaque integer keys. It combines a lookup agent for question-specific…
HazardWeaver: Scientific Route Selection for Hazard Analysis Agents
The preprint formulates hazard-analysis automation as state-dependent scientific route selection. HazardWeaver combines an evidence-linked Hazard Knowledge Compiler with a Hazard Capability Graph that checks…
HyperBrowseComp: A Multilingual and Multimodal Stress Test for Web-Browsing Agents
The preprint presents 423 manually authored and human-validated questions across 13 languages. Items require obscure evidence discovery, multi-step clue chains, and heterogeneous sources such as videos, scanned…
Recursive Harness Self-Improvement for Frontier Reasoning Data Synthesis
The preprint introduces task-harness co-evolution for recursive reasoning-data synthesis. Online self-improvement turns solver failures into reusable skills, while post-task updates revise skills, prompts, and…
Agents Are Systems, Not Models: Rethinking Agentic Evaluation
The preprint evaluates agents as configurable systems whose task information, reasoning settings, self-verification, time budget, and backbone model all affect outcomes. On four scientific tasks, the abstract reports…
Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval
The preprint identifies a retrieval-level positivity problem: memories that are never retrieved cannot have their utility identified by store-level interventions. It proposes Causal Memory Policy, which reserves…
Mingbird: A Local-First Agent Harness Enabling Small Open Models to Complete Real Tasks
The preprint argues that many failures of 2B–9B open models on real tasks arise from the harness rather than the model. Mingbird is a local-first harness for Windows and Ollama with mechanisms including a byte-level…
ScholarCatalyst: A Benchmark for Retrieving Papers That Inspire New Research
The preprint builds a benchmark from judgments by 184 lead authors of 207 recent computer-science papers, who identified prior papers that advanced or could have advanced their projects and provided rationales. The…
VISTA: A Visual Harness for Reasoning in an Interactive World
The technical report introduces a visual harness that gives a multimodal model long-horizon visual context through direct perception, lossless visual memory, active retrieval, and input reorganization. The abstract…
The AI Assessment Sandbox Configurator: A Framework to Support Technical Assessment in AI Regulatory Sandboxes
The preprint describes an open-source framework for technical testing in AI regulatory sandboxes, motivated by EU AI Act obligations. It proposes a plug-in test and control catalogue, a shared data model for…
External Observers May See More Clearly: Cross-Model Span-Level Hallucination Detection in Large Language Models via Hidden State Probing
The preprint presents a hidden-state method for identifying the onset and continuation of hallucinated spans rather than making only token-level binary judgments. It proposes an external observer model that probes the…
Homomorphic Advantage Operator: Stabilizing Reinforcement Learning Under Fully Homomorphic Encryption Constraints
The preprint proposes the Homomorphic Advantage Operator to stabilize deep reinforcement learning when nonlinear operations are approximated under fully homomorphic encryption. It applies a zero-mean centering…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
