Field notes

2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.

All notes, newest first

2,343 notes, page 5 of 98

  1. BackTrend: Evaluating Scientific Weak-Signal Prediction via Backward Reconstruction

    Source note · Sep 21, 2026 · evaluation, retrieval

    BackTrend is a retrospective benchmark that asks systems to recover early problem-space and solution-space precursors for mature AI/ML topics under temporal evidence constraints. It contains 25 mature topics and 66…

  2. DUMA-Bench: A Dual-Control Multi-Agent Benchmark for Evaluating LLM Agent Security

    Source note · Sep 21, 2026 · evaluation, agents, security

    DUMA-Bench evaluates agent security when both the agent and user can influence shared environment state. It extends tau-squared bench with adversarial environments covering eight vulnerability classes, including RAG…

  3. Et Tu, Brute? Economic Misalignment in Personal AI Agents

    Source note · Sep 21, 2026 · agents, safety, privacy

    The preprint studies personal agents making economic recommendations from user context, including email and structured personal attributes. It reports 325,000 experiments across 13 agents and three decision types…

  4. Emergent Collusion in Long-Horizon LLM Agent Interaction

    Source note · Sep 21, 2026 · evaluation, safety, governance

    The study examines two agents repeatedly completing tasks, sharing logs, verifying each other's work, and receiving rewards under a protocol whose compliance conflicts with reward maximization. The abstract reports…

  5. Harness-Zero: Harness Distillation via Agent-as-Harness

    Source note · Sep 21, 2026 · agents, efficiency, training

    Harness-Zero uses a domain- or instance-optimized harness as training-time guidance, then transfers its behavior into model weights so the specialized harness can be removed at deployment. An agent-as-harness corrects…

  6. Pinocchio: Fast Uncertainty Estimates for Black-Box Language Models

    Source note · Sep 21, 2026 · evaluation, reliability, inference

    Pinocchio is an external calibrator for estimating response correctness from black-box language-model APIs without logits, weights, internal states, or fine-tuning access. The preprint reports a single-forward-pass…

  7. AutoViewMem: Self-Configuring Orthogonal Views for Conversational Long-Term Memory

    Source note · Sep 18, 2026 · agents, memory, rag

    AutoViewMem discovers low-overlap semantic views from interaction traces, uses a compact complementary view set for structured write-time extraction, and grounds memories in provenance. It moves semantic…

  8. CodeMidas: Scaling Agentic Coding RL Environments from Code Itself

    Source note · Sep 18, 2026 · evaluation, reinforcement learning, software engineering

    CodeMidas converts implemented functionality in open-source codebases into executable reinforcement-learning environments using source code as the only task-specific input. Agents formulate behavioral specifications…

  9. Designer-RSI: Evolving Procedural Memory from User Traffic for Agentic Graphic Design

    Source note · Sep 18, 2026 · agents, memory, continual learning

    Designer-RSI uses a frozen frontier model operating professional design software through more than 230 tools and maintains an external procedural-memory bank of natural-language skills. The memory widens by adding…

  10. EnterpriseVal: Quantifying the Efficacy, Reliability and Value of Generative AI in the Enterprise

    Source note · Sep 18, 2026 · evaluation, governance, reliability

    EnterpriseVal specifies the tested workflow and frozen socio-technical configuration, including model, prompts, retrieval, tools, guardrails, human oversight, autonomy level, and consequence tier. It defines metrics…

  11. GUARD: Natural Forgetting in Large Reasoning Models via Guided Answer-Reasoning Distillation

    Source note · Sep 18, 2026 · evaluation, safety, unlearning

    GUARD frames unlearning in large reasoning models as learning a coherent non-disclosing reasoning trajectory followed by a stable refusal-style answer. It uses Guided Answer-Reasoning Distillation and introduces…

  12. How Do Agent Harnesses Create Value? Planning Information and Release Control in Stateful LLM Agents

    Source note · Sep 17, 2026 · agents, planning, verification

    Across 265 matched cells in Retail experiments and an Airline pilot in τ²-bench, the paper compares task-specific plans with shuffled text, and evaluates a read-only terminal verifier. It reports a 7.17-point…

  13. Ownership in AI-Assisted Everyday Tasks

    Source note · Sep 17, 2026 · human-ai interaction

    The exploratory qualitative study examines two self-selected AI-assisted tasks. Its abstract reports that perceived ownership depends on the collaboration process: approving suggestions alone can erode ownership, while…

  14. Refuse, Decompose, Refresh: A Claim-Safe Protocol for Closed-Loop AI Evaluation

    Source note · Sep 17, 2026 · evaluation, safety, uncertainty

    The protocol proposes three actions: refuse when a clean reference stream or matched runtime comparison lacks support; decompose execution, false admission, and structural hypotheses instead of collapsing them into…

  15. An Empirical Study of Harness Design for Coding Agents

    Source note · Sep 17, 2026 · evaluation, agents, software engineering

    The paper varies planning, action space, and context management in a fixed coding harness and evaluates 176 matched settings across four models on SWE-Bench Verified and Terminal-Bench 2.1. It reports that context…

  16. DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression

    Source note · Sep 17, 2026 · infrastructure, inference

    The record describes a 552B-backbone multimodal mixture-of-experts model with up to one million tokens of context, activating 16B parameters during decode and 8B during prefill. It reports cross-layer KV reuse, FP4 KV…

  17. Language-model groups overstate consensus when replaying human deliberation on a reasoning task

    Source note · Sep 17, 2026 · evaluation, safety, multi-agent

    The preprint replays 100 held-out human Wason groups with matched LLM agent groups, using belief-anchored agents and shared scoring code. It reports that consensus estimates depend on participation and final-state…

  18. PosteriorBench: From Point Estimates to Posterior Matching in Evaluating Generative Inverse Solvers

    Source note · Sep 17, 2026 · evaluation, uncertainty

    PosteriorBench evaluates whether generative inverse solvers recover full solution distributions rather than only one plausible reconstruction. It covers four physics-based inverse problems and uses reference posteriors…

  19. RAFT: A Stateful Retrieval-Augmented Framework for Troubleshooting Agents

    Source note · Sep 17, 2026 · agents, enterprise, rag

    RAFT models each closed support case as a directed chain of timeline entries and retrieves at the entry level, returning the parent-case trajectory anchored at a matching state. It evaluates against a synthetic…

  20. Score Centering Stabilizes Off-policy Reinforcement Learning

    Source note · Sep 17, 2026 · reinforcement learning, optimization, efficiency

    The preprint attributes instability in large-language-model reinforcement learning under training-inference mismatch to persistent drift between engines. It derives an additive score-centering correction that cancels…

  21. SkillAA: Attribution-Guided Skill-Graph Updating with Targeted Validation and Rollback

    Source note · Sep 17, 2026 · evaluation, agents, reliability

    SkillAA represents skill applicability, execution, and composition in a unified graph. It contrasts successful and failed executions to route local repairs, then uses local and broader validation gates before…

  22. SoL-Pi: Recursively Scaling Auto-Research Loops for Efficient Agent Harness

    Source note · Sep 17, 2026 · agents, efficiency, self-improvement

    SoL-Pi applies recursive self-improvement at the harness layer across many environments. The abstract describes mechanisms for action execution, context compaction, observation handling, and delegated reading; on a…

  23. Q&A on Any Spreadsheet Requires Interpreting Its Grid Structure

    Source note · Sep 17, 2026 · evaluation, rag

    The preprint argues that spreadsheet question answering requires interpreting two-dimensional grid structure. It proposes semantic cell-role annotation to improve chunking and interpretability for LLM-driven RAG. The…

  24. TRACE: Accountable Agentic Retrieval for Source Discovery in Digital Archives

    Source note · Sep 17, 2026 · agents, rag

    TRACE is a training-free agentic retrieval framework for historical archives with OCR degradation, heterogeneous document genres, and source-traceability requirements. The preprint describes an internal deployment for…

An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.