Field notes

2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.

Notes on verification

13 notes

  1. Cogentic: Multi-Agent Orchestration for Automated Proof Discovery

    Source note · Sep 30, 2026 · reasoning, verification, multi-agent

    The preprint describes an orchestrator that assigns independent provers to competing proof directions, uses specialized adversarial verification components, and promotes confirmed intermediate results into a persistent…

  2. NNV3: Expanding Neural Network Verification to New Architectures and Domains

    Source note · Sep 24, 2026 · robustness, verification, fairness

    The preprint presents NNV3, a MATLAB framework for formal verification of neural networks. It describes ModelStar for weight perturbation, VolumeStar for video and 3D inputs, GraphStar for graph neural networks…

  3. How Do Agent Harnesses Create Value? Planning Information and Release Control in Stateful LLM Agents

    Source note · Sep 17, 2026 · agents, planning, verification

    Across 265 matched cells in Retail experiments and an Airline pilot in τ²-bench, the paper compares task-specific plans with shuffled text, and evaluates a read-only terminal verifier. It reports a 7.17-point…

  4. Falsifiable Commitment Planning for Self-Correcting Web Agents

    Source note · Jul 27, 2026 · robustness, ai framework, verification

    Researchers propose a new framework called FCPAgent for web agents to ensure they stay on track during long-term planning. The framework represents each plan step as a Falsifiable Commitment Unit (FCU) that includes…

  5. Partially Correlated Verifier Cascades in LLM Harnesses: Concave Log-Odds, Polynomial Reliability, and Blind-Spot Ceilings

    Source note · Jul 15, 2026 · reliability, verification

    The text presents a new theory for partially correlated verifier cascades in LLM harnesses (a system used to verify candidate answers). The theory provides insights into the growth and decay of failure rates, the…

  6. Evidence-Grounded Verified Agentic Reasoning: A Path Toward Eliminating LLM Hallucination in Empirical Inference via Tool-Attested Kernel Proofs

    Source note · Jul 14, 2026 · ai, language model, verification

    The paper introduces EG-VAR, a tool-calling architecture that aims to make the reasoning of a large language model (LLM) more trustworthy by verifying all outputs through tool-attestation axioms and kernel checks. The…

  7. Physics-Audited Agentic Discovery in Scientific Machine Learning

    Source note · Jul 8, 2026 · machine learning, verification

    The paper introduces Physics-Audited Agentic Scientific Machine Learning (PA-SciML), a new workflow that verifies the accuracy of surrogate models discovered by large language model agents in scientific machine…

  8. Harnessing Code Agents for Automatic Software Verification

    Source note · Jul 7, 2026 · artificial intelligence, software engineering, verification

    The authors propose a new method for automatic software verification using large language models (LLMs) in the form of 'code agents'. Instead of wireting a fixed proof strategy, they allow the code agent to choose its…

  9. LLM-as-a-Verifier: A General-Purpose Verification Framework

    Source note · Jul 6, 2026 · ai, language models, verification

    The paper introduces LLM-as-a-Verifier, a general-purpose verification framework that provides fine-grained feedback to improve the accuracy of agentic tasks. The framework scales across multiple dimensions for better…

  10. LLM-as-a-Verifier: A General-Purpose Verification Framework

    Source note · Jul 6, 2026 · ai, machine learning, reinforcement learning

    In this research, a general-purpose verification framework called LLM-as-a-Verifier is introduced. This framework provides detailed feedback for agentic tasks without requiring additional training. The framework…

  11. Theoria: Rewrite-Acceptability Verification over Informal Reasoning States

    Source note · Jul 1, 2026 · ai, verification

    Theoria is a verification architecture proposed by Ben Slivinski and Michael Saldivar that aims to close the gap between formal proof assistants and scalar LLM judges in determining when an AI system's answer can be…

  12. AxDafny: Agentic Verified Code Generation in Dafny

    Source note · Jun 30, 2026 · benchmark, code generation, verification

    Researchers present AxDafny, a framework for generating executable code and proof artifacts in Dafny using a verifier-guided repair method. The study uses a benchmark called LiveCodeBench-Pro-Dafny with 250 programming…

  13. Bayesian control for coding agents

    Source note · Jun 23, 2026 · coding agents, verification, uncertainty quantification

    The paper proposes a Bayesian controller for coding agents that make decisions based on a belief over candidate correctness, rather than fixed rules. This method is found to be most useful when verification is costly…

An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.