Field notes

2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.

Notes on testbed

4 notes

  1. LACUNA: A Testbed for Evaluating Localization Precision for LLM Unlearning

    Source note · Jul 2, 2026 · evaluation, unlearning, data privacy

    Researchers introduce a new testbed called LACUNA that allows for the evaluation of unlearning methods at the parameter level, rather than just the output level. They find that current state-of-the-art (SOTA)…

  2. LACUNA: A Testbed for Evaluating Localization Precision for LLM Unlearning

    Source note · Jul 2, 2026 · evaluation, privacy, unlearning

    Researchers introduce LACUNA, a testbed that allows for direct evaluation of unlearning methods at the parameter level. LACUNA is used to assess current state-of-the-art unlearning methods and finds them to be…

  3. LACUNA: A Testbed for Evaluating Localization Precision for LLM Unlearning

    Source note · Jul 2, 2026 · llm, unlearning, testbed

    The researchers introduce a new testbed called LACUNA for evaluating the precision of post hoc removal methods (unlearning) for LLMs. The testbed focuses on injecting personal identifiable information into specific…

  4. AI-Assisted Computational Reproducibility on the FABRIC Testbed

    Source note · Jun 24, 2026 · ai, reproducibility, testbed

    This paper discusses the use of an international research testbed, FABRIC, combined with a large language model (LLM) coding assistant called LoomAI, to simplify the reproduction of published experiments across various…

An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.