Field notes

2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.

Notes on legal ai

4 notes

  1. ContractScrub: A benchmark for final review of legal contracts

    Source note · Aug 20, 2026 · natural language processing, benchmark, legal ai

    The paper introduces ContractScrub, a new benchmark for evaluating the performance of Language Models (LLMs) in reviewing legal contracts for errors. The study finds that while LLMs perform well on general benchmarks…

  2. InsufficiencyBench: Evaluating LLM legal advice on underspecified user queries

    Source note · Aug 20, 2026 · evaluation, legal ai

    Researchers introduce InsufficiencyBench, a new legal benchmark to evaluate how well AI models can identify when user queries lack important information needed for accurate legal advice. The study finds that current AI…

  3. Evaluating RAG for French immigration law: a benchmark and baseline study

    Source note · Jul 27, 2026 · artificial intelligence, evaluation, benchmarking

    The paper presents a new benchmark for evaluating AI models used in French immigration law, focusing on permit-type recommendation, required document retrieval, and legal citation coverage. The study compares a…

  4. LLMs Prompted for Legal Context Object More: Overrefusal from Small On-Premises LLMs in Criminal Legal Context

    Source note · Jun 23, 2026 · ai ethics, language model behavior, legal ai

    Researchers investigated the impact of contextual framing, such as role-play prefixes, on overrefusal rates in small, deployable language models used as legal assistants. They found that authority-style prefixes…

An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.