Field notes

2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.

Notes on consistency

4 notes

  1. What Current AI Benchmarks Leave Unmeasured: Modality, Search, Citations, and Implications (for Safety Evaluations)

    Source note · Aug 6, 2026 · artificial intelligence, large language model, web search

    The study compares two access modalities of a large language model (LLM), ChatGPT's chat UI and OpenAI's API, with and without web search enabled. The research shows that the accuracy of responses varies between the…

  2. Consistency-Driven Co-Evolution for Self-Supervised Cross-Representation Learning

    Source note · Aug 5, 2026 · ai, machine learning, evaluation

    The paper introduces CoCoEvolve, a method aimed at improving the consistency between chart, table, and code representations in AI systems. The method optimizes models based on agreement between different…

  3. Reasoning Consistency Scanning: A Framework for Auditing Chain-of-Thought Validity in AI Safety Evaluations

    Source note · Jul 8, 2026 · ai, evaluation, safety

    The paper introduces a method called Reasoning Consistency Scanning to assess the logical consistency between stated reasoning and answers in AI safety evaluation transcripts. The method can be applied to various AI…

  4. From Personas to Plot: Character-Grounded Multi-Agent Story Generation for Long-Form Narratives

    Source note · Jul 1, 2026 · consistency

    A new framework called MAGNET is introduced for generating long-form narratives using multiple agent characters that maintain consistency and coherence in their actions based on a shared world state and evolving story…

An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.