Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
3 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on ai benchmarks
3 notes
MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations
The paper introduces MemOps, a new benchmark for evaluating the lifecycle of memory operations in long-horizon conversations for LLM-based agents. Unlike existing benchmarks that focus on final answers, MemOps focuses…
ClassicLogic: A Knowledge-Driven Benchmark of Classic Puzzle Games for Evaluating Compositional Generalization
The paper introduces ClassicLogic, a new benchmark suite designed to evaluate an agent's ability to learn and compose problem-solving strategies in four classic logic puzzles: Sudoku, KenKen, Kakuro, and Futoshiki. The…
EvoAgentBench: Benchmarking Agent Self-Evolution via Ability Transfer
The paper introduces EvoAgentBench, a new benchmark for evaluating agent self-evolution in long-horizon learning machine systems. The benchmark focuses on procedural knowledge transfer across four domains: web…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
