Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
4 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on mathematical reasoning
4 notes
Mismatch Matters: On-Policy Distillation Beyond Token Agreement
Researchers present TIDE, a new method to address a failure mode in on-policy distillation (OPD) called degenerate agreement. This issue arises when students exploit repetitive loops to achieve high token agreement…
Mask-Aware Policy Gradients for Diffusion Language Models
The paper presents a method for improving the performance of large language models in tasks like mathematical reasoning and coding by using reinforcement learning. This method addresses the challenge of extending…
AIMO Interpretability Challenge
The AIMO Interpretability Challenge is a competition proposed by researchers aimed at distinguishing robust from spurious reasoning in advanced mathematical language models. The challenge focuses on evaluating the…
TREK: Distill to Explore, Reinforce to Refine
TREK is a procedure that uses distillation for exploration support expansion to improve policy optimization on tasks where the current policy stalls on hard prompts. It identifies low-performing prompts, generates…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
