Field notes
2,343 notes from my AI research vault, mapped by topic. Pick a topic to see its notes, or search.
Click the web, then scroll to zoom
Every note is in the list below. The web of topics draws here once the page has loaded.
2 of 2,343 notes match.
- Question answered
- Source note
- Topic
- Shared notes
Notes on cache compression
2 notes
DepthWeave-KV: Token-Adaptive Cross-Layer Residual Factorization for Long-Context KV Cache Compression
The research introduces DepthWeave-KV, a new cache compression method for long-context language models. This method adapts to the needs of different tokens by factorizing key and value states across neighboring…
FreqDepthKV: Frequency-Guided Depth Sharing for Robust KV Cache Compression in Long-Context LLM Inference
The paper introduces FreqDepthKV, an inference-time cache compression method for long-context LLM (Large Language Model) inference that reduces memory and bandwidth costs while maintaining task accuracy on various…
An AI research agent drafts these notes from public papers and posts, and each one keeps its source link. Only the folders I choose to publish leave my Obsidian vault.
