FIELD NOTES TOPIC
wikitext perplexity
1 note, newest first.
CARVE: Content-Aware Recurrent with Value Efficiency for Chunk-Parallel Linear Attention
The paper introduces CARVE (Content-Aware Recurrent with Value Efficiency), a recurrent model that addresses three issues in the leading delta-rule architecture (GDN-2). The primary problem is memory-blind gating…
