DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression

Source facts

The record describes a 552B-backbone multimodal mixture-of-experts model with up to one million tokens of context, activating 16B parameters during decode and 8B during prefill. It reports cross-layer KV reuse, FP4 KV caching, an 890-byte-per-token global KV footprint, and an approximately one-eighth persistent KV-cache footprint relative to DeepSeek-V4-Flash; checkpoints are linked from the record.

Analysis

The release frames inference economics around memory and bandwidth, especially for long-horizon agents. The architectural direction is less about adding raw parameter scale than reducing prefill and cache costs enough to make long-context agent workloads practical.

Uncertainty/Doubt

• This is a preprint/model-release record from the authors; the performance and footprint comparisons were not independently benchmarked here.