01 · inference
DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
QuestionHow can prefill computation costs and massive KV cache footprints be dramatically reduced to scale long-horizon agent workloads?
The paper introduces DeepSeek-V4.1-Flash, a multimodal MoE model featuring 552B backbone parameters and support for up to one million context tokens. Using a Causal Encoder-Decoder architecture, it activates 16B parameters per token during decode but only 8B during prefill to lower computational overhead. It combines cross-layer KV cache reuse in Compressed Sparse Attention 2 with FP4 KV caching, shrinking the global KV cache footprint to 890 bytes per token. Furthermore, SWA Bounded Replay reduces the persistent KV cache footprint to roughly 1/8 of DeepSeek-V4-Flash.
DeepSeek-V4.1-Flash is a multimodal MoE model with 552B backbone parameters and support for contexts of up to one million tokens.
The model activates 16B parameters per token during decode but only 8B parameters during prefill.
These designs reduce its global KV cache footprint to 890 bytes per token, roughly 1/4 of the corresponding footprint of DeepSeek-V4-Flash.