mirror of
https://github.com/FlashML-org/FreeToken.git
synced 2026-11-21 01:52:30 +08:00
* feat(kvcache): add fp8_ds_mla and nvfp4_ds_mla kv formats for deepseek-v4 / v4.1 Window and compressed KV are stored as fp8_ds_mla rows (584 B instead of 1024 B) and indexer keys as MXFP4, holding the same values as the reference's quant round-trip. DeepSeek-V4.1's packed layout is named nvfp4_ds_mla and shares the row-format code. * refactor(engine): drop the model field from the dsv4 kv formats