mirror of
https://github.com/FlashML-org/FreeToken.git
synced 2026-11-22 17:53:30 +08:00
The NVFP4 release quantizes the attention gate with a different weight global scale than q/k/v, so one fused weight cannot carry a single global for all four parts. BREAKING CHANGE: an FTW checkpoint converted with the fused qkvg_proj no longer loads; reconvert it with `ft checkpoint`.