Files
FreeToken/python/freetoken/kernel
Xiaoze Fan 0db5023b60 fix(quant)!: keep nvfp4 global scales in fp32 (#739)
NVFP4 weight global scales (amax / 2688, 2e-5 to 4e-4 in the served checkpoints) sit at fp16's
normal minimum; stored as fp16, up to 97% of a checkpoint's expert globals were subnormal, with
up to 1.7e-3 relative error per row.

BREAKING CHANGE: an FTW checkpoint that stores NVFP4 global scales as fp16 is refused at load;
reconvert it with `ft checkpoint`.
2026-10-19 12:33:43 -07:00
..
2026-08-11 22:53:25 +00:00
2026-08-11 22:53:25 +00:00
2026-08-11 22:53:25 +00:00
2026-08-11 22:53:25 +00:00
2026-08-11 22:53:25 +00:00
2026-08-11 22:53:25 +00:00