mirror of
https://github.com/FlashML-org/FreeToken.git
synced 2026-11-22 01:25:34 +08:00
* feat(moe): bench hybrid fetch fractions per moe layer kind The ft bench bw profile (version 6) holds only layer_kinds rows, keyed by CPU format, options, expert shape, top_k and CPU worker threads; older profiles are ignored. ft bench bw --model also takes checkpoint paths and benches each of their layer kinds. Hybrid decode reads each layer's own row for its fetch fraction, else keeps a fixed cap of 1. --moe-strategy auto no longer upgrades to hybrid from the profile. * fix(bench): fill gguf mxfp4 scales, scope act_block to ds_fp4 and skip cpu-less rows